Abstract: An exemplary image processing apparatus comprises: a polarized light source section; an image capturing section which sequentially captures an image of the object that is being illuminated with each of three or more plane polarized light rays; and an image processing section. The image processing section includes: a varying intensity processing section which calculates a state of polarized light reflected from the object's surface; a reflection decision section which distinguishes a multi-reflection region in which incoming light is reflected twice from a recessed region from a once-reflected region in which the incoming light is reflected only once from the object's surface; and a mirror image search section which locates a pair of multi-reflection regions. Based on the pair of multi-reflection regions, the image processing section generates an image representing the recessed region on the object's surface.

Abstract: An image processing apparatus according to the present invention includes a single-chip color image capture element that has a color mosaic filter 201 and a patterned polarizer 202 in which a number of polarizer units, having polarization transmission planes defining at least three different angles, are provided for multiple pixels of the same color (G) in the color mosaic filter 201.

Abstract: A polarization image sensor includes: photodiodes arranged on an image capturing plane; a color mosaic filter in which color filters in multiple different colors are arranged to face the photodiodes; an optical low-pass filter which covers the color mosaic filter; and polarization optical elements located closer to a light source than the optical low-pass filter is. Each polarization optical element covers an associated one of the photodiodes and makes light which is polarized in a predetermined direction in a plane that is parallel to the image capturing plane incident onto the optical low-pass filter. The color filters are arranged so that light that has passed through polarization optical elements is transmitted through an associated one of the color filters in a single color. Each color filter covers multiple photodiodes.

Abstract: To provide a multiplexing method which facilitates a reproduction process and reduces unpleasantness felt by a viewer about image quality. The multiplexing method includes: a step of judging whether or not a clip to be coded should be coded as part of a continuous reproduction unit in which bitstreams are structured so as to allow continuous reproduction (S100); a step of determining a color space that is common within the continuous reproduction unit when it is judged that the clip should be coded as part of the continuous reproduction unit (S110); a step of generating bitstreams by coding the clip to be coded according to a determined color space (S112); and a step of packet-multiplexing bitstreams (S118).

Abstract: A polarization camera that can capture polarization images and a color image at the same time is used. Specifically, a clear sky polarization image, which provides information about the polarization of a part of the sky, is captured by a clear sky polarization image capturing section 100. And by reference to the information provided by a sun position determining section 1301 that determines the sun's position at the time of shooting, a camera direction estimating section 101 determines in what direction and in what area of the whole sky the clear sky polarization image is located as a polarization pattern. Finally, information about what direction or orientation on the globe the camera (image capture device) is now facing is output. In this manner, the direction of the camera and the relative position of the camera with respect to the sun can be known without providing a sensor separately and without capturing the whole sky or the sun.

Abstract: It is possible to realize a novel video processing device that can utilize the compatibility between the spaces of an encoded image in an xvYCC system with a wide color gamut and an encoded image in the conventional YCbCr system. The video signal processing device detects the type of the recording medium with a video medium type detection portion, obtains the color gamut of the video signal with a video color gamut obtaining portion, determines a color adjustment parameter with a color adjustment parameter determining portion, performs color adjustment on the video signal with a video color adjustment portion based on that parameter, records the color-adjusted video signal to the recording medium.

Abstract: An exemplary image processing apparatus comprises: a polarized light source section; an image capturing section which sequentially captures an image of the object that is being illuminated with each of three or more plane polarized light rays; and an image processing section. The image processing section includes: a varying intensity processing section which calculates a state of polarized light reflected from the object's surface; a reflection decision section which distinguishes a multi-reflection region in which incoming light is reflected twice from a recessed region from a once-reflected region in which the incoming light is reflected only once from the object's surface; and a mirror image search section which locates a pair of multi-reflection regions. Based on the pair of multi-reflection regions, the image processing section generates an image representing the recessed region on the object's surface.

Abstract: An exemplary 3D image shooting apparatus comprises: a polarized light source; an image capturing section that sequentially captures an image of the object that is being illuminated with each of plane polarized light rays, and an image processor. The image capturing section includes: a lens; an image sensor; and an incoming light transmitting section which has a transparent area and a plurality of polarization filter areas. The polarization filter areas are arranged outside of the transparent area, generally have a concentric ring shape, and include left and right filter areas so that their polarization transmission axis directions define an angle ? (0<?<90 degrees). The image processing section generates a plurality of images from light that has been transmitted through the transparent area and light that has been transmitted through the plurality of polarization filter areas.

Abstract: A recording process records low-resolution video data while obtaining a high-resolution image in a window region being a portion of an entire image. Then, the process learns, as a resolution conversion rule, a resolution increasing parameter by using the high-resolution image. In a resolution increasing process, the resolution of the recorded low-resolution video data is increased by using the resolution increasing parameter learned in the recording process.

Abstract: In one embodiment, an element 106 transforms non-polarized light into plane polarized light with an arbitrary plane of polarization. A synchronizer 112 gives the element 106 an instruction to rotate the plane of polarization, thereby getting the plane of polarization of the illumination rotated and casting that polarized illumination toward the object. At the same time, the synchronizer 112 sends a shooting start signal to an image sensor 110, thereby getting video. The synchronizer 112 performs these processing steps multiple times. A captured video signal is sent to an image processing processor 108. Candidates for the azimuth angle of a surface normal are obtained based on an intensity maximizing angle image, the zenith angle of the surface normal is obtained based on a degree of intensity modulation image, and the ambiguity of the azimuth angle is solved, thereby generating a surface groove normal image.

Abstract: In one embodiment, an element 106 transform, with a voltage, non-polarized light into plane polarized light with an arbitrary plane of polarization. A synchronizer 112 gives the plane of polarization control element 106 an instruction to rotate the plane of polarization, thereby getting the plane of polarization of the illumination rotated and casting that polarized light toward the object. At the same time, the synchronizer 112 sends a shooting start signal to an image sensor 110, thereby getting video. The synchronizer 112 performs these processing steps multiple times. A captured video signal is sent to an image processing processor 108, where LL, RR and CC images are separately generated as images of light rays that have passed through left and right polarizing areas and the central non-polarizing area and left and right parallax signals are generated and sent to a 3D display section 122.

Abstract: A polarization image capturing section 103 obtains a first polarization image containing polarization information. A polarization information obtaining section 104 obtains first polarization information from the first polarization image. An illumination control section 102 changes an illumination section 101 and again obtains a second polarization image by means of the polarization image capturing section 103. The polarization information obtaining section 104 obtains second polarization information from the second polarization image. A light source dependency estimation section 105 obtains light source dependency from the first and second polarization information obtained from the first and second polarization images. An area dividing section 106 performs an area division by using the polarization information and light source dependency information.

Abstract: The resolution of an image of an object is increased. The illumination equation parameters of the object are estimated, and a resolution-increasing process is performed on the estimated illumination equation parameters. Then, the resolution-increased illumination equation parameters are synthesized together to produce a high-resolution image. If there is a pixel for which the estimation precision of the estimated illumination equation parameters does not satisfy a predetermined precision, the illumination equation parameters are estimated again while feeding back the resolution-increased illumination equation parameters.

Abstract: An image processing apparatus according to the present invention includes: a color and polarization obtaining section 101 including a single-chip color image capture device that has a color mosaic filter 201 and a patterned polarizer 202 in which a number of polarizer units, having polarization transmission planes defining mutually different angles, are provided for multiple pixels of the same color (G) in the color mosaic filter 201; a polarization information processing section 103 for approximating, as a sinusoidal function, a relation between the intensities of light rays that have been transmitted through the polarizer units for the G pixels and the angles of the polarization transmission planes of the polarizer units; and a color mosaic interpolation section 103 for generating a color intensity image by performing color intensity interpolation and getting a color intensity that cannot be obtained at a pixel of interest.

Abstract: An image processor (101) according to a preferred embodiment of the present invention includes a polarized light source (102) and a polarization camera (103). In shooting an object (104), the object is irradiated with polarized light (105) that rotates its polarization plane. The polarized light is reflected from the object's surface and the polarized reflected light (106) reaches the polarization camera (103), thereby recording an image there. The polarization camera (103) includes a polarization image sensor (201), an intensity and polarization information processing section (202), a polarization plane control section (204), and an image capturing control section (205). By capturing an image every time the polarization plane control section (204) changes the polarization state of the polarized light, an intensity image Y and a polarization phase image P are obtained in association with each polarization state.

Abstract: An image processing apparatus captures an object's image and separates the object's image into multiple components. The apparatus includes: a light projecting section 101 for projecting light emitted from a light source toward the object; a color and polarization obtaining section 102 for getting a color polarized image of the object; a polarization information processing section 104 for generating color and polarization information based on an association between the intensity of the light that has been transmitted through a polarizer with three or more polarization principal axis directions and the polarization principal axis directions for each of unit pixels that form the color polarized image; a light source color information collecting section 105 for collecting color information of the light source; and an image component separating section 106 for separating the color image into multiple components based on the polarization information and the color information of the light source.

Abstract: To provide an image capturing apparatus that detects a camera movement accurately and corrects image blurring appropriately. An image capturing apparatus (200) includes: an image sensor unit (103) that captures and outputs an input image (105); an output unit (121) that outputs an image of a framing area (160) of the input image (105); a motion vector calculation unit (106) and a stationary object detection unit (201) that detect motion vectors in an outer-frame area (161) of the input image (105) and derive detection accuracy; an outer-frame area adjustment unit (205) that adjusts the outer-frame area (161) in size so that the detection accuracy meets an outer-frame area change threshold (tr); and a camera movement calculation unit (113) and a framing area modification unit (115) that move the framing area (160) according to motion vectors in the adjusted outer-frame area (161), irrespective of motion vectors in the other area.

Abstract: The process captures a plurality of images under a light source whose luminance varies over time, such as a fluorescent lamp, under such an imaging condition that a plurality of images that are different from one another in terms of light source conditions can be captured (S11). The process detects a temporal luminance variation from the plurality of captured images (S12), estimates a shadow area by using the temporal luminance variation (S13), and performs an image process such as a process of synthesizing a linearized image or an image segmentation based on optical characteristics (S14).

Abstract: In a learning process, first, images having different resolutions are obtained from a target region of the subject (S101). Further, the subject characteristic of the target region is obtained (S102). Then, the resolution conversion rules are learned from the images having different resolutions, and those are recorded to a storage device along with the subject characteristics (S103). When converting the resolutions, the resolution conversion rules learned for the corresponding subject characteristics are applied to each region of the original image so as to convert the resolutions of the original image.

Abstract: According to the present invention, a polarized image is captured, a variation in its light intensity is approximated with a sinusoidal function, and then the object is spatially divided into a specular reflection area (S-area) and a diffuse reflection area (D-area) in Step S402 of dividing a reflection area. Information about the object's refractive index is entered in Step S405, thereby obtaining surface normals by mutually different techniques in Steps S406 and S407, respectively. Finally, in Steps S410 and S411, the two normals are matched to each other in the vicinity of the boundary between the S- and D-areas.