Abstract: An albedo estimating section produces an albedo image of an object from an original image captured by an image-capturing section by using light source information estimated by a light source information estimating section and shape information of the object obtained by a shape information obtaining section. An albedo super-resolution section performs super-resolution of the albedo image according to a conversion rule obtained from an albedo DB. A super-resolution section produces a high-resolution image obtained by performing super-resolution of the original image by using the super-resolution albedo image, the light source information and the shape information.

Abstract: A recording process records low-resolution video data while obtaining a high-resolution image in a window region being a portion of an entire image. Then, the process learns, as a resolution conversion rule, a resolution increasing parameter by using the high-resolution image. In a resolution increasing process, the resolution of the recorded low-resolution video data is increased by using the resolution increasing parameter learned in the recording process.

Abstract: The process captures a plurality of images under a light source whose luminance varies over time, such as a fluorescent lamp, under such an imaging condition that a plurality of images that are different from one another in terms of light source conditions can be captured (S11). The process detects a temporal luminance variation from the plurality of captured images (S12), estimates a shadow area by using the temporal luminance variation (S13), and performs an image process such as a process of synthesizing a linearized image or an image segmentation based on optical characteristics (S14).

Abstract: A multi-color image processor according to the present invention includes an image capturing section 101 and a signal processing section 104. The image capturing section 101 includes a color separating section 10 for separating visible radiation into at least two light rays with first- and second-color components, respectively, and first and second imagers 12 and 14 that receive the light rays with the first- and second-color components. The image capturing section 101 gets images with the first- and second-color components by making the first imager 12 decimate pixels to read, but making the second imager 14 read every pixel, on a field-by-field basis on respective arrangements of pixels of the first and second imagers 12 and 14.

Abstract: A recording process records low-resolution video data while obtaining a high-resolution image in a window region being a portion of an entire image. Then, the process learns, as a resolution conversion rule, a resolution increasing parameter by using the high-resolution image. In a resolution increasing process, the resolution of the recorded low-resolution video data is increased by using the resolution increasing parameter learned in the recording process.

Abstract: The resolution of an image of an object is increased. The illumination equation parameters of the object are estimated, and a resolution-increasing process is performed on the estimated illumination equation parameters. Then, the resolution-increased illumination equation parameters are synthesized together to produce a high-resolution image. If there is a pixel for which the estimation precision of the estimated illumination equation parameters does not satisfy a predetermined precision, the illumination equation parameters are estimated again while feeding back the resolution-increased illumination equation parameters.

Abstract: A polarized image acquisition section shoots a subject through a polarizing element operable to set principal axes of which directions are different from each other. An incident plane specifying section specifies an incident plane of each pixel, and an incident angle computation section computes an incident angle of each pixel. A classifying section clusters pixels similar to each other in both incident plane and incident angle. A reflection component separation section performs reflection component separation on each clustered pixel set on the assumption of probabilistic independence between the diffuse reflection component and the specular reflection component.

Abstract: An image processing apparatus according to the present invention includes: a color and polarization obtaining section 101 including a single-chip color image capture element with a color mosaic filter and a patterned polarizer in which a number of polarizer units, of which the polarization transmission planes define mutually different angles, are arranged adjacent to each other within each single color pixel; a color information processing section 102 for getting average color intensity information by averaging the intensities of the light rays that have been transmitted through the polarizer units within each said single color pixel; and a polarization information processing section 103 for approximating, as a sinusoidal function, a relation between the intensity of light rays that have been transmitted through the polarizer units within each said single color pixel and the angles of the polarization transmission planes of the polarizer units.

Abstract: For a first region being a portion of a storage section (202), a read-out pulse produced by a progressive scanning shift register (206) is used to perform a progressive read-out operation of reading out signals from all rows of image-storing pixels (221). For a second region including an entire region other than the first region, a read-out pulse produced by a skip scanning shift register (205) is used to perform a skip read-out operation of reading out signals from intermittently-selected rows of image-storing pixels (221). The progressive scanning shift register (206) produces the read-out pulse so that the first region moves every frame and an entire region of the storage section (202) is scanned over a plurality of frames.

Abstract: An image processing apparatus according to the present invention includes: a color and polarization obtaining section 101 including a single-chip color image capture device that has a color mosaic filter 201 and a patterned polarizer 202 in which a number of polarizer units, having polarization transmission planes defining mutually different angles, are provided for multiple pixels of the same color (G) in the color mosaic filter 201; a polarization information processing section 103 for approximating, as a sinusoidal function, a relation between the intensities of light rays that have been transmitted through the polarizer units for the G pixels and the angles of the polarization transmission planes of the polarizer units; and a color mosaic interpolation section 103 for generating a color intensity image by performing color intensity interpolation and getting a color intensity that cannot be obtained at a pixel of interest.

Abstract: To provide an image-capturing apparatus and an image-capturing method which keeps, even when an object or a photographer moves, the object-missing capturing to a minimum and which allows recording for a longer period of time.

Abstract: An image taking device has a multifocal lens which changes its focal length to change the image taking area on a subject from which an image is to be taken by an image pickup sensor, a distance sensor for measuring the distance to the subject, an image taking distance buffer unit for temporarily storing the image taking distance measured at a past time, a focal length computation unit which computes the focal length of the multifocal lens on the basis of the image taking distance at the present time measured by the distance sensor and the image taking distance supplied from the mage taking distance buffer unit, and a focus control unit which controls the focal length of the multifocal lens so that the focal length of the multifocal lens equals the focal length computed by the focal length computation unit.

Abstract: The process captures a plurality of images under a light source whose luminance varies over time, such as a fluorescent lamp, under such an imaging condition that a plurality of images that are different from one another in terms of light source conditions can be captured (S11). The process detects a temporal luminance variation from the plurality of captured images (S12), estimates a shadow area by using the temporal luminance variation (S13), and performs an image process such as a process of synthesizing a linearized image or an image segmentation based on optical characteristics (S14).

Abstract: The image processing device performs processing on a shadow in an image of an object, and includes: an image information obtaining unit obtaining information about an image of the object, the information including luminance information about luminance of light from the object and polarization information about polarization of the light from the object; a shadow area extracting unit extracting an attached shadow area and a cast shadow area from the image of the object based on the luminance information and the polarization information, the attached shadow area appearing on the surface of the object depending on an angle of incidence light, and the cast shadow area appearing on the surface of a material body other than the object when the light is blocked by the object; and an output unit outputting information identifying the attached shadow area and cast shadow area.

Abstract: An image taking device (100) capable of taking an image by directly reflecting an image-taking idea while avoiding alienation of zooming from other kinds of camera work has a multifocal lens (101) which changes its focal length to change the image taking area on a subject (300) from which an image is to be taken by an image pickup sensor (102), a distance sensor (104) for measuring the distance (image taking distance D) to the subject (300), an image taking distance buffer unit (105) for temporarily storing the image taking distance Di?1 measured at a past time Ti?1, a focal length computation unit (106) which computes the focal length F of the multifocal lens (101) on the basis of the image taking distance Di at the present time Ti measured by the distance sensor (104) and the image taking distance Di?1 supplied from the mage taking distance buffer unit (105), and a focus control unit (107) which controls the focal length of the multifocal lens (101) so that the focal length of the multifocal lens (101) equa

Abstract: The normal vector information generating device generates normal vector information on the surface of an object, and includes: an image information obtaining unit obtaining information about an image of the object, the information including luminance information about luminance of light from the object and polarization information about polarization of the light; a shadow area extracting unit extracting an attached shadow area and a cast shadow area from the image based on the luminance information and the polarization information, the attached shadow area appearing on the surface of the object depending on an angle of incidence light, and the cast shadow area appearing on the surface of a material body when the light is blocked by the object; and a normal vector information generating unit generating normal vector information identifying a normal vector on the surface of the object in the attached shadow area using the polarization information.

Abstract: The present invention provides a display control method and a display control device capable of detecting a position and an orientation of an apparatus by a simple structure and controlling a display of a displayed image based on the detected position and orientation of the apparatus with ease. Two cameras are mounted on the apparatus. A user holds the apparatus in the hand, captures, by a first camera, a first image including the face of the user, and captures, by a second camera, a second image including a scene opposite to the user. A display control unit extracts features of the face from the first image and extracts scene feature points from the second image. Then, the display control unit compares the extracted results with reference graphics and the like, and calculates a user-to-apparatus distance ro and angles ?o, ?o which indicate a direction to the apparatus, and controls the display of the displayed image based on the calculated distance ro and angles ?o, ?o.

Abstract: To provide a multiplexing method which facilitates a reproduction process and reduces unpleasantness felt by a viewer about image quality. The multiplexing method includes: a step of judging whether or not a clip to be coded should be coded as part of a continuous reproduction unit in which bitstreams are structured so as to allow continuous reproduction (S100); a step of determining a color space that is common within the continuous reproduction unit when it is judged that the clip should be coded as part of the continuous reproduction unit (S110); a step of generating bitstreams by coding the clip to be coded according to a determined color space (S112); and a step of packet-multiplexing bitstreams (S118).

Abstract: To provide an image capturing apparatus that detects a camera movement accurately and corrects image blurring appropriately. An image capturing apparatus (200) includes: an image sensor unit (103) that captures and outputs an input image (105); an output unit (121) that outputs an image of a framing area (160) of the input image (105); a motion vector calculation unit (106) and a stationary object detection unit (201) that detect motion vectors in an outer-frame area (161) of the input image (105) and derive detection accuracy; an outer-frame area adjustment unit (205) that adjusts the outer-frame area (161) in size so that the detection accuracy meets an outer-frame area change threshold (tr); and a camera movement calculation unit (113) and a framing area modification unit (115) that move the framing area (160) according to motion vectors in the adjusted outer-frame area (161), irrespective of motion vectors in the other area.

Abstract: A plurality of parameters included in a predetermined illumination equation which defines a brightness are acquired for each pixel of an image. For each of the parameters, a homogeneous region including pixels which are similar in value of the parameter is specified. In each of the specified homogeneous region, each of the parameters is converted according to details of the predetermined image conversion. The brightness of each pixel of a second image is determined using the values of the parameters obtained after the conversion.