Abstract: Provided is an image processing device that removes noise caused by disturbance during image capture from a captured image by image processing, the image processing device includes an image input unit to which a plurality of temporally continuous captured images are input, an image feature extraction unit that extracts features related to the disturbance in the captured images, and an image sharpening unit that performs image processing based on the features related to the disturbance to thereby remove noise in the captured images. Further, the image processing device may further include mode switching means for switching between a monitoring mode for performing image processing based on the features related to the disturbance and a normal mode for preventing the image processing based on the features related to the disturbance from being performed.

Abstract: A video distribution method is a video distribution method to be performed by a server that distributes a plurality of videos captured by a plurality of users from different viewpoints to a terminal apparatus. The video distribution method includes distributing, from a server to a terminal apparatus, a first video that is one of a plurality of videos captured by a plurality of users from different viewpoints and that is requested by the terminal apparatus, selecting a second video that is one of the plurality of videos and that is likely to be next requested next time by the terminal apparatus, and starting transmission of the second video to the terminal apparatus during distribution of the first video to the terminal apparatus.

Abstract: Provided is an image processing device that removes noise caused by disturbance during image capture from a captured image by image processing, the image processing device includes an image input unit to which a plurality of temporally continuous captured images are input, an image feature extraction unit that extracts features related to the disturbance in the captured images, and an image sharpening unit that performs image processing based on the features related to the disturbance to thereby remove noise in the captured images. Further, the image processing device may further include mode switching means for switching between a monitoring mode for performing image processing based on the features related to the disturbance and a normal mode for preventing the image processing based on the features related to the disturbance from being performed.

Abstract: An apparatus includes: a generating unit which generates, from each of images respectively obtained at viewpoint positions, one of different-viewpoint images which corresponds to an image at a virtual viewpoint position different from the viewpoint positions, the different-viewpoint image including a hole area in which a pixel value is missing; a calculating unit which calculates, for each of processing units respectively in predetermined areas in the different-viewpoint images, a hole density indicating, with respect to the predetermined area, a ratio of one of the hole areas in the processing units in the different-viewpoint images; a calculating unit which calculates, for each processing unit, a combination ratio of the different-viewpoint image, based on the hole density of the processing unit co-located with an other one of the processing units in an other one of the different-viewpoint images; and a combining unit which combines the different-viewpoint images, based on the combination ratios.

Abstract: A video distribution method is a video distribution method to be performed by a server that distributes a plurality of videos captured by a plurality of users from different viewpoints to a terminal apparatus. The video distribution method includes distributing, from a server to a terminal apparatus, a first video that is one of a plurality of videos captured by a plurality of users from different viewpoints and that is requested by the terminal apparatus, selecting a second video that is one of the plurality of videos and that is likely to be next requested next time by the terminal apparatus, and starting transmission of the second video to the terminal apparatus during distribution of the first video to the terminal apparatus.

Abstract: An apparatus for generating a new viewpoint image includes: a new viewpoint image generation unit that shifts the foreground image region in the input image, based on a depth map to generate a new viewpoint image including a missing pixel region; a representative background pixel selection unit that selects background pixels located a predetermined number of pixels away from edge pixels, as representative background pixels; a texture direction map calculation unit that calculates a texture direction of each of the selected representative background pixels, to calculate a texture direction map indicating texture directions, each corresponding to one of missing pixels, based on locations of the representative background pixels and locations of the missing pixels included in the missing pixel region; and a hole-filling processing unit that fills the missing pixel region with the obtained background pixels in accordance with the texture direction map.

Abstract: An image interpolation apparatus includes: a first processing unit which calculates an error on image data between a patch to be interpolated that overlaps with a masked region and a reference patch that does not overlap with the masked region; a second processing unit which calculates, based on the image data, feature quantities indicating the degrees of flatness of the respective patch regions; a third processing unit which calculates an error between their feature quantities; a fourth processing unit which selects a reference patch that has produced a least significant error based on results obtained by the first and third processing units; and a fifth processing unit which pastes pixel data of the reference patch that the fourth processing unit has selected onto the patch to be interpolated. The third processing unit calculates an error between the feature quantities by comparing the feature quantity of the patch to be interpolated outside of the masked region to that of the entire reference patch.

Abstract: A parallax image generation device includes: a depth value correction unit which performs correction processing on a depth value, from among a plurality of depth values which define a depth image, to shift a position corresponding to the depth value to be closer to a display screen as the depth value is located closer to an end of the depth image, the display screen being for displaying a parallax image; and a parallax image generation unit which generates a first parallax image and a second parallax image having mutual parallax, using a two-dimensional image and the depth image corrected through the correction processing.

Abstract: A data input unit is configured to receive an input image, depth data and a shooting parameter. A parameter input unit receives a transformation parameter as a parameter on projective transformation of a three-dimensional model, a transformed image generating unit that generate a transformed image by performing projective transformation based on the transformation parameter in the three-dimensional model obtained from the input image, the depth data, and the shooting parameter. A blank area detecting unit detects a blank area in the transformed image, the blank area being a group of blank pixels having no corresponding pixel in the input image, and an output unit is configured to output the transformed image in the case where a blank value indicating size of the blank area is smaller than or equal to a threshold value.

Abstract: An image interpolation apparatus includes: a first processing unit which calculates an error on image data between a patch to be interpolated that overlaps with a masked region and a reference patch that does not overlap with the masked region; a second processing unit which calculates, based on the image data, feature quantities indicating the degrees of flatness of the respective patch regions; a third processing unit which calculates an error between their feature quantities; a fourth processing unit which selects a reference patch that has produced a least significant error based on results obtained by the first and third processing units; and a fifth processing unit which pastes pixel data of the reference patch that the fourth processing unit has selected onto the patch to be interpolated. The third processing unit calculates an error between the feature quantities by comparing the feature quantity of the patch to be interpolated outside of the masked region to that of the entire reference patch.

Abstract: An apparatus includes: a generating unit which generates, from each of images respectively obtained at viewpoint positions, one of different-viewpoint images which corresponds to an image at a virtual viewpoint position different from the viewpoint positions, the different-viewpoint image including a hole area in which a pixel value is missing; a calculating unit which calculates, for each of processing units respectively in predetermined areas in the different-viewpoint images, a hole density indicating, with respect to the predetermined area, a ratio of one of the hole areas in the processing units in the different-viewpoint images; a calculating unit which calculates, for each processing unit, a combination ratio of the different-viewpoint image, based on the hole density of the processing unit co-located with an other one of the processing units in an other one of the different-viewpoint images; and a combining unit which combines the different-viewpoint images, based on the combination ratios.

Abstract: A video editing apparatus includes: a selection unit which receives a first editing point and a second editing point; a representative value generation unit which generates a representative value of first disparity information on disparities of the first editing point and a representative value of second disparity information on disparities of the second editing point; a comparison value calculation unit which calculates a first depth difference by a comparison between the representative value of the first disparity information and the representative value of the second disparity information; a determination unit which determines whether or not the first depth difference is less than or equal to a predetermined value; and a presenting unit which presents a message prompting a user to change at least one of the first editing point and the second editing point when it is determined that the first depth difference is greater than the predetermined value.

Abstract: An imaging apparatus includes: an imaging unit; a focal range control unit configured to cause the imaging unit to capture a first image and a second image which have mutually different focal ranges, changing a focal position of the imaging unit; a reference image generation unit configured to generate, using the first image and the second image, a reference image to be used as a blur standard; and a distance measurement unit configured to measure a distance to the subject based on a difference in blur degrees between the reference image and each of the first image and the second image. The focal ranges of the first image and the second image are independent of each other, and an out-of-focus space is provided between the focal ranges.

Abstract: A person cluster selection part selects one or more person clusters as representative person clusters in order of largest number of facial images included therein. A unit selection part selects, from each representative person cluster, (i) a unit having the highest likelihood as a first representative unit, and (ii) units in order of lowest likelihood as a second representative unit onward. A representative facial image selection part selects, from each representative unit, (i) a facial image having the highest likelihood as a first representative facial image, and (ii) facial images in order of lowest likelihood as a second representative facial image onward.

Abstract: A data processing apparatus includes: a temporary storage unit storing a cluster-element correspondence table showing correspondence between a cluster ID for identifying each of clusters classified by the data processing apparatus and an element ID of element data belonging to the cluster identified by the cluster ID, and a group-cluster correspondence table showing correspondence between a group ID for identifying a group classified according to a user's subjective criterion and a cluster ID of a cluster belonging to the group identified by the group ID; a feature extraction unit extracting a feature value of newly added element data; and an automatic classification processing unit determining a belonging cluster from the clusters, and updating a classification boundary condition defining a boundary of the belonging cluster. The apparatus also includes a data management unit recording an element ID of the newly added element data and a cluster ID of the belonging cluster.

Abstract: A video editing apparatus includes: a selection unit which receives a first editing point and a second editing point; a representative value generation unit which generates a representative value of first disparity information on disparities of the first editing point and a representative value of second disparity information on disparities of the second editing point; a comparison value calculation unit which calculates a first depth difference by a comparison between the representative value of the first disparity information and the representative value of the second disparity information; a determination unit which determines whether or not the first depth difference is less than or equal to a predetermined value; and a presenting unit which presents a message prompting a user to change at least one of the first editing point and the second editing point when it is determined that the first depth difference is greater than the predetermined value.

Abstract: There are provided an data input unit configured to receive an input image, depth data, and a shooting parameter, a parameter input unit that receives a transformation parameter as a parameter on projective transformation of a three-dimensional model, a transformed image generating unit that generate a transformed image by performing projective transformation based on the transformation parameter in the three-dimensional model obtained from the input image, the depth data, and the shooting parameter, a blank area detecting unit that detects a blank area in the transformed image, the blank area being a group of blank pixels having no corresponding pixel in the input image, and an output unit configured to output the transformed image in the case where a blank value indicating size of the blank area is smaller than or equal to a threshold value.

Abstract: A parallax image generation device includes: a depth value correction unit which performs correction processing on a depth value, from among a plurality of depth values which define a depth image, to shift a position corresponding to the depth value to be closer to a display screen as the depth value is located closer to an end of the depth image, the display screen being for displaying a parallax image; and a parallax image generation unit which generates a first parallax image and a second parallax image having mutual parallax, using a two-dimensional image and the depth image corrected through the correction processing.

Abstract: An image analysis apparatus comprising: an identification unit operable to, in each of a plurality of scenes, identify one or more persons who appear in the scene; a scene evaluation value calculation unit operable to calculate a scene evaluation value for, among the plurality of scenes, each scene in which at least one person has been identified, the one person being included as one of persons identified by the identification unit; a scene selection unit operable to select, from among the plurality of scenes, one or more scenes that include the one person; and a person evaluation value calculation unit operable to calculate a person evaluation value for the one person by summating scene evaluation values of the scenes selected by the scene selection unit.

Abstract: An imaging apparatus includes: an imaging unit; a focal range control unit configured to cause the imaging unit to capture a first image and a second image which have mutually different focal ranges, changing a focal position of the imaging unit; a reference image generation unit configured to generate, using the first image and the second image, a reference image to be used as a blur standard; and a distance measurement unit configured to measure a distance to the subject based on a difference in blur degrees between the reference image and each of the first image and the second image. The focal ranges of the first image and the second image are independent of each other, and an out-of-focus space is provided between the focal ranges.