Abstract: An image processing apparatus may include a sensor unit which generates both a color image and a depth image. A color-depth time difference correcting unit may correct a mismatching that occurs due to a time difference between a point in time when the color image is generated and a point in time when the depth image is generated. An image generator may generate a stereoscopic image or a multi-view image using the color image and the depth image after the mismatching is corrected.

Abstract: A stereo matching apparatus and method through learning a unary confidence and a pairwise confidence are provided. The stereo matching method may include learning a pairwise confidence representing a relationship between a current pixel and a neighboring pixel, determining a cost function of stereo matching based on the pairwise confidence, and performing stereo matching between a left image and a right image at a minimum cost using the cost function.

Abstract: A method and apparatus to generate a volume-panorama image based on three-dimensional (3D) volume images is provided. A method of generating a volume-panorama image includes receiving pieces of image data of one or more volume images, extracting partial regions including one or more voxels from the volume images, determining a global conversion function representing a relationship of a conversion between a second volume image of the volume images and a first volume image of the volume images, the determined global conversion function being based on a conversion function representing a relationship of a conversion between one of the extracted partial regions of the second volume image and one of the extracted partial regions of the first volume image, and generating image data of a volume image to be combined with the first volume image from image data of the second volume image based on the determined global conversion function.

Abstract: A method and apparatus for processing a depth image determines a number of mods (NoM) for corresponding pixels in a plurality of depth images. The corresponding pixels may represent a same three-dimensional (3D) point. The NoM may be determined to be a value for minimizing a Markov random field (MRF) energy. A depth value for one depth image may be recovered, and a depth value for another depth image may be updated using the recovered depth value.

Abstract: An apparatus and method for processing a depth image. A depth image may be generated with reduced noise and motion blur, using depth images generated during different integration times that are generated based on the noise and motion blur of the depth image.

Abstract: A method of generating a depth image includes irradiating an object with a light which is generated from a light source, acquiring a plurality of phase difference signals which have different phase differences from one another, by sensing a reflection light reflected from the object, generating a first depth image based on the plurality of phase difference signals, generating a second depth image based on phase difference signals in which a motion artifact has not occurred, among the plurality of phase difference signals, generating a third depth image by combining the first depth image and the second depth image.

Abstract: A method and apparatus for generating a spanning tree, a method and apparatus for stereo matching, a method and apparatus for up-sampling, and a method and apparatus for generating a reference pixel are disclosed, in which a spanning tree may be generated by reference pixels, stereo matching or up-sampling may be performed based on the generated spanning tree, and a reference pixel may be generated based on a stereo video.

Abstract: An apparatus and method for processing an image based on a motion of an object, the apparatus including a motion estimator configured to estimate a motion of an object included in a current image, an image determiner configured to determine a neighboring image neighboring the current image based on the motion of the object, and a pixel value determiner configured to determine a pixel value of a hole region neighboring the object based on the neighboring image is provided.

Abstract: A method of cloth simulation using a constrainable multigrid is provided. The method includes steps of: calculating a change of geometry of the mesh of nodes at a plurality of time steps using a multigrid method by solving a time-varying partial differential equation at multiple resolutions or levels; providing a hierarchical mesh through restriction or coarsening by down-sampling from level m to m?1 or prolongation or interpolation by up-sampling from level m to m+1; transferring soft constraints between different hierarchical levels using a damper-based constraint method; updating the position vector x and the velocity vector v of the mesh nodes; and displaying an updated state of the mesh of nodes using updated position vector x and velocity vector v on a display.

Abstract: Provided are an apparatus and method for converting a low-resolution depth image to a depth image having a resolution identical to a resolution of a high-resolution color image. The depth image conversion apparatus may generate a discrete depth image by quantizing a depth value of an up-sampled depth image, estimate a high-resolution discrete depth image by optimizing an objective functions of the discrete depth image based on the high-resolution color image and an up-sampled depth border, and convert the up-sampled depth image to a high-resolution depth image by filtering the up-sampled depth image when a difference between discrete depth values of neighboring pixels in the high-resolution discrete depth image is less than a predetermined threshold value.

Abstract: Provided is a method and apparatus for modeling a human body using a depth image and a color image. An image processing apparatus may extract a body area from a color image based on a depth value of a depth image, may match a boundary of the extracted body area and a boundary of a generic body mesh model, and may deform a mesh of the generic body mesh model based on a depth value of a pixel positioned within the boundary of the extracted body area.

Abstract: Disclosed is a mesh generating apparatus, method and computer-readable medium, and an image processing apparatus, method and computer-readable medium. A single 3D mesh and a single 3D object model may be generated using a single color image and a single depth image. A plurality of viewpoint images seen from a plurality of viewpoints may be generated from a single 3D object model.

Abstract: Provided are a method of decreasing the noise of a depth image which predicts the noise for each pixel of the depth image using the difference in depth values of two adjacent pixels of the depth image and the reflectivity of each pixel of an intensity image, and an image processing apparatus and an image generating apparatus that use the method.

Abstract: Provided is an image processing method including: receiving a depth map and a color image with respect to a predetermined scene; projecting a plurality of points included in the depth map, onto the color image; segmenting the color image, onto which the depth map is projected, by using at least two image segmentation methods to generate respective segmentation results, and classifying the plurality of points included in the color image into at least one set according to the respective segmentation results; assigning a depth value to each of the plurality of points of the color image included in the set; and outputting the color image, to which the depth values are assigned.

Abstract: Provided are a method and an apparatus for image processing. A scene includes a low resolution depth image and a high resolution color image. A depth image up-scaler up-scales the depth image using an interpolation so as to improve the resolution of the depth image. A color-depth similarity based filter removes noise from the up-scaled depth image using the color image and the up-scaled depth image. A boundary sharpening filter converts a boundary between objects in the up-scaled depth image into a clearer boundary. The resolution of the depth image may increase to the level of the resolution of the color image by means of the depth image up-scaler, the color-depth similarity based filter and the boundary sharpening filter, and the depth of each pixel in the depth image may be adjusted.

Abstract: A method of processing a depth image includes receiving a high-resolution color image and a low-resolution depth image corresponding to the high-resolution color image, generating a feature vector based on a depth distribution of the low-resolution depth image, selecting a filter to upsample the low-resolution depth image by classifying a generated feature vector according to a previously learnt classifier, upsampling the low-resolution depth image by using a selected filter, and outputting an upsampled high-resolution depth image.

Abstract: An apparatus and method for out-focusing a color image based on a depth image, the method including receiving an input of a depth region of interest (ROI) desired to be in focus for performing out-focusing in the depth image, and applying different blur models to pixels corresponding to the depth ROI, and pixels corresponding to a region, other than the depth ROI, in the color image, thereby performing out-focusing on the depth ROI.

Abstract: An image processing apparatus and method for zooming in on a partial area in a three-dimensional (3D) image selects a zoom mode from among a two-dimensional (2D) zoom mode, a 3D zoom mode, and an intermediate dimensional zoom mode between the 2D zoom mode and the 3D zoom mode. The image processing apparatus may include a mode selecting unit to select a zoom mode to be applied to a zoom area in a color image and a depth image among the 2D zoom mode, the 3D zoom mode, and the intermediate dimensional zoom mode between the 2D zoom mode and the 3D zoom mode, and a scaling unit to scale the zoom area using a zoom factor indicating magnification or minification of the zoom area and the selected zoom mode.

Abstract: A communication network comprising a collaborative photography group including a plurality of cameras having synchronized photographing times, is provided. The plurality of cameras may share location information, direction angle information, and image information generated by photographing an object, and generate a three-dimensional (3D) image of the object.

Abstract: Provided is an image processing apparatus. The image processing apparatus may extract a three-dimensional (3D) silhouette image in an input color image and/or an input depth image. Motion capturing may be performed using the 3D silhouette image and 3D body modeling may be performed.