Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method may include classifying a multiplicity of source view videos into base view videos and additional view videos, generating residual data for the additional view videos, packing a patch, which is generated based on the residual data, into an altas video, and generating metadata for the patch.

Abstract: A method and an apparatus for generating a three-dimension (3D) virtual viewpoint image including: segmenting a first image into a plurality of images indicating different layers based on depth information of the first image at a gaze point of a user; and inpainting an area occluded by foreground in the plurality of images based on depth information of a reference viewpoint image are provided.

Abstract: Disclosed herein are an image encoding/decoding method and apparatus and a recording medium storing a bitstream.

Abstract: A video encoding method of encoding a multi-view image including one or more basic view images and a plurality of reference view images includes determining a pruning order of the plurality of reference view images, acquiring a plurality of residual reference view images, by pruning the plurality of reference view images based on the one or more basic view images according to the pruning order, encoding the one or more basic view images and the plurality of residual reference view images, and outputting a bitstream including encoding information of the one or more basic view images and the plurality of residual reference view images.

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method may include classifying a multiplicity of view videos into a base view and an additional view, generating a residual video for the additional view video classified as an additional view, packing a patch, which is generated based on the residual video, into an atlas video, and generating metadata for the patch.

Abstract: Disclosed herein is an immersive video formatting method and apparatus for supporting motion parallax, The immersive video formatting method includes acquiring a basic video at a basic position, acquiring a multiple view video at at least one position different from the basic position, acquiring at least one residual video plus depth (RVD) video using the basic video and the multiple view video, and generating at least one of a packed video plus depth (PVD) video or predetermined metadata using the acquired basic video and the at least one RVD video.

Abstract: Provided are an image magnification apparatus and method for three-dimensional display images. A multi-view image magnification apparatus includes: a region designation detection unit for detecting detection regions corresponding to the magnification regions of three-dimensional display images from original view images; a magnification ratio determination unit for determining the magnification ratios of the magnification regions; and a partial multiplexing unit for multiplexing non-detection regions except for the detection regions of the original view images according to a predetermined resolution and multiplexing the detection regions according the resolution which is different from the resolution of the non-detection regions on the basis of the magnification ratios. The present invention can magnify the images without lowering the resolution in a three-dimensional display.

Abstract: There are provided a method and apparatus for controlling an electronic device. The apparatus for controlling an electronic device includes a marker recognition unit configured to recognize the marker of the electronic device and a control unit configured to perform communication with the electronic device based on the marker and control the electronic device using a Graphic User Interface (GUI) program received from the electronic device.

Abstract: A method of receiving stereoscopic video according to the present invention includes receiving a bit stream including image information, extracting a base image stream corresponding to a base image and an additional image stream corresponding to an additional image from the bit stream, generating the base image and the additional image by decoding the base image stream and the additional image stream, respectively, and generating a left image and a right image by using at least one of the base image and the additional image. According to the present invention, 2D/3D broadcasting service efficiency may be improved.

Abstract: A device for creating multi-view video contents includes a virtual view position and distribution unit that calculates a plurality of virtual views corresponding to the number of predetermined virtual views based on input information and distributes the calculated positions of the plurality of virtual views to a plurality of view synthesis processing units; a view synthesis processor that operates the plurality of view synthesis processing units in parallel, allows each of the view synthesis processing units to create at least one virtual view video corresponding to a position of at least one virtual view distributed from the virtual view position calculation and distribution unit, and performs partial multiplexing based on at least one created virtual view video; and a video integration unit that integrates a plurality of partially multiplexed videos output from the plurality of view synthesis processing units.

Abstract: There are provided a method and apparatus for controlling an electronic device. The apparatus for controlling an electronic device includes a marker recognition unit configured to recognize the marker of the electronic device and a control unit configured to perform communication with the electronic device based on the marker and control the electronic device using a Graphic User Interface (GUI) program received from the electronic device.

Abstract: Method and device for generating a multi-viewpoint image are provided. The method of generating a multi-viewpoint image includes the steps of: acquiring at least one reference-viewpoint image; generating unit image information of a virtual-viewpoint image on the basis of unit image information of the reference-viewpoint image; multiplexing the unit image information of the reference-viewpoint image and the unit image information of the virtual-viewpoint image; and generating a multi-viewpoint image by performing an interpolation process on occluded areas between the multiplexed unit image information using the multiplexed unit image information. As a result, it is possible to avoid unnecessary processes of completing and rearranging individual viewpoint images in the course of generating a multi-viewpoint image.

Abstract: Provided are an image magnification apparatus and method for three-dimensional display images. A multi-view image magnification apparatus includes: a region designation detection unit for detecting detection regions corresponding to the magnification regions of three-dimensional display images from original view images; a magnification ratio determination unit for determining the magnification ratios of the magnification regions; and a partial multiplexing unit for multiplexing non-detection regions except for the detection regions of the original view images according to a predetermined resolution and multiplexing the detection regions according the resolution which is different from the resolution of the non-detection regions on the basis of the magnification ratios. The present invention can magnify the images without lowering the resolution in a three-dimensional display.

Abstract: A method and a device for adjusting depth perception, a terminal including a function for adjusting depth perception and a method for operating the terminal are provided. The method for adjusting depth perception includes: obtaining color and depth videos of a user; detecting a user's position based on the obtained depth video of the user; calculating a range of maximum and minimum depths in a 3-dimensional (3D) video according to the detected user's position; and adjusting a left and right stereo video generating interval of the 3D video to be rendered so as to satisfy the calculated range of the maximum and minimum depths. Therefore, during a 3D or multi-view video call, the 3D video having a three-dimensional effect optimized according to the user's position may be provided.

Abstract: A method of receiving stereoscopic video according to the present invention includes receiving a bit stream including image information, extracting a base image stream corresponding to a base image and an additional image stream corresponding to an additional image from the bit stream, generating the base image and the additional image by decoding the base image stream and the additional image stream, respectively, and generating a left image and a right image by using at least one of the base image and the additional image. According to the present invention, 2D/3D broadcasting service efficiency may be improved.

Abstract: A method and a device for adjusting depth perception, a terminal including a function for adjusting depth perception and a method for operating the terminal are provided. The method for adjusting depth perception includes: obtaining color and depth videos of a user; detecting a user's position based on the obtained depth video of the user; calculating a range of maximum and minimum depths in a 3-dimensional (3D) video according to the detected user's position; and adjusting a left and right stereo video generating interval of the 3D video to be rendered so as to satisfy the calculated range of the maximum and minimum depths. Therefore, during a 3D or multi-view video call, the 3D video having a three-dimensional effect optimized according to the user's position may be provided.

Abstract: A device for creating multi-view video contents includes a virtual view position and distribution unit that calculates a plurality of virtual views corresponding to the number of predetermined virtual views based on input information and distributes the calculated positions of the plurality of virtual views to a plurality of view synthesis processing units; a view synthesis processor that operates the plurality of view synthesis processing units in parallel, allows each of the view synthesis processing units to create at least one virtual view video corresponding to a position of at least one virtual view distributed from the virtual view position calculation and distribution unit, and performs partial multiplexing based on at least one created virtual view video; and a video integration unit that integrates a plurality of partially multiplexed videos output from the plurality of view synthesis processing units.

Abstract: Method and device for generating a multi-viewpoint image are provided. The method of generating a multi-viewpoint image includes the steps of: acquiring at least one reference-viewpoint image; generating unit image information of a virtual-viewpoint image on the basis of unit image information of the reference-viewpoint image; multiplexing the unit image information of the reference-viewpoint image and the unit image information of the virtual-viewpoint image; and generating a multi-viewpoint image by performing an interpolation process on occluded areas between the multiplexed unit image information using the multiplexed unit image information. As a result, it is possible to avoid unnecessary processes of completing and rearranging individual viewpoint images in the course of generating a multi-viewpoint image.

Abstract: An apparatus for displaying images in an image system includes: an encoder configured to encode color and depth images of at least one view received from a plurality of imaging devices and generate a reference image by synthesizing the encoded depth image of a current view and the encoded color and depth images before and after the current view based on a predetermined method; a decoder configured to decode a color image of the current view by using the generated reference image and decode the encoded color and depth images of at least one view; and a splitter configured to divide and split, based on each view, the decoded color and depth images of at least one view.

Abstract: Provided is a method of editing a depth image, comprising: receiving a selection on a depth image frame to be edited and a color image corresponding to the depth image frame; receiving a selection on an interest object in the color image; extracting boundary information of the interest object; and correcting a depth value of the depth image frame using the boundary information of the interest object.