Abstract: A video encoding method of encoding a multi-view image including one or more basic view images and a plurality of reference view images includes determining a pruning order of the plurality of reference view images, acquiring a plurality of residual reference view images, by pruning the plurality of reference view images based on the one or more basic view images according to the pruning order, encoding the one or more basic view images and the plurality of residual reference view images, and outputting a bitstream including encoding information of the one or more basic view images and the plurality of residual reference view images.

Abstract: Disclosed herein are an apparatus for estimating a camera pose using multi-view images of a 2D array structure and a method using the same. The method performed by the apparatus includes acquiring multi-view images from a 2D array camera system, forming a 2D image link structure corresponding to the multi-view images in consideration of the geometric structure of the camera system, estimating an initial camera pose based on an adjacent image extracted from the 2D image link structure and a pair of corresponding feature points, and estimating a final camera pose by reconstructing a 3D structure based on the initial camera pose and performing correction so as to minimize a reprojection error of the reconstructed 3D structure.

Abstract: Disclosed herein are a method and apparatus for generating a residual image of multi-view video. The method includes generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images, and detecting outliers in the pruning mask using color information of the basic view image and the additional view image.

Abstract: Disclosed herein is a method for encoding an immersive image. The method includes detecting a non-diffuse surface in a first texture image of a first view, generating an additional texture image from the first texture image based on the detected non-diffuse surface, performing pruning on the additional texture image based on a second texture image of a second view, generating a texture atlas based on the pruned additional texture image, and encoding the texture atlas.

Abstract: Disclosed herein are an immersive video decoding method and an immersive video encoding method. The immersive video decoding method includes partitioning a current picture into multiple main blocks, determining whether each main block is to be partitioned into multiple sub-blocks, and when it is determined that each main block is to be partitioned into multiple sub-blocks, determining a partitioning type of the corresponding main block. Here, the corresponding main block may be partitioned into four or two sub-blocks depending on the partitioning type. When the corresponding main block is partitioned into multiple sub-blocks, whether depth information is to be updated for each of the sub-blocks generated by partitioning the main block may be determined.

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, a first flag indicating whether or not an atlas includes a patch including information on an entire region of a first source video may be encoded into the metadata.

Abstract: An immersive video processing method according to the present disclosure includes determining a priority order of pruning for source view videos, generating a residual video for an additional view video based on the priority order of pruning, packing a patch generated based on the residual video into an atlas video, and encoding the atlas video.

Abstract: An immersive video processing method according to the present invention includes: classifying view videos into a base video and an additional video; performing pruning for the view videos by referring to a result of the classification; generating an atlas based on a result of the pruning; determining a depth parameter of each view in the atlas; and encoding information indicating whether or not updating of the depth parameter is needed, based on whether or not the depth parameter of each view in the atlas is identical as in a previous atlas.

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method may include classifying a multiplicity of view videos into a base view and an additional view, generating a residual video for the additional view video classified as an additional view, packing a patch, which is generated based on the residual video, into an atlas video, and generating metadata for the patch.

Abstract: A method for processing an immersive video includes: performing pruning for view images; generating an atlas by packing a patch that is extracted as a result of the pruning; deriving an offset for the patch that is comprised in the atlas; and correcting pixel values in the patch by using the derived offset.

Abstract: An immersive video processing method according to the present invention includes: classifying view videos into a base video and an additional video; performing pruning for the view videos by referring to a result of the classification; generating an atlas based on a result of the pruning; determining a depth parameter of each view in the atlas; and encoding information indicating whether or not updating of the depth parameter is needed, based on whether or not the depth parameter of each view in the atlas is identical as in a previous atlas.

Abstract: Disclosed herein are a method and apparatus for generating a residual image of multi-view video. The method includes generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images, and detecting outliers in the pruning mask using color information of the basic view image and the additional view image.

Abstract: Disclosed herein is an immersive video formatting method and apparatus for supporting motion parallax, The immersive video formatting method includes acquiring a basic video at a basic position, acquiring a multiple view video at at least one position different from the basic position, acquiring at least one residual video plus depth (RVD) video using the basic video and the multiple view video, and generating at least one of a packed video plus depth (PVD) video or predetermined metadata using the acquired basic video and the at least one RVD video.

Abstract: A method of processing an immersive video includes classifying view images into a basic image and an additional image, performing pruning with respect to view images by referring to a result of classification, generating atlases based on a result of pruning, generating a merged atlas by merging the atlases into one atlas, and generating configuration information of the merged atlas.

Abstract: A video decoding method comprises receiving a plurality of atlases and metadata, unpacking patches included in the plurality of atlases based on the plurality of atlases and the metadata, reconstructing view images including an image of a basic view and images of a plurality of additional views, by unpruning the patches based on the metadata, and synthesizing an image of a target playback view based on the view images. The metadata is data related to priorities of the view images.

Abstract: Disclosed herein is a method for rectifying a 2D multi-view image. The method for rectifying a 2D multi-view image according to an embodiment of the present disclosure may include: detecting uniformly the at least one feature point in each region unit distinguished by considering a distribution of feature points of a plurality of input images: removing an error of the least one feature point; determining a corresponding pair for a vertical or horizontal direction of the at least one feature point; by considering an arrangement relationship of the plurality of input images, projecting the at least one feature point onto a projection plane; determining a disparity error for a corresponding pair for the at least one feature point that is projected onto the projection plane; and, by considering the disparity error, performing image rectification based on the at least one feature point.

Abstract: A method of producing an immersive video comprises decoding an atlas, parsing a flag for the atlas, and producing a viewport image using the atlas. The flag may indicate whether the viewport image is capable of being completely produced through the atlas, and, according to a value of the flag, when the viewport image is produced, it may be determined whether an additional atlas is used in addition to the atlas.

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include first threshold information that becomes a criterion for distinguishing between a valid pixel and an invalid pixel in the atlas video.

Abstract: A video encoding/decoding method and apparatus is provided. The image decoding method includes acquiring image data of images of a plurality of views, determining a basic view and a plurality of reference views among the plurality of views, determining a pruning order of the plurality of reference views, and parsing the image data based on the pruning order and decoding an image of the basic view and images of the plurality of reference views.

Abstract: Disclosed herein is an image encoding/decoding method and apparatus for virtual view synthesis. The image decoding for virtual view synthesis may include decoding texture information and depth information of at least one or more basic view images and at least one or more additional view images from a bit stream and synthesizing a virtual view on the basis of the texture information and the depth information, wherein the basic view image and the additional view image comprise a non-empty region and an empty region, and wherein the synthesizing of the virtual view comprises determining the non-empty region through a specific value in the depth information and a threshold and synthesizing the virtual view by using the determined non-empty region.