Abstract: A video encoding method includes classifying a plurality of view images into a basic image and additional images, performing pruning on at least one of the plurality of view images on the basis of the classification result, generating an atlas on the basis of the pruning result, and encoding the atlas and metadata for the atlas. Here, the metadata includes a first flag indicating whether depth estimation needs to be performed on a decoder side.

Abstract: Disclosed herein is a method for encoding/decoding an immersive image, and the method for encoding an immersive image may include extracting an invalid region from an already encoded atlas and encoding a current atlas by referring to the invalid region.

Abstract: A method of producing an immersive video comprises decoding an atlas, parsing a flag for the atlas, and producing a viewport image using the atlas. The flag may indicate whether the viewport image is capable of being completely produced through the atlas, and, according to a value of the flag, when the viewport image is produced, it may be determined whether an additional atlas is used in addition to the atlas.

Abstract: An image encoding method according to the present disclosure may include classifying a plurality of view images into a basic image and an additional image; performing pruning for at least one of the plurality of view images based on a result of the classification; generating an atlas based on a result of performing the pruning; and encoding the atlas and metadata for the atlas. In this case, the metadata may include spherical harmonic function information on a point in a three-dimensional space.

Abstract: Disclosed herein are an immersive video decoding method and an immersive video encoding method. The immersive video decoding method includes partitioning a current picture into multiple main blocks, determining whether each main block is to be partitioned into multiple sub-blocks, and when it is determined that each main block is to be partitioned into multiple sub-blocks, determining a partitioning type of the corresponding main block. Here, the corresponding main block may be partitioned into four or two sub-blocks depending on the partitioning type. When the corresponding main block is partitioned into multiple sub-blocks, whether depth information is to be updated for each of the sub-blocks generated by partitioning the main block may be determined.

Abstract: Disclosed herein a device tracking gaze and method therefor. The device includes: an image acquisition unit configured to obtain an eyeball image; a pupil detection unit configured to detect a center of pupil by using the eyeball image; a virtual corneal reflection light position generator configured to process the eyeball image so that a virtual corneal reflection light is located at a predetermined point in the eyeball image; and a PCVR vector generator configured to generate a pupil center virtual reflection vector (PCVR vector) based on a position of the pupil center and a position of the virtual corneal reflection light.

Abstract: An immersive image encoding method according to the present disclosure includes classifying a plurality of view images into a basic image and an additional image; performing pruning for at least one of the plurality of view images based on the classification result; generating a depth atlas based on a result of performing the pruning; and correcting an occupancy state of pixels in the depth atlas.

Abstract: A method of switching an atlas according to a watching position according to the present disclosure includes acquiring information on a view image required to reproduce a viewport image; acquiring information of a first atlas mapped to the view image; and receiving a bitstream of the first atlas and a bitstream of a second atlas different from the first atlas. In this case, when it is determined that atlas switching is necessary, reception of any one of a bitstream of the first atlas and a bitstream of the second atlas may be stopped and a bitstream of a third atlas may be newly received.

Abstract: A method of encoding an immersive image according to the present disclosure comprises classifying a plurality of view images into a basic image and an additional image, generating a plurality of texture atlases based on the plurality of view images, generating a first depth atlas including depth information of view images included in a first texture atlas among the plurality of texture atlases, and generating a second depth atlas including depth information of view images included in remaining texture atlases other than the first texture atlas.

Abstract: A method of processing an immersive video includes classifying each of a plurality of objects included in a view image as one of a first object group and a second object group, acquiring a patch for each of the plurality of objects, and packing patches to generate at least one atlas. In this instance, patches derived from objects belonging to the first object group may be packed in a different region or a different atlas from a region or an atlas of patches derived from objects belonging to the second object group.

Abstract: A method of processing an immersive video according to the present disclosure includes performing pruning for an input image, generating an atlas based on patches generated by the pruning and generating a cropped atlas by removing a background region of the atlas.

Abstract: A method for processing an immersive video includes: performing pruning for view images; generating an atlas by packing a patch that is extracted as a result of the pruning; deriving an offset for the patch that is comprised in the atlas; and correcting pixel values in the patch by using the derived offset.

Abstract: Disclosed herein are an immersive video encoding method and an immersive video decoding method. The immersive video encoding method includes setting basic view images among input images corresponding to multiple views, generating an atlas image using the basic view images, performing encoding on the atlas image, and generating metadata about an encoded atlas image, wherein the atlas image includes a texture atlas or a depth atlas.

Abstract: Disclosed herein are an apparatus and method for removing redundant data between multi-view videos. The method includes generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images, and revalidating the pruning mask using color information of the basic view image and the additional view image. Revalidating the pruning mask may include defining a color relationship between the basic view image and the additional view image by extracting predetermined sample values from corresponding pixels between the basic view image and the additional view image, which are included in the pruning candidate group of the pruning mask, and detecting pixels that do not match the defined color relationship, among the pixels in the pruning mask, as outliers.

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for input videos; extracting patches from the input videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include information on a priority order of pruning among input videos.

Abstract: A video encoding method of encoding a multi-view image including one or more basic view images and a plurality of reference view images includes determining a pruning order of the plurality of reference view images, acquiring a plurality of residual reference view images, by pruning the plurality of reference view images based on the one or more basic view images according to the pruning order, encoding the one or more basic view images and the plurality of residual reference view images, and outputting a bitstream including encoding information of the one or more basic view images and the plurality of residual reference view images.

Abstract: Disclosed herein are a method and apparatus for generating a residual image of multi-view video. The method includes generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images, and detecting outliers in the pruning mask using color information of the basic view image and the additional view image.

Abstract: Disclosed herein is a method for encoding an immersive image. The method includes detecting a non-diffuse surface in a first texture image of a first view, generating an additional texture image from the first texture image based on the detected non-diffuse surface, performing pruning on the additional texture image based on a second texture image of a second view, generating a texture atlas based on the pruned additional texture image, and encoding the texture atlas.

Abstract: Disclosed herein are an immersive video decoding method and an immersive video encoding method. The immersive video decoding method includes partitioning a current picture into multiple main blocks, determining whether each main block is to be partitioned into multiple sub-blocks, and when it is determined that each main block is to be partitioned into multiple sub-blocks, determining a partitioning type of the corresponding main block. Here, the corresponding main block may be partitioned into four or two sub-blocks depending on the partitioning type. When the corresponding main block is partitioned into multiple sub-blocks, whether depth information is to be updated for each of the sub-blocks generated by partitioning the main block may be determined.

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, a first flag indicating whether or not an atlas includes a patch including information on an entire region of a first source video may be encoded into the metadata.