Abstract: A video encoding method includes classifying a plurality of view images into a basic image and additional images, performing pruning on at least one of the plurality of view images on the basis of the classification result, generating an atlas on the basis of the pruning result, and encoding the atlas and metadata for the atlas. Here, the metadata includes a first flag indicating whether depth estimation needs to be performed on a decoder side.

Abstract: A transmitter system for processing a video includes: an object recognition component configured to identify one or more objects in the video and extract one or more features associated with the one or more objects; a video processing component configured to process each frame of the video by removing the one or more objects; a video encoding component configured to encode the processed video; and a transmitting component configured to transmit the encoded video and the extracted features of the one or more objects.

Abstract: Systems and methods for processing a video are disclosed herein. The method include (1) receiving an input video; (2) identifying one or more objects in the input video; (3) determining a set of feature descriptors associated with the one or more objects; (4) generating a set of feature units associated with the one or more objects.

Abstract: A video encoding method includes classifying a plurality of view images into a basic image and additional images, performing pruning on at least one of the plurality of view images on the basis of the classification result, generating an atlas on the basis of the pruning result, and encoding the atlas and metadata for the atlas. Here, the metadata includes a first flag indicating whether depth estimation needs to be performed on a decoder side.

Abstract: A method for multiview picture data encoding comprising the steps of: performing extraction of features from multiview picture data to obtain a plurality of feature maps; performing stitching and/or transforming of the obtained plurality of feature maps to obtain at least one panoramic map of features; performing transforming of the multiview picture data to select a plurality of patches of view of the multiview picture data; encoding the at least one panoramic map of features; and encoding the plurality of patches of view.

Abstract: A method for multiview video data encoding is provided. The method includes: performing feature detection on first picture data relating to a first view to obtain a first set of features corresponding to said first view; generating a picture bitstream based on the first picture data relating to the first view; performing feature detection on second picture data relating to a second view to obtain a second set of features corresponding to said second view; performing feature matching of the first and second sets of features so as to identify an area of common characteristics; and performing prediction on second input picture data based on the area of common characteristics so as to generate a residual data bitstream.

Abstract: Disclosed herein are an immersive video decoding method and an immersive video encoding method. The immersive video decoding method includes partitioning a current picture into multiple main blocks, determining whether each main block is to be partitioned into multiple sub-blocks, and when it is determined that each main block is to be partitioned into multiple sub-blocks, determining a partitioning type of the corresponding main block. Here, the corresponding main block may be partitioned into four or two sub-blocks depending on the partitioning type. When the corresponding main block is partitioned into multiple sub-blocks, whether depth information is to be updated for each of the sub-blocks generated by partitioning the main block may be determined.

Abstract: Methods and devices for video data decoding and encoding are provided. The method for video data decoding includes: obtaining a picture bitstream; obtaining a feature bitstream indicating a residual set of features as a result of subtracting a second set of features detected in encoded picture data generated from original picture data by encoding from a first set of features detected in the original picture data; retrieving a decoded set of features from decoding the picture bitstream; and recovering the first set of features indicating the features detected in the input picture data from the decoded set of features and the residual set of features decoded from the feature bitstream.

Abstract: A visual feature processing method in an encoding device is disclosed. The visual feature processing method comprises: performing feature extraction from picture data to be encoded based on a predetermined feature extraction method to thereby obtain a set of extracted features; sorting the features in the set of extracted features based on a predetermined criterion; iteratively dividing the sorted set of extracted features in a plurality of subsets of features, said plurality of subsets of features comprising a first subset of features and at least one further subset of features, wherein the first subset of features is assigned a priority value which is higher than the priority value of the at least one further subset of features; and multiplexing the features of each subset of features for outputting for compressing, wherein the multiplexing is based on the priority value assigned to each subset of features.

Abstract: Computer-implemented methods, computer-readable media and devices for encoding video data using picture synthesis from features are provided. A computer-implemented method of encoding video data includes extracting features from a picture in a video; obtaining a predicted value of one or more regions in the picture by applying generative picture synthesis onto the features; obtaining a residual value of the one or more regions in the picture based on an original value of the one or more regions in the picture and the predicted picture; and encoding the residual value and the extracted features. Disclosed herein are also computer-implemented methods, computer-readable media and devices for decoding video data using picture synthesis from features.

Abstract: A method of encoding an immersive image according to the present disclosure comprises classifying a plurality of view images into a basic image and an additional image, generating a plurality of texture atlases based on the plurality of view images, generating a first depth atlas including depth information of view images included in a first texture atlas among the plurality of texture atlases, and generating a second depth atlas including depth information of view images included in remaining texture atlases other than the first texture atlas.

Abstract: A method for processing an immersive video includes: performing pruning for view images; generating an atlas by packing a patch that is extracted as a result of the pruning; deriving an offset for the patch that is comprised in the atlas; and correcting pixel values in the patch by using the derived offset.

Abstract: Disclosed herein are an immersive video encoding method and an immersive video decoding method. The immersive video encoding method includes setting basic view images among input images corresponding to multiple views, generating an atlas image using the basic view images, performing encoding on the atlas image, and generating metadata about an encoded atlas image, wherein the atlas image includes a texture atlas or a depth atlas.

Abstract: Disclosed herein are an immersive video decoding method and an immersive video encoding method. The immersive video decoding method includes partitioning a current picture into multiple main blocks, determining whether each main block is to be partitioned into multiple sub-blocks, and when it is determined that each main block is to be partitioned into multiple sub-blocks, determining a partitioning type of the corresponding main block. Here, the corresponding main block may be partitioned into four or two sub-blocks depending on the partitioning type. When the corresponding main block is partitioned into multiple sub-blocks, whether depth information is to be updated for each of the sub-blocks generated by partitioning the main block may be determined.

Abstract: An immersive video processing method according to the present invention includes: classifying view videos into a base video and an additional video; performing pruning for the view videos by referring to a result of the classification; generating an atlas based on a result of the pruning; determining a depth parameter of each view in the atlas; and encoding information indicating whether or not updating of the depth parameter is needed, based on whether or not the depth parameter of each view in the atlas is identical as in a previous atlas.

Abstract: A method for processing an immersive video includes: performing pruning for view images; generating an atlas by packing a patch that is extracted as a result of the pruning; deriving an offset for the patch that is comprised in the atlas; and correcting pixel values in the patch by using the derived offset.

Abstract: An immersive video processing method according to the present invention includes: classifying view videos into a base video and an additional video; performing pruning for the view videos by referring to a result of the classification; generating an atlas based on a result of the pruning; determining a depth parameter of each view in the atlas; and encoding information indicating whether or not updating of the depth parameter is needed, based on whether or not the depth parameter of each view in the atlas is identical as in a previous atlas.

Abstract: Disclosed herein is an image encoding/decoding method and apparatus for virtual view synthesis. The image decoding for virtual view synthesis may include decoding texture information and depth information of at least one or more basic view images and at least one or more additional view images from a bit stream and synthesizing a virtual view on the basis of the texture information and the depth information, wherein the basic view image and the additional view image comprise a non-empty region and an empty region, and wherein the synthesizing of the virtual view comprises determining the non-empty region through a specific value in the depth information and a threshold and synthesizing the virtual view by using the determined non-empty region.

Abstract: Disclosed herein is an image encoding/decoding method and apparatus for virtual view synthesis. The image decoding for virtual view synthesis may include decoding texture information and depth information of at least one or more basic view images and at least one or more additional view images from a bit stream and synthesizing a virtual view on the basis of the texture information and the depth information, wherein the basic view image and the additional view image comprise a non-empty region and an empty region, and wherein the synthesizing of the virtual view comprises determining the non-empty region through a specific value in the depth information and a threshold and synthesizing the virtual view by using the determined non-empty region.

Abstract: The present disclosure can provide an image processing apparatus. In some embodiments, the image processing apparatus in accordance with the disclosure comprises memory configured to store a previously selected depth information value (dprev), (dprev; dprevi) having been selected for a previously processed fragment and signal processing logic (103).