Abstract: Improved video coding and decoding techniques are described, including techniques to derive quantization step sizes adaptively with quantization step size table templates. Quantization techniques described provide finer-grained control over quantization with a more flexible quantization step size especially at higher degrees of quantization. This may result in improved overall compression quality. Other coding parameters, such as in-loop filtering parameters, may be derived based on the more flexible quantization parameters.

Abstract: Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.

Abstract: Techniques for coding and decoding video may include predicting picture regions defined by a time-varying tessellation and/or by a tessellation that varies spatially within a picture. These techniques improve decoded video quality, for example, by reducing block-based visual artifacts. Tessellation patterns may be irregular spatially to prevent alignment of some prediction region boundaries within a picture. Tessellation patterns may vary over time based on a spatial offset value, and the spatial offset value may be determined via a modulo function. Tessellation patterns may include overlapped shapes, for example when used in conjunction with overlapped block motion compensation.

Abstract: A method of adaptive chroma downsampling is presented. The method comprises converting a source image to a converted image in an output color format, applying a plurality of downsample filters to the converted image and estimating a distortion for each filter chose the filter that produces the minimum distortion. The distortion estimation includes applying an upsample filter, and a pixel is output based on the chosen filter. Methods for closed loop conversions are also presented.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

Abstract: Support for additional components may be specified in a coding scheme for image data. A layer of a coding scheme that specifies color components may also specify additional components. Characteristics of the components may be specified in the same layer or a different layer of the coding scheme. An encoder or decoder may identify the specified components and determine the respective characteristics to perform encoding and decoding of image data.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.

Abstract: A system comprises an encoder configured to compress video data using an in-loop noise generation process that generates noise in the compression loop at a sub-image portion level of granularity, such as at a block level. The encoder includes noise model and/or noise model input parameter information in an encoded bit stream. Also, a system includes a decoder configured to receive such a bit stream and decompress the video using an in-loop noise generation process that generates noise in the decompression loop at a sub-image portion level of granularity.

Abstract: Predictive coding techniques may include resampling of reference pictures, where various coding parameters are determined based on the resolution(s) or pixel format(s) of the prediction references. In a first aspect, lists of weights for use in weighted prediction are based on the resolution(s) of prediction references. In a second aspect, resampling filter parameters are selected based on the resolutions of prediction references. In a third aspect, deblocking filter parameters are based on the resolution(s) of prediction references.

Abstract: A system comprises an encoder configured to compress video data using an in-loop noise generation process that generates noise in the compression loop at a sub-image portion level of granularity, such as at a block level. The encoder includes noise model and/or noise model input parameter information in an encoded bit stream. Also, a system includes a decoder configured to receive such a bit stream and decompress the video using an in-loop noise generation process that generates noise in the decompression loop at a sub-image portion level of granularity.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding, wherein pixel values for the padding are determined based on neighboring pixels values such that the padding is smoothed in the image frame. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.

Abstract: Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

Abstract: Predictive coding techniques may include resampling of reference pictures, where various coding parameters are determined based on the resolution(s) or pixel format(s) of the prediction references. In a first aspect, lists of weights for use in weighted prediction are based on the resolution(s) of prediction references. In a second aspect, resampling filter parameters are selected based on the resolutions of prediction references. In a third aspect, deblocking filter parameters are based on the resolution(s) of prediction references.