Abstract: A scalable hardware accelerator configured to compute video quality metrics is disclosed. In some embodiments, an accelerator for video quality metrics comprises an application-specific integrated circuit that includes an interface configured to receive pixel data of a frame of a video being analyzed for quality metric determination and a kernel configured to compute a video quality metric for the received pixel data using a fixed-point hardware approximation of a floating-point based algorithm associated with the video quality metric.

Abstract: Video coding and decoding methods are described. In example method includes performing a conversion between a current video block of a video and a bitstream representation of the current video block by determining a first intra coding mode to be stored which is associated with the current video block using a differential coding mode, where the first intra coding mode associated with the current video block is determined according to a second prediction mode used by the differential coding mode, and where, in the differential coding mode, a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual is represented in the bitstream representation for the current video block using a differential pulse coding modulation (DPCM) representation.

Abstract: History based motion vector prediction is disclosed. In one example method of video processing, initializing, for a conversion between a first region of video and a bitstream of the first region, a first history motion vector predictor (HMVP) table associated with the first region based on at least one of stored multiple HMVP tables, the multiple HMVP tables being used to store motion information associated with regions coded prior the first region; and performing the conversion by using the initialized first HMVP table which includes at least one motion candidate.

Abstract: An example device for decoding video data includes a video decoder configured to decode one or more syntax elements at a region-tree level of a region-tree of a tree data structure for a coding tree block (CTB) of video data, the region-tree having one or more region-tree nodes including region-tree leaf and non-leaf nodes, each of the region-tree non-leaf nodes having at least four child region-tree nodes, decode one or more syntax elements at a prediction-tree level for each of the region-tree leaf nodes of one or more prediction trees of the tree data structure for the CTB, the prediction trees each having one or more prediction-tree leaf and non-leaf nodes, each of the prediction-tree non-leaf nodes having at least two child prediction-tree nodes, each of the prediction leaf nodes defining respective coding units (CUs), and decode video data for each of the CUs.

Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.

Abstract: Video coding and decoding methods are described. In example method includes determining that a differential coding mode is applicable to a conversion between a current video block of a video and a bitstream representation of the current video block, and performing, based on the determining, the conversion between the current video block and the bitstream representation of the current video block using the differential coding mode according to an implementation rule, where, in the differential coding mode, the current video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual, and where, in the differential coding mode, the difference between the quantized residual and the prediction of the quantized residual is represented using a differential pulse coding modulation (DPCM) representation.

Abstract: Devices, systems and methods for adaptive loop filtering are described. In an exemplary aspect, a method for video processing includes performing, for a current video block of a video, a filtering process that uses filter coefficients and comprises two or more operations with at least one intermediate result, applying a clipping operation to the at least one intermediate result, and performing, based on the at least one intermediate result, a conversion between the current video block and a bitstream representation of the video, wherein the at least one intermediate result is based on a weighted sum of the filter coefficients and differences between a current sample of the current video block and neighboring samples of the current sample.

Abstract: Video coding and decoding methods are described. An example method includes determining, based on an applicability rule, that a differential coding mode is applicable to a conversion between a chroma video block of a video and a bitstream representation of the chroma video block, and performing, based on the determining, the conversion between the chroma video block and the bitstream representation of the chroma video block using the differential coding mode, where the chroma video block is represented in the bitstream representation using a difference between a quantized residual of an intra prediction of the chroma video block and a prediction of the quantized residual in the differential coding mode, where the intra prediction is performed in a first direction and the prediction of the quantized residual is performed in a second direction, and where the difference is represented using a differential pulse coding modulation (DPCM) representation.

Abstract: An example device includes a memory to store the video data, and processing circuitry in communication with the memory. The processing circuitry is configured to compare a value of a dimension of a current block of the stored video data to a value of a corresponding dimension of a neighboring block of the current block to obtain a relative dimension value. The processing circuitry is further configured to determine, based on the relative dimension value, that the current block is to be partitioned according to a prediction tree (PT) portion of a multi-type tree-based partitioning scheme. The PT portion comprises partitioning according to one of a binary tree structure or a center-side triple tree structure. The processing circuitry is further configured to partition, based on the determination, the current block according to the PT portion, to form a plurality of sub-blocks.

Abstract: An example device includes a memory to store the video data, and processing circuitry in communication with the memory. The processing circuitry is configured to compare a value of a dimension of a current block of the stored video data to a value of a corresponding dimension of a neighboring block of the current block to obtain a relative dimension value. The processing circuitry is further configured to determine, based on the relative dimension value, that the current block is to be partitioned according to a prediction tree (PT) portion of a multi-type tree-based partitioning scheme. The PT portion comprises partitioning according to one of a binary tree structure or a center-side triple tree structure. The processing circuitry is further configured to partition, based on the determination, the current block according to the PT portion, to form a plurality of sub-blocks.

Abstract: Devices, systems and methods for using zero-units in video and image coding are described. In a representative aspect, a method for processing video, including: determining, for a conversion between a block of the video and a bitstream of the video, that the block is a zero-unit (ZU) block based on at least one of the dimensions being a non-power-of-two number, wherein no transform and inverse-transform operations are performed on the block; performing the conversion based on the determination.

Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into more than four sub-blocks; decoding, based on a bitstream representation, the more than four sub-blocks; and decoding, based on the more than four sub-blocks and the partitioning process, the current visual media block. Another exemplary method for visual media encoding includes receiving input data associated with a current visual media block; applying, to the input data, a partitioning process that splits the current visual media block into more than four sub-blocks; encoding, based on the partitioning process, the more than four sub-blocks; and generating, based on the encoding, a bitstream representation of the current visual media block.

Abstract: A device for video decoding may include a memory configured to store video data and a processor configured receive a bitstream including encoded video data. The processor may be configured to select a number of template matching (TM) candidates for a temporal layer or slice during the video decoding. The number of TM candidates selected are fixed prior to the video decoding, or adaptively calculated during the video decoding. The processor may be configured to generate a prediction block and residual block, based on a template matching candidate, to reconstruct the video data.

Abstract: Devices, systems and methods for picture border coding are described. In a representative aspect, a method for processing pictures includes segmenting a picture into one or multiple picture segments, determining that a first block of a picture segment covers at least one region that is outside a border of the picture segment, wherein a size of the first block is M×N pixels, selecting a second block of size K×L pixels and where (K?M and L<N) or (K?M and L?N) and the second block falls entirely within the picture segment, and processing, using a partition tree, the border of the picture segment, wherein the partition tree is based on the size of the second block, wherein the processing includes splitting the second block into two or three sub-blocks without an indication on the splitting.

Abstract: Devices, systems and methods for picture border coding are described. In a representative aspect, a method for processing picture includes segmenting a picture into one or multiple picture segments, determining that a first block of a picture segment covers at least one region that is outside a border of the picture segment, wherein a size of the first block is M×N pixels, selecting a second block of size K×L pixels, where (K?M and L<N) or (K<M and L?N), wherein the second block falls entirely within the picture segment and wherein the second block is used as a largest coding unit, a leaf coding block or a coding tree block; and processing, using a partition tree, the border of the picture segment, wherein the partition tree is based on the size of the second block.

Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques, and in particular, sub-block shapes in extended quadtree partitioning, are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block, where a size of the current visual media block is M×N, and the size of the at least one sub-block is based on a minimum value between M and N, or a maximum value between M and N; decoding, based on a bitstream representation, the four sub-blocks; and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.

Abstract: Techniques and systems are provided for processing video data. For example, a current block of a picture of the video data can be obtained for processing by an encoding device or a decoding device. A pre-defined set of weights for template matching based motion compensation are also obtained. A plurality of metrics associated with one or more spatially neighboring samples of the current block and one or more spatially neighboring samples of at least one reference frame are determined. A set of weights are selected from the pre-defined set of weights to use for the template matching based motion compensation. The set of weights is determined based on the plurality of metrics. The template matching based motion compensation is performed for the current block using the selected set of weights.

Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques are described. An exemplary method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block, decoding, based on a bitstream representation, the four sub-blocks, and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.

Abstract: For a bi-directional inter predicted block, a video decoder is configured, using a first MV, to locate a first predictive block in a first reference picture; using a second MV, locate a second predictive block in a second reference picture; for a first sub-block of the first predictive block, determine a first amount of bi-directional optical flow (BIO) motion; determine a first final predictive sub-block for the block of video data based on the first amount of BIO motion; for a second sub-block of the first predictive block, determine a second amount of BIO motion; determine a second final predictive sub-block for the block of video data based on the second amount of BIO motion; and based on the first final predictive sub-block and the second final predictive sub-block, determine a final predictive block for the block of video data.

Abstract: Methods, systems and devices for using flexible and efficient partitioning techniques and in particular, restricting extended quadtree (EQT) partitioning, are described. An exemplary method for visual media decoding includes making a decision, based on one or more conditions, regarding a selective inclusion of one or more signaling bits for a partitioning process in a bitstream representation of a current visual media block of a plurality of visual media blocks, where the partitioning process splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block; decoding, based on the bitstream representation, the four sub-blocks; and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.