Abstract: An example method of decoding video data that includes receiving one or more syntax elements of the video data indicative of whether a first type of coding scheme or a second type of coding scheme is applied to residual values of a block of video data coded with transform skip, wherein the residual values are indicative of a difference between the block and a prediction block, and wherein, in transform skip, the residual values are not transformed from a sample domain to a frequency domain. The method includes determining a type of coding scheme to apply to the residual values based on the one or more syntax elements, determining the residual values based on the determined type of coding scheme, and reconstructing the block based on the determined residual values and the prediction block.

Abstract: Methods and systems for improving coding decoding efficiency of video by providing a syntax modeler, a buffer, and a decoder. The syntax modeler may associate a first sequence of symbols with syntax elements. The buffer may store tables, each represented by a symbol in the first sequence, and each used to associate a respective symbol in a second sequence of symbols with encoded data. The decoder decodes the data into a bitstream using the second sequence retrieved from a table.

Abstract: This disclosure relates to video coding and more particularly to techniques for performing motion vector prediction. According to an aspect of an invention, a motion vector and a corresponding reference picture identifier for the motion vector are received; a reference picture corresponding to a second motion vector is determined based on the reference picture corresponding to the received motion vector and a current picture; a scaling value is determined based on the determined reference picture, the reference picture corresponding to the received motion vector, and the current picture; and the second motion vector is generated from the received motion vector by scaling with the scaling value.

Abstract: The present disclosure provides a computer-implemented method for encoding video. The method includes: receiving a video frame for processing; generating one or more coding units of the video frame; and processing one or more coding units using one or more palette predictors having palette entries, wherein each palette entry of the one or more palette predictors has a corresponding reuse flag, and wherein a number of reuse flags for each palette predictor is set to a fixed number for a corresponding coding unit.

Abstract: A decoding method and apparatus are provided. A first candidate having a first motion vector that has been used to decode a first block, a first prediction direction that corresponds to the first motion vector, and a first reference picture index that identifies a first reference picture is derived. A second candidate having a second motion vector that has been used to decode a second block, a second prediction direction that corresponds to the second motion vector, and a second reference picture index that identifies a second reference picture is derived. When a total number of candidates is less than a maximum number, a third candidate is derived by combining the first motion vector and the first reference picture index for the first prediction direction of the first candidate and the second motion vector and the second reference picture index for the second prediction direction of the second candidate.

Abstract: A differential video rendering system, including a graphics processing unit (GPU); a graphical display coupled to the GPU; a video decoder configured to decode a bitstream of encoded data into a plurality of sets of decoded blocks; at least one processor configured to: generate, based on a first set of the plurality of sets of decoded blocks, a first differential video frame comprising a plurality of sets of differential regions, normalize each set of the plurality of sets of differential regions to a fixed size block to provide a normalized plurality of sets of differential regions, map a respective set of the normalized plurality of sets of differential regions to align with a respective tile size region of a plurality of tile size regions conforming with the GPU, generate a hierarchal region tree based on the normalized plurality of sets of differential regions mapped to the plurality of tile size regions, and generate a plurality of optimal regions based on the hierarchal region tree satisfying a predefin

Abstract: A picture coding device includes: a block vector candidate derivation unit that derives block vector candidates of a target block in a target picture from coding information stored in coding information storage memory; a selector that selects a selected block vector from the block vector candidates; and a reference position correction unit that performs a correction regarding a reference block to be referred to by the selected block vector so that a reference position of the reference block is to be corrected to refer to an inside of a referenceable region, in which a decoded sample in the target picture is acquired from decoded picture memory as a prediction value of the target block based on the reference position of the reference block.

Abstract: The present invention includes obtaining block type identification information on a partition of the current macroblock when the current macroblock is intra-mixed specifying a bock type of the current macroblock based on the block type identification information, obtaining an intra prediction mode of the current macroblock according to the block type of the partition of the current macroblock, and predicting the current macroblock using the intra prediction mode and a pixel value of a neighboring block.

Abstract: A method for decoding a current block in a current picture of a video bitstream includes decoding, from the video bitstream, a first motion vector for the current block relative to a first reference block of a first reference picture having a first picture order count, and decoding, from the video bitstream, a second motion vector for the current block relative to a second reference block of a second reference picture having a second picture order count. A similarity metric is generated based on a comparison of the first motion vector and the second motion vector. The method further includes determining whether to refine the first motion vector based on the similarity metric, generating a first refined motion vector from the first motion vector, and performing motion compensation to derive a first reference block from the first reference picture using the first refined motion vector.

Abstract: Systems, methods and apparatus for video processing are described. The video processing may include video encoding, video decoding, or video transcoding. One example method of video processing includes performing a conversion between a video and a bitstream of the video according to a format rule. The format rule specifies that a first field at a sequence level or a picture level or a slice level controls a value of a second field in an adaptation parameter set.

Abstract: A technique iteratively fits a rasterization distortion function to a distortion property of a display such as a head-mounted display (HMD). The technique also features reconstructing a distortion function from a rendered image with unknown distortion property.

Abstract: A method for inter prediction of a block of a picture and corresponding apparatus are provided. The method comprises: determining a first prediction block based on an initial first motion vector of a current block in a first reference picture, so as to obtain a first extension block; obtaining from the first reference picture, one or more first reference blocks each of which is associated with a combination of the initial first motion vector and one of motion vector offsets; obtaining a target motion vector offset with a smallest cost among the motion vector offsets; determining for the current block, a refined first motion vector which is a combination of the initial first motion vector and the target motion vector offset; and obtaining a refined prediction block of the current block based on the refined first motion vector, thereby improving coherence of refined motion vectors to achieve higher coding efficiencies.

Abstract: A method of performing motion vector prediction for a current block in a picture is provided which includes: deriving a candidate for a motion vector predictor to code a current motion vector of the current block, from a first motion vector of a first block that is spatially adjacent or temporally adjacent to the current block; adding the derived candidate to a list of candidates; and deriving at least one motion vector predictor based on a selected candidate from the list of candidates, wherein the deriving of the candidate includes determining whether to derive the candidate from the first motion vector, based on a type of a current reference picture and a type of a first reference picture, the current reference picture being referred to from the current block using the current motion vector, the first reference picture being referred to from the first block using the first motion vector.

Abstract: Frames from an image stream or streams are processed by independently operating digital signal processors (DSPs), with only frame checking microprocessors operating in a lockstep mode. In one example, two DSP are operating on alternate frames. Each DSP processes the frames and produces prediction values for the next frame. The lockstep microprocessors develop their own next frame prediction. The lockstep processors compare issued frames and previously developed predicted frames for consistency. If the predictions are close enough, the issued frame passes the test. The lockstep processors then compare the issued frame to the preceding two frames for a similar consistency check. If the prior frames are also close enough, the issued frame is acceptable. In another example, hardware checkers are provided to compare the present frame with a larger number of prior frames. The hardware checkers provide comparison results to the lockstep processors to compare against allowable variation limits.

Abstract: Methods to decode a picture from a bitstream are discussed. A partitioning structure of the picture is determined, wherein the partitioning structure defines at least first and second partitions of the picture. At least one dependency syntax element is decoded from the bitstream, and whether the second partition is dependent on or independent of the first partition is determined based on the at least one dependency syntax element. The picture is decoded from the bitstream based on determining whether the second partition of the picture is dependent on or independent of the first partition of the picture. Related methods of encoding and related devices are also discussed.

Abstract: A video processing method according to an embodiment of the present disclosure includes obtaining motion information and bi-directional prediction weight information for inter prediction of a current block, deriving a prediction sample of the current block based on the motion information and the bi-directional prediction weight information, and updating an HMVP candidate list based on a history-based motion vector predictor (HMVP) candidate including the motion information and the bi-directional prediction weight information. The motion information includes a first reference index and a first motion vector related to a first reference picture and a second reference index and a second motion vector related to a second reference picture. The bi-directional prediction weight information may be used to derive a first weight value applied to a first prediction sample from the first reference picture and a second weight value applied to a second prediction sample from the second reference picture.

Abstract: Devices, systems and methods for digital video coding, which include sub-block based inter prediction methods, are described. An exemplary method for video processing includes determining, for a conversion between a current block of video and a bitstream representation of the video, a maximum number of candidates in a sub-block based merge candidate list and/or whether to add sub-block based temporal motion vector prediction (SbTMVP) candidates to the sub-block based merge candidate list based on whether temporal motion vector prediction (TMVP) is enabled for use during the conversion or whether a current picture referencing (CPR) coding mode is used for the conversion, and performing, based on the determining, the conversion.

Abstract: A video encoding method includes a step of encoding substreams which are rows of largest coding units (LCUs) in parallel with each other, and a step of transmitting a bit stream including the encoded substreams, where the number of the substreams may be the same as the number of entry points.

Abstract: An image encoder or decoder includes circuitry and a memory coupled to the circuitry. The circuitry, in operation, predicts a first set of samples for a first partition of a current picture with one or more motion vectors including a first motion vector and predicts a second set of samples for a first portion of the first partition with one or more motion vectors from a second partition different from the first partition. The samples of the first set of samples of the first portion of the first partition and of the second set of samples of the first portion of the first partition are weighted. A motion vector for the first portion of the first partition is stored which is based on one or both of the first motion vector and the second motion vector. The first partition is encoded or decoded using at least the weighted samples of the first portion of the first partition.

Abstract: A motion vector decoding unit derives a motion vector of a prediction block subject to decoding on the basis of a motion vector of a candidate block included in candidate blocks selected from neighboring blocks. The motion compensation prediction unit performs motion compensation prediction using the derived motion vector. In case a motion vector number of a first block and a motion vector number of a second block are identical with each other, the motion vector decoding unit determines whether or not to set the second block as a candidate block in accordance with whether or not a reference index indicating a reference picture that the motion vector of the first block refers to and a reference index indicating a reference picture that the motion vector of the second block refers to are identical with each other.

Abstract: The present disclosure relates to a method for deriving constructed affine merge candidates. The method includes encoding, by an encoder, a regular merge flag for a coding unit (CU) that is coded as merge mode and merge related modes; in response to determining that the regular merge flag is encoded as one, indicating that a regular merge mode or merge mode with motion vector differences (MMVD) is used by the CU, constructing, by the encoder, a motion vector merge list for the CU and using regular merge index to indicate which candidate is used; and in response to determining that the regular merge flag is encoded as zero, indicating the regular merge mode is not used by the CU, and further encoding, by the encoder, mode flags to indicate associated merge related modes are used in response to determining that a mode flag's constraints are met.

Abstract: Coding efficiency is improved. A motion compensation filter unit acts on a motion vector applied image obtained by acting a motion vector on a reference image. The motion compensation filter unit causes filter coefficients mcFilter[i][k] designated by a phase i and a filter coefficient position k to act on the motion vector applied image. The filter coefficients mcFilter[i][k] includes filter coefficients calculated by using filter coefficients mcFilter[p][k] (p?i) and filter coefficients mcFilter[q][k] (q?i).

Abstract: A method and a device for encoding/decoding images are disclosed. The method for encoding images comprises the steps of: deriving a scan type of a residual signal for a current block according to whether or not the current block is a transform skip block; and applying the scan type to the residual signal for the current block, wherein the transform skip block is a block to which transform for the current block is not applied and is specified on the basis of information indicating whether or not transform for the current block is to be applied.

Abstract: A method and a device for encoding/decoding images are disclosed. The method for encoding images comprises the steps of: deriving a scan type of a residual signal for a current block according to whether or not the current block is a transform skip block; and applying the scan type to the residual signal for the current block, wherein the transform skip block is a block to which transform for the current block is not applied and is specified on the basis of information indicating whether or not transform for the current block is to be applied.

Abstract: An image decoding method performed by a decoding device according to the present document comprises the steps of: deriving a temporary reference motion vector regarding a current block on the basis of a temporal periphery block included in a reference picture of a current picture including the current block; deriving a binary code indicating a reference motion vector by applying a shifting operation to a binary code indicating the temporary reference motion vector; storing information regarding the binary code indicating the reference motion vector; deriving a motion vector regarding the current block on the basis of the reference motion vector; deriving a predicted block regarding the current block on the basis of the motion vector regarding the current block; and generating a restored picture regarding the current picture on the basis of the predicted block regarding the current block.

Abstract: An image encoding/decoding method and apparatus according to the present invention may determine a motion information encoding mode of a target block, configure a motion information prediction candidate group according to the motion information encoding mode, select one candidate from the motion information prediction candidate group so as to induce the selected candidate as motion information of the target block, and perform inter-prediction on the target block on the basis of the motion information of the target block.

Abstract: An inter prediction method according to the present invention comprises: a step for deriving reference motion information related to a unit to be decoded in a current picture; and a step for performing motion compensation for the unit to be decoded, using the reference motion information that has been derived. According to the present invention, image encoding/decoding efficiency can be enhanced.

Abstract: A method for setting the motion vector list and the apparatus using the same may include determining the presence of a first motion vector or a second motion vector by a sequential determination process in a first spatial candidate prediction group; and setting the first motion vector or the second motion vector produced through the sequential determination process as the candidate prediction motion vector. Thus, the encoding/decoding time and the complexity can be reduced by restricting the scaling number in a process for scanning the candidate prediction motion vector.

Abstract: A method for deblocking a chroma block edge between a first chroma block of a first image block and a second chroma block of a second image block. The method includes a decision process which includes: determining a first chroma quantization parameter for the first chroma block based on a first luma quantization parameter of a first luma block of the first image block and a chroma QP mapping table for the first chroma block; determining a second chroma quantization parameter for the second chroma block based on a second luma quantization parameter of a second luma block of the second image block and a chroma QP mapping table for the second chroma block; determining an averaged and rounded chroma quantization parameter based on the first chroma quantization parameter and the second chroma quantization parameter; and determining a threshold parameter based on the averaged and rounded chroma quantization parameter.

Abstract: Coding efficiency is improved. A motion compensation filter unit acts on a motion vector applied image obtained by acting a motion vector on a reference image. The motion compensation filter unit causes filter coefficients mcFilter[i][k] designated by a phase i and a filter coefficient position k to act on the motion vector applied image. The filter coefficients mcFilter[i][k] includes filter coefficients calculated by using filter coefficients mcFilter[p][k] (p?i) and filter coefficients mcFilter[q][k] (q?i).

Abstract: Provided is a video decoding method including: obtaining, from a bitstream, intra prediction mode information indicating an intra prediction mode of a current block; determining an interpolation filter set to be used in prediction of the current block, based on at least one of a size of the current block and the intra prediction mode indicated by the intra prediction mode information; determining a reference location to which a current sample of the current block refers according to the intra prediction mode; determining, in the interpolation filter set, an interpolation filter that corresponds to the reference location; determining a prediction value of the current sample, according to reference samples of the current block and the interpolation filter; and reconstructing the current block, based on the prediction value of the current sample.

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that decodes prediction information of a current block in a coded video bitstream. The prediction information comprises at least one reference picture index used in low delay inter bi-prediction for the current block. Each of the at least one reference picture index has a same value. The processing circuitry determines a first reference picture in a first reference picture list and a second reference picture in a second reference picture list based on the at least one reference picture index. The current block is coded using the low delay inter bi-prediction. The first reference picture list is identical to the second reference picture list. The first reference picture is identical to the second reference picture. The processing circuitry reconstructs the current block based on the first and second reference pictures.

Abstract: Coding efficiency is improved. A motion compensation filter unit acts on a motion vector applied image obtained by acting a motion vector on a reference image. The motion compensation filter unit causes filter coefficients mcFilter[i][k] designated by a phase i and a filter coefficient position k to act on the motion vector applied image. The filter coefficients mcFilter[i][k] includes filter coefficients calculated by using filter coefficients mcFilter[p][k] (p?i) and filter coefficients mcFilter[q][k] (q?i).

Abstract: A method of visual media processing, including: determining, fora conversion between a current video block of a visual media data and a bitstream representation of the visual media data, that a partitioning mode coding tool is disabled for the conversion based on a rule that depends on a dimension of the current video block; and performing the conversion based on the determining.

Abstract: To increase efficiency of a bit-depth scalable data-stream an inter-layer prediction is obtained by mapping samples of the representation of the picture or video source data with a first picture sample bit-depth from a first dynamic range corresponding to the first picture sample bit-depth to a second dynamic range greater than the first dynamic range and corresponding to a second picture sample bit-depth being higher than the first picture sample bit-depth by use of one or more global mapping functions being constant within the picture or video source data or varying at a first granularity, and a local mapping function locally modifying the one or more global mapping functions and varying at a second granularity smaller than the first granularity, with forming the quality-scalable data-stream based on the local mapping function such that the local mapping function is derivable from the quality-scalable data-stream.

Abstract: An image decoding method performed by the decoding apparatus according to this document comprising deriving a temporary reference motion vector for a current block based on a reference candidate block of the current block, deriving a reference motion vector by compressing the temporary reference motion vector based on a shifting operation, deriving a motion vector for the current block based on the reference motion vector, deriving prediction samples for the current block based on the motion vector for the current block, and generating reconstructed samples for the current block based on the prediction samples for the current block, wherein a total number of bits of the binary code representing the reference motion vector is less than a total number of bits of the binary code representing the temporary reference motion vector.

Abstract: A method of video decoding includes maintaining a number of tables, wherein each table includes a set of motion candidates, wherein each motion candidate is associated with corresponding motion information derived from previously video blocks, performing a conversion between a video block and a coded representation of the video block, and determining, based on a conversion condition of the video block, whether to update at least one of the tables by adding motion information corresponding to the video block.

Abstract: Embodiments of the systems and methods described herein provide a dynamic animation generation system that can apply a real-life video clip with a character in motion to a first neural network to receive rough motion data, such as pose information, for each of the frames of the video clip, and overlay the pose information on top of the video clip to generate a modified video clip. The system can identify a sliding window that includes a current frame, past frames, and future frames of the modified video clip, and apply the modified video clip to a second neural network to predict a next frame. The dynamic animation generation system can then move the sliding window to the next frame while including the predicted next frame, and apply the new sliding window to the second neural network to predict the following frame to the next frame.

Abstract: The present invention relates to block merging according to block split among video coding techniques, and a method and an apparatus for coding and decoding a video, in which in generating and modifying a block merging list, spatial merging candidate blocks of the block merging list are changed according to a split type and order of a current coding unit.

Abstract: A video encoding device includes encoding control means 11 for controlling an inter-PU partition type of a CU to be encoded, based on the maximum number (PA) of motion vectors allowed for an image block having a predetermined area and the number (PB) of motion vectors of an encoded image block contained in the image block having the predetermined area. A video decoding device includes decoding control means for controlling an inter-PU partition type of a CU to be decoded, based on the maximum number (PA) of motion vectors allowed for an image block having a predetermined area and the number (PB) of motion vectors of a decoded image block contained in the image block having the predetermined area.

Abstract: A method for video processing includes: determining, that the video block is split into a plurality of sub-blocks based on a condition associated with the video block, refining motion information of each sub-block using a motion refinement process, the motion refinement process being a one-step or an iterative multi-step refinement process; and performing a video processing on the video block based on the refined motion information of each sub-block.

Abstract: Aspects of the disclosure provide method and apparatus for video coding. In some examples, an apparatus includes processing circuitry for video decoding. The processing circuitry decodes prediction information of a current block from a coded video bitstream. The prediction information is indicative of an intra block copy mode. The processing circuitry selects, from a set of multiple candidate resolutions, a resolution of a block vector difference for the current block, and determines a block vector of the current block according to the selected resolution of the block vector difference and a block vector predictor of the current block. Then, the processing circuitry reconstructs at least one sample of the current block according to the block vector.

Abstract: A method of visual media processing, including: determining, fora conversion between a current video block of a visual media data and a bitstream representation of the visual media data, that a partitioning mode coding tool is disabled for the conversion based on a rule that depends on a dimension of the current video block; and performing the conversion based on the determining.

Abstract: A method of visual media processing method includes performing a conversion between a current video block of a current picture of a visual media data and a bitstream representation of the visual media data. The conversion is based on a reference region from the current picture comprising reference samples used for deriving a prediction block of the current video block. A virtual buffer of a defined size is used for tracking availability of the reference samples for deriving the prediction block.

Abstract: According to the present invention, an inter prediction method comprises the steps of: generating a merge candidate list for a block to be predicted, wherein the block is to correspond to a current prediction unit; deriving, on the basis of one of a plurality of merge candidates constituting the merge candidate list, motion information on the block to be predicted; and performing, on the basis of the derived motion information, a prediction on the block to be predicted so as to generate a prediction block corresponding to the current prediction unit.

Abstract: The present invention provides a method of processing a video signal based on inter prediction, the method comprises constructing a merge list based on a neighboring block of a current block; adding a history-based merge candidate representing motion information of a previously coded block of the current block to the merge list; obtaining a merge index indicating a merge candidate used for inter prediction of the current block within the merge list; generating a prediction block of the current block based on motion information of the merge candidate indicated by the merge index; and adding a residual block of the current block to the prediction block to reconstruct the current block, wherein when the history-based merge candidate has motion information that is not redundant with a pre-defined merge candidate among merge candidates included in the merge list, the history-based merge candidate is added to the merge list.

Abstract: Frames from an image stream or streams are processed by independently operating digital signal processors (DSPs), with only frame checking microprocessors operating in a lockstep mode. In one example, two DSP are operating on alternate frames. Each DSP processes the frames and produces prediction values for the next frame. The lockstep microprocessors develop their own next frame prediction. The lockstep processors compare issued frames and previously developed predicted frames for consistency. If the predictions are close enough, the issued frame passes the test. The lockstep processors then compare the issued frame to the preceding two frames for a similar consistency check. If the prior frames are also close enough, the issued frame is acceptable. In another example, hardware checkers are provided to compare the present frame with a larger number of prior frames. The hardware checkers provide comparison results to the lockstep processors to compare against allowable variation limits.

Abstract: A method for processing a video includes performing a determination, by a processor, that a first video block is partitioned to include a first prediction portion that is non-rectangular and non-square; adding a first motion vector (MV) prediction candidate associated with the first prediction portion to a motion candidate list associated with the first video block, wherein the first MV prediction candidate is derived from a sub-block MV prediction candidate; and performing further processing of the first video block using the motion candidate list.

Abstract: A method for processing a vide signal, according to the present invention comprises generating a reference picture list based on a current picture reference flag for a current picture, obtaining motion information about a current block in the current picture, and restoring the current block using the motion information of the current block and the reference picture list relating to the current picture.

Abstract: Provided is an apparatus for encoding and decoding an image that adaptively filters reference pixels according to an intra prediction mode and a size of a prediction block, and generates the prediction block according to the intra prediction mode. When the reference pixels for a second directional intra prediction mode are filtered, the reference pixels for a first directional intra prediction mode, that is closer to an intra prediction mode having a direction of 45° with reference to a horizontal mode than the second directional intra prediction mode is, are also filtered. The first and the second intra prediction modes exist between the horizontal mode and the intra prediction mode having the direction of 45° with reference to the horizontal mode. The number of intra prediction modes in which the filter is applied increases as the size of the prediction block increases.