Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.

Abstract: Methods and devices for encoding a point cloud. A predictor-copy coding mode is described in which an encoder copies the predicted points for a sub-volume rather than encoding the occupancy data for the original points in the sub-volume. A predictor-copy coding mode flag is coded in the bitstream to signal to the decoder whether predictor-copy coding mode is active or inactive. The predictor-copy coding mode flag may only be coded for sub-volumes that are eligible to use the mode. Eligibility may be based on depth within the coding tree and/or size of the sub-volume. Predictor-copy coding mode has the result of early termination of a branch of the coding tree. Instead of decoding the occupancy for the remainder of the branch, a decoder copies the predicted points that are positioned within the sub-volume as the reconstructed points of the point cloud for that sub-volume.

Abstract: A technique for determining a quality value for a subject block of encoded video is provided. Contributing blocks, of the same frame and/or different frames of the subject block, are determined by identifying blocks likely to be a part of the same moving object or background as the subject block. A spatial and/or temporal filter is then applied to the quality values of the contributing blocks and an initial quality value of the subject block. With a spatial filter, quality values for contributing blocks from the same frame are combined and used to modify the quality value of the subject block. With a spatial filter, a temporal characteristic quality value for contributing blocks of one or more other frames (such as the immediately previous frame) is determined and then combined with a quality value representative of the subject block.

Abstract: When determining that a pixel of a future frame, which is included in a search range, includes a pixel on an outside of an effective image area, and determining that pixels inside an effective image area of a past frame are present at positions point-symmetric to pixels inside the search range and on an outside of the effective image area about a pixel of interest, a pixel selector selects pixels in an effective image area of a past frame, the pixels being located at the point-symmetric positions. The pixel selector calculates difference values between the pixel of interest and the selected pixels inside the effective image area of the past frame.

Abstract: A video codec that encodes or decodes video sequences using decoder-side motion vector refinement is provided. The video codec identifies a first motion vector and a second motion vector for coding a current block of pixels of a current video frame in the video sequence. The video codec determines whether to perform motion vector refinement for the current block of pixels based on a comparison between a linear dimension of the current block of pixels and a threshold. When motion vector refinement is performed, the video codec refines the first and second motion vectors to minimize a distortion cost and codes the current block of pixels by using the refined first and second motion vectors. When motion vector refinement is not performed, the video codec codes the current block of pixels by using the identified first and second motion vectors.

Abstract: A method encodes an image of a video sequence by analyzing motion in the video sequence to identify a coherent region in the image that has moved with a distance vector which is longer than a threshold since a previously encoded image in the video sequence. A cost for inter-coding the block is calculated as a combination of a cost for encoding a motion vector and a residual. For at least one block of pixels in the coherent region, the cost for encoding the motion vector is calculated relative to the distance vector of the coherent region instead of being calculated relative to a motion vector of a neighbouring block of pixels in the image. The block is then inter-coded if the combined cost for encoding the motion vector and the cost for encoding the residual when combined are below a cost for intra-coding the block of pixels.

Abstract: A method of dividing an input image signal into pixel blocks, and performing inter-prediction on the divided pixel blocks. This method includes selecting predicted motion information from a motion information buffer storing motion information in an encoded region, and predicting motion information of an encoding target block by using the predicted motion information. The method further includes acquiring representative motion information from a plurality of items of motion information in an encoded region in accordance with first information indicating a method of selecting the predicted motion information, thereby obtaining only the representative motion information.

Abstract: An apparatus includes an inter prediction unit configured to decode multiple reference picture list structures and to select one reference picture list structure from the multiple reference picture list structures on a per picture basis or on a per slice basis, wherein in the multiple reference picture list structures, the number of all reference pictures is one or more.

Abstract: A compensation method for VR display, a compensation device for VR display, and a display device are provided. The compensation method for VR display includes: calculating a first synchronization signal value to be output by a controller according to a rendering resolution, a rendering frame rate and bandwidth data of a display panel; comparing the first synchronization signal value with a pre-stored second synchronization signal value of the display panel; generating compensation image data between two adjacent frames of original image data in a case where a comparison result shows that the first synchronization signal value is greater than the second synchronization signal value; and compensating an image to be displayed according to generated compensation image data.

Abstract: Encoding a video data stream comprising a first and second frame of video data, encoding comprising the steps of: obtaining motion prediction data for a plurality of pixels, the motion prediction data indicative of the predicted relative motion of the plurality of pixels between the first and second frames of video data; obtaining a data mask comprising data indicative of relative weights to be applied for predicting pixels for the second frame; determining update data to define a relative difference between a plurality of pixels in the first frame and a corresponding plurality of pixels in the second frame, wherein said update data is based on a weighted scaling of the motion prediction data and the second frame of video data, said weighted scaling based on the data mask; and encoding the video data stream comprising at least the first frame of video data and the update data.

Abstract: A video codec for encoding a sequence of video frames divides a video frame area into number of row segments. The Video encoder selects a different set of row segments in each video frame in a set of video frames and encodes the selected set of row segments by intra-prediction. As a result, the selected part of the frame is intra-refreshed. The video codec limits the maximum value of the vertical global motion vector GMVy to zero and video codec adjust the number of row segments in the select set of row segments based on the height of the search range configured for the motion estimation. As a result, the video codec may not refer to an un-refreshed portion in the previous frame for encoding an already refreshed area of the current frame.

Abstract: A method of dividing an input image signal into pixel blocks, and performing inter-prediction on the divided pixel blocks. This method includes selecting predicted motion information from a motion information buffer storing motion information in an encoded region, and predicting motion information of an encoding target block by using the predicted motion information. The method further includes acquiring representative motion information from a plurality of items of motion information in an encoded region in accordance with first information indicating a method of selecting the predicted motion information, thereby obtaining only the representative motion information.

Abstract: A method of decoding a motion vector includes: obtaining information indicating a motion vector resolution (MVR) of a current block from a bitstream; selecting one candidate block from among at least one candidate block, based on the MVR of the current block; and obtaining a motion vector of the current block corresponding to the MVR, by using a motion vector of the determined one candidate block as a prediction motion vector of the current block.

Abstract: A method and apparatus for deriving motion compensated prediction for boundary pixels in a video coding system are disclosed. Embodiments of the present invention determine a current motion vector (MV) and one or more neighboring MVs corresponding to an above MV, a left MV, or both the above MV and the left MV. A first predictor for a current boundary pixel in a boundary region of the current CU is generated by applying motion compensation based on the current MV and a first reference picture pointed by the current MV. One or more second predictors for the current boundary pixel are generated by applying the motion compensation based on the neighboring MVs and reference pictures pointed by the neighboring MVs. A current boundary pixel predictor for the current boundary pixel is then generated using a weighted sum of the first predictor and the second predictors according to weighting factors.

Abstract: Systems, methods, and media are provided for video coding, including loop filtering. One example includes obtaining the video data comprising one or more pictures and determining a sample of the one or more pictures to be filtered using a loop filter. A shift variable associated with the sample is determined, and a rounding value is selected based on the shift variable. A modified sample is generated, the modified sample being generated at least in part by modifying a value of the sample using one or more filter coefficients, one or more clipping values of the loop filter, the rounding value, and the shift variable. The modified sample is then output.

Abstract: A method that is performed by a video encoding device is provided. The method includes identifying N image frames in a sliding window of an image frame sequence, the N image frames including N?1 encoded image frames and a to-be-encoded image frame; obtaining a motion amplitude difference of the N image frames in the sliding window, the motion amplitude difference indicating a difference between a corresponding image frame motion amplitude and a previous image frame motion amplitude; updating a static variable based on the motion amplitude difference of each of the N image frames in the sliding window, the static variable indicating a number of consecutive static image frames; and encoding the to-be-encoded image frame as an I frame based on the updated static variable not being less than a first preset threshold.

Abstract: A method of decoding video data includes constructing, by a video decoder implemented in processing circuitry, a candidate list of motion vector information for a portion of a current frame. The method includes receiving, by the video decoder, signaling information indicating starting motion vector information of the candidate list of motion vector information, the starting motion vector information indicating an initial position in a reference frame. The method includes refining, by the video decoder, based on one or more of bilateral matching or template matching, the starting motion vector information to determine refined motion vector information indicating a refined position in the reference frame that is within a search range from the initial position. The method includes generating, by the video decoder, a predictive block based on the refined motion vector information and decoding, by the video decoder, the current frame based on the predictive block.

Abstract: Provided is a method for decoding a video signal. The method includes generating a first prediction sample by performing intra prediction on a current block, determining an intra prediction pattern of a current block, partitioning the current block into a plurality of sub-blocks based on the determined intra prediction pattern, generating a first prediction sample for a sub-block by performing intra prediction, determining an offset for the sub-block to obtain a second prediction sample, and generating the second prediction sample for the sub-block by using the first prediction sample and the offset.

Abstract: A picture decoding method performed by a decoding apparatus according to the present disclosure includes obtaining motion prediction information from bitstream, generating an affine MVP candidate list including affine MVP candidates for a current block, deriving CPMVPs for respective CPs of the current block based on one of the affine MVP candidates included in the affine MVP candidate list, deriving the CPMVDs for the CPs of the current block based on information on CPMVDs for each of the CPs included in the obtained motion prediction information, deriving CPMVs for the CPs of the current block based on the CPMVPs and the CPMVDs, deriving prediction samples for the current block based on the CPMVs, and generating reconstructed samples for the current block based on the derived prediction samples.

Abstract: Images to be used as reference images in an adaptive resolution coder or decoder undergo resizing to match the resolution of an image being processed. The resizing process is carried out using extended resolution bit lengths to more accurately represent the processed image. The internal bit depth is retained through the resizing process, and kept as a reference image is stored. When a reference image is used in motion compensation processing, the resized reference matches the resolution of a current image being processed and has an expanded bit depth precision to achieve better fidelity.

Abstract: Disclosed herein is a method for adaptive bidirectional optical flow estimation for inter-screen prediction compensation during video encoding. The method aims to reduce complexity and/or cost of bidirectional optical flow (BIO) at a pixel level or a subblock level.

Abstract: Systems and methods for coding and decoding are provided. A method includes receiving a coded video stream including a parameter set and video data partitioned into a plurality of layers; deriving, based on the parameter set, at least one first syntax element that specifies at least one first layer, from among the plurality of layers, to be outputted in an output layer set, and at least one second syntax element that indicates profile-tier-level information of the output layer set; and decoding, based on information derived from the parameter set, a portion of the video data of the coded video stream that corresponds to the output layer set.

Abstract: A method of dividing an input image signal into pixel blocks, and performing inter-prediction on the divided pixel blocks. This method includes selecting predicted motion information from a motion information buffer storing motion information in an encoded region, and predicting motion information of an encoding target block by using the predicted motion information. The method further includes acquiring representative motion information from a plurality of items of motion information in an encoded region in accordance with first information indicating a method of selecting the predicted motion information, thereby obtaining only the representative motion information.

Abstract: A method of video processing is provided to include: maintaining, prior to a conversion between a current video block of a video region and a coded representation of the video, at least one history-based motion vector prediction (HMVP) table, wherein the HMVP table includes one or more entries corresponding to motion information of one or more previously processed blocks; and performing the conversion using the at least one HMVP table; and wherein the motion information of each entry is configured to include interpolation filter information for the one or more previously processed blocks, wherein the interpolation filter information indicates interpolation filters used for interpolating prediction blocks of the one or more previously processed blocks.

Abstract: Video processing methods and apparatuses for coding a current block comprise receiving input data of a current block, splitting the current block into sub-blocks, deriving motion information for the sub-blocks, performing motion compensation for the sub-blocks using the motion information to derive a final predictor, deriving and storing a representative motion vector for each grid in the current block, and encoding or decoding the current block using the final predictor. The representative motion vector for grids in a weighted area is determined by combining the motion vectors of the sub-blocks if the motion vectors of the sub-blocks are in different lists. The representative motion vector for grids in the weighted area is determined as one of the motion vectors of the sub-blocks if the motion vectors of the sub-blocks are in the same list.

Abstract: A detection unit successively selects each of a plurality of blocks of a target image as a target block and detects a motion vector of the target block using a reference image. During motion vector detection, a control unit performs control to partially store the reference image into a storage unit so as to achieve a state where a search range for the target block is stored. The detection unit selects each of the plurality of blocks as the target block in an order of raster scan for each of N regions obtained by dividing the target image in a horizontal direction. When a temporal distance between the target image and the reference image is a second distance that is longer than a first distance, a value of N is large compared to a case where the temporal distance is the first distance.

Abstract: Different implementations are described for determining one or more illumination compensation parameters for a current block being encoded by a video encoder or decoded by a video decoder, based on the selection of one or more neighboring samples. The selection of the one or more neighboring samples is based on information used to reconstruct a plurality of neighboring reconstructed blocks. The selection may be based on the motion information, such as motion vector and reference picture information. In one example, only samples from neighboring reconstructed blocks that have (1) the same reference picture index and/or (2) a motion vector close to the motion vector of the current block is selected. In another example, if the current block derives or inherits some motion information from a top or left neighboring block, then only the top or left neighboring samples are selected for IC parameter calculation.

Abstract: A method and apparatus of video coding using history-based candidate derivation are disclosed. According to one method, a current block is inside a Shared Merge candidate list Region (SMR) or a history-based parallel processing region is received. The current block is encoded or decoded using a Merge candidate list. Only if the current block is one of first-coded N (N?0) blocks, one of last-coded N blocks, or one of selected N blocks, the history-based candidate list is updated after the current block is encoded or decoded. In one embodiment, Merge candidate list is pre-generated for the current block in the SMR and is separately generated for the current block in the history-based parallel processing region. In another method, if the current block is inside the SMR or the history-based parallel processing region, the current block is encoded or decoded using a history-based candidate list associated with the root CU.

Abstract: A decoder includes circuitry configured to receive a bitstream; construct, for a current block, a motion vector candidate list including adding a global motion vector candidate to the motion vector candidate list; and reconstruct pixel data of the current block and using the motion vector candidate list. Related apparatus, systems, techniques and articles are also described.

Abstract: In one embodiment, a method comprising receiving at a single encoding engine an input video stream according to a first version of a video characteristics, such as frame rate, profile and level, and coding standard, and generating by the single encoding engine, in parallel, a plurality of streams comprising a first encoded stream according to a first version of the video characteristic and a second encoded stream according to a second version of the video characteristic, the second encoded stream generated based on video coding information used to generate the first encoded stream.

Abstract: A method of video decoding includes creating a candidate list for a current block in a current picture included in a coded video bitstream. The method further includes determining a coding mode for a candidate block associated with the current block. The method further includes determining whether to add, to the candidate list, a vector associated the candidate block based on the determined coding mode. The method further includes reconstructing the current block using at least one candidate from the candidate list.

Abstract: The present invention relates to a method and apparatus for setting a reference picture index of a temporal merging candidate. An inter-picture prediction method using a temporal merging candidate can include the steps of: determining a reference picture index for a current block; and inducing a temporal merging candidate block of the current block and calculating a temporal merging candidate from the temporal merging candidate block, wherein the reference picture index of the temporal merging candidate can be calculated regardless of whether a block other than the current block is decoded. Accordingly, a video processing speed can be increased and video processing complexity can be reduced.

Abstract: A moving picture coding method includes: coding, using a motion vector, a current block to be coded; generating a plurality of predictive motion vectors; and coding the motion vector using one of the predictive motion vectors, and when a co-located block included in a coded picture and co-located with the current block has two reference motion vectors and reference directions of the two reference motion vectors are the same, a first prediction vector is generated using a first reference motion vector and a second prediction vector is generated using a second reference motion vector in the generating of a plurality of predictive motion vectors.

Abstract: A decoder includes circuitry configured to receive a bitstream, extract a header associated with a current frame and including a signal characterizing that global motion is enabled and further characterizing parameters of a global motion model, and decoding the current frame, the decoding including using a motion model for each current block having a complexity that is less than or equal to a complexity of the global motion model. Related apparatus, systems, techniques, and articles are also described.

Abstract: A video decoder for decoding a video from a data stream using block-based predictive decoding, the video decoder supporting a set of primitive prediction modes for predicting blocks of a picture of the video, is configured to predict a predetermined block by a composed prediction signal by deriving, using a collection of one or more primitive prediction modes out of the set of primitive prediction modes, a collection of one or more primitive predictions for the predetermined block, and composing the composed prediction signal for the predetermined block by combining the collection of one or more primitive predictions.

Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, whether a combined inter and intra prediction (CIIP) coding technique is to be applied to the current block based on a characteristic of the current block. The CIIP coding technique uses an intermedia inter prediction value and an intermedia intra prediction value to derive a final prediction value of the current block. The method also includes performing the conversion based on the determining.

Abstract: A video coding block is intra-predicted on the basis of reference samples from a set of neighboring video coding blocks. A fitting plane is determined on the basis of the reference samples. The fitting plane defines a plurality of fitting samples. For a selected directional intra prediction mode, the sample values of the video coding block are predicted on the basis of the reference sample values and the fitting sample values.

Abstract: Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a block of a video and a bitstream representation of the video, whether a bi-prediction coding technique is applicable to the block based on a size of the block having a width W and a height H, W and H being positive integers. The method also includes performing the conversion based on the determining.

Abstract: A method for decoding a picture from a bitstream, includes decoding a first part of the bitstream to form an address mapping that maps a segment group index value to a segment group address; and decoding a second part of the bitstream. The second part of the bitstream includes code words representing the plurality of segment groups. Decoding the second part of the bitstream includes decoding a first segment group. Decoding the first segment group includes: 1) decoding a first segment group index value for the first segment group; 2) determining a first segment group address for the first segment group; 3) determining a first spatial location for the first segment group; and 4) decoding at least one sample value for the first segment group and assigning the at least one sample value to a location in the decoded picture given by the first spatial location.

Abstract: Disclosed herein is a method for adaptive bidirectional optical flow estimation for inter prediction compensation during video encoding. The method aims to reduce complexity and/or cost of bidirectional optical flow (BIO) at a pixel level or a subblock level.

Abstract: A method and image processing circuit for performing searching operations regarding an image are provided, wherein the image includes a plurality of blocks. The method includes: utilizing a grouping circuit to divide the plurality of blocks into a plurality of groups, wherein a group within the plurality of groups corresponds to a searching region within a target image, the group includes NB reference blocks within the plurality of blocks, the searching region includes NB sub-regions, and NB is an integer greater than one; utilizing a searching circuit to search for the NB reference blocks in the NB sub-regions, respectively, to generate NB searching results respectively corresponding to the NB reference blocks; and utilizing a selecting circuit to select a searching result from the NB searching results, for utilizing the searching result to represent a portion or all of the NB searching results.

Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.

Abstract: An apparatus comprises: a memory; and a processor coupled to the memory and configured to: obtain a current block of a video frame, obtain candidate MVs corresponding to neighboring blocks of the video frame, the neighboring blocks neighbor the current block, obtain precisions of the candidate MVs, perform first rounding of the precisions based on a rounding scheme, perform second rounding of the candidate MVs based on the first rounding, perform pruning of the candidate MVs, and generate a candidate list based on the second rounding and the pruning.

Abstract: A method of video decoding performed by a video decoder includes receiving a coded video bitstream including a current picture. The method further includes determining a block size of a current block coded in the intra sub-partition (ISP) coding mode. The method further includes determining a direction and number of partitions of the current block based on the determined block size. The method further includes decoding the current block based on the determined direction and number of partitions of the current block.

Abstract: A method of decoding motion information includes: identifying a type of omission motion information not included in a bitstream from among a plurality of pieces of motion information used to decode a current block that is inter predicted; obtaining the omission motion information by using a predetermined method; and decoding the current block based on the plurality of pieces of motion information including the obtained omission motion information.

Abstract: A decoder includes circuitry configured to receive a bitstream, extract a header including a list of reference frames available for global motion compensation, determine, using the header, a global motion model for a current block, the global motion relative to a reference frame contained in the list of reference frames, and decode the current block using the global motion model. Related apparatus, systems, techniques and articles are also described.

Abstract: Improved systems and methods related to decoder-side motion vector derivation (DMVD), for example, in applying one or more constraints to motion information, such as a MV derived by DMVD, and/or a MV difference between an initial MV and an MV derived by DMVD. These techniques may be applied to any of the existing video codecs, such as HEVC (High Efficiency Video Coding), and/or may be an efficient coding tool in any future video coding standards. In one example, the block size used for DMVD can be restricted. In another example, FRUC bilateral matching can be simplified by not searching outside reference blocks indicated by the original motion vector.

Abstract: An example method for visual media decoding includes applying, to a current visual media block, a partitioning process that splits the current visual media block into exactly four sub-blocks including at least one sub-block that has a size different from half of a width of the current visual media block times half of a height of the current visual media block decoding, based on a bitstream representation, the four sub-blocks, and decoding, based on the four sub-blocks and the partitioning process, the current visual media block.

Abstract: Methods and Systems disclosed to counteract spatial distortions introduced by imaging processes of multi-directional video frames, where objects may be projected to spherical or equirectangular representations. Techniques provided to invert the spatial distortions in video frames used as reference picture data in predictive coding, by spatially transforming the image content of the reference picture data before this image content is being used for the prediction of input video data in prediction-based coders and decoders.

Abstract: A system may comprise a video data buffer configured to store input video frame data received from a source; and a video processor logically coupled to the video data buffer, wherein the video processor is configured to cause the stored video frame data to be output from the video data buffer at an output video frame rate, and vary the output video frame rate based on an amount of video frame data stored at the video data buffer.