Abstract: Coding efficiency is improved. A motion compensation filter unit acts on a motion vector applied image obtained by acting a motion vector on a reference image. The motion compensation filter unit causes filter coefficients mcFilter[i][k] designated by a phase i and a filter coefficient position k to act on the motion vector applied image. The filter coefficients mcFilter[i][k] includes filter coefficients calculated by using filter coefficients mcFilter[p][k](p?i) and filter coefficients mcFilter[q][k](q?i).

Abstract: Computer processor hardware: parses a data stream into first portions of encoded data and second portions of encoded data; implements a first decoder to decode the first portions of encoded data into a first rendition of a signal; implements a second decoder to decode the second portions of encoded data into reconstruction data, the reconstruction data specifying how to modify the first rendition of the signal; and applies the reconstruction data to the first rendition of the signal to produce a second rendition of the signal.

Abstract: Various embodiments relate to a video coding system in which some elements required for decoding are generated according to a process that not specified within the video coding system. This process is hereafter referenced to as being the “external” process. This external process may generate “external” reference pictures to be used by a decoder that is adapted to use these external pictures. Encoding method, decoding method, encoding apparatus, decoding apparatus based on this post-processing method are proposed.

Abstract: To encode a coding unit in the inter modes, there exist multiple inter modes that signal the motion information using a Motion Vector Predictor (MW) list. The MW lists for different coding modes include spatial predictors. In one embodiment, for all coding modes that use MVP lists, the top spatial predictor is first added to the motion vector predictor list before the left spatial predictor. In another embodiment, a subset of coding modes adds the top spatial predictor before the left spatial predictor, and another subset of coding modes adds the left spatial predictor before the top spatial predictor. For example, all merge modes add the top spatial predictor first, and all AMVP modes add the left spatial predictor first. In another example, all non-sub-block modes add the top spatial predictor first, and all sub-block modes add the left spatial predictor first.

Abstract: An afterimage analyzer may include an accumulation determiner which determines an accumulation interval of images based on a first change amount of images in regions of interest of the images in which an afterimage object is disposed and a second change amount of images in entire regions, an image accumulator which accumulates the images during the accumulation interval to generate accumulated images, and an afterimage object detector which detects the afterimage object from the accumulated images.

Abstract: A motion vector decoding unit derives a motion vector of a prediction block subject to decoding on the basis of a motion vector of a candidate block included in candidate blocks selected from neighboring blocks. The motion compensation prediction unit performs motion compensation prediction using the derived motion vector. In case a motion vector number of a first block and a motion vector number of a second block are identical with each other, the motion vector decoding unit determines whether or not to set the second block as a candidate block in accordance with whether or not a reference index indicating a reference picture that the motion vector of the first block refers to and a reference index indicating a reference picture that the motion vector of the second block refers to are identical with each other.

Abstract: Systems, methods, and instrumentalities for sub-block motion derivation and motion vector refinement for merge mode may be disclosed herein. Video data may be coded (e.g., encoded and/or decoded). A collocated picture for a current slice of the video data may be identified. The current slice may include one or more coding units (CUs). One or more neighboring CUs may be identified for a current CU. A neighboring CU (e.g., each neighboring CU) may correspond to a reference picture. A (e.g., one) neighboring CU may be selected to be a candidate neighboring CU based on the reference pictures and the collocated picture. A motion vector (MV) (e.g., collocated MV) may be identified from the collocated picture based on an MV (e.g., a reference MV) of the candidate neighboring CU. The current CU may be coded (e.g., encoded and/or decoded) using the collocated MV.

Abstract: Devices and methods for Intra prediction are provided. The method includes: parsing a bitstream, wherein the bitstream includes indication information to indicate whether a closest neighboring reference line to the current block is used for an intra prediction; determining an intra prediction mode of the current block is not Planar mode when the closest neighboring reference line to the current block is not used for the intra prediction; and obtaining an index indicating which intra prediction mode in a set of most probable modes is used for the intra prediction mode of the current block when the intra prediction mode of the current block is not Planar mode. The method can improve the efficiency to determine the intra prediction mode of the current block.

Abstract: A system for encoding a sequence of frames of a data signal. The system comprises: a first encoding system comprising at least: a first encoder configured to encode the sequence of frames according to a first encoding algorithm; and a first rate control unit configured to control a first bit rate at which the first encoder encodes said sequence of frames; a second encoding system comprising at least: a second encoder configured to encode a second sequence of frames associated with the sequence of frames according to a second encoding algorithm; and a second rate control unit configured to control a second bit rate at which the second encoder encodes said second sequence of frames associated with the sequence of frames.

Abstract: A computer implemented method for warping virtual content includes receiving rendered virtual content data, the rendered virtual content data including a far depth. The method also includes receiving movement data indicating a user movement in a direction orthogonal to an optical axis. The method further includes generating warped rendered virtual content data based on the rendered virtual content data, the far depth, and the movement data.

Abstract: Disclosed are an image encoding/decoding method and apparatus. The image decoding method includes decoding coding mode information of a current coding block, dividing the current coding block into at least one prediction block, and generating prediction samples of the at least one prediction block on the basis of the decoded coding mode, in which the coding mode information is information indicating any one mode among intra mode, inter mode, and hybrid mode.

Abstract: Systems, methods and apparatus for video processing are described. The video processing may include video encoding, video decoding, or video transcoding. One example method of video processing includes performing a conversion between a video and a bitstream of the video according to a format rule. The format rule specifies that a first field at a sequence level or a picture level or a slice level controls a value of a second field in an adaptation parameter set.

Abstract: Systems and methods for performing motion vector prediction for video coding are disclosed. A motion vector predictor is determined based at least in part on motion information associated with a selected motion vector predictor origin and offset values corresponding to a selected sampling point. The sampling point is specified according to a set of direction and distance on a sampling map for the motion vector predictor origin.

Abstract: Provided is a video decoding method including: generating a merge candidate list including neighboring blocks referred to predict a motion vector of a current block in a skip mode or a merge mode; when a merge motion vector difference is used according to merge difference mode information indicating whether the merge motion vector difference and a motion vector determined from the merge candidate list are used, determining a base motion vector from a candidate determined among the merge candidate list based on merge candidate information; determining the motion vector of the current block by using the base motion vector and a merge motion vector difference of the current block, the merge motion vector difference being determined by using a distance index and direction index of the merge motion vector difference of the current block; and reconstructing the current block by using the motion vector of the current block.

Abstract: The present disclosure relates to video encoding and decoding, and in particular to determining motion information for a current block using a history-based motion vector predictor, HMVP, list. The HMVP list is constructed, with said list being an ordered list of N HMVP candidates Hk, k=0, . . . , N?1, which are associated with motion information of N preceding blocks of the frame and precede the current block. Each HMVP candidate has motion information including elements of one or more motion vectors, MVs, one or more reference picture indices corresponding to the MVs, and one or more bi-prediction weight indices. One or more HMVP candidates from the HMVP list are added into a motion information candidate list for the current block; and the motion information is derived based on the motion information candidate list.

Abstract: An image encoder or decoder includes circuitry and a memory coupled to the circuitry. The circuitry, in operation, predicts a first set of samples for a first partition of a current picture with one or more motion vectors including a first motion vector and predicts a second set of samples for a first portion of the first partition with one or more motion vectors from a second partition different from the first partition. The samples of the first set of samples of the first portion of the first partition and of the second set of samples of the first portion of the first partition are weighted. A motion vector for the first portion of the first partition is stored which is based on one or both of the first motion vector and the second motion vector. The first partition is encoded or decoded using at least the weighted samples of the first portion of the first partition.

Abstract: Example image processing methods and apparatuses are disclosed. One example image processing method includes obtaining a video stream, where the video stream includes a first frame of image, a second frame of image, and a third frame of image that are adjacent in time sequence. The video stream can then be decoded to obtain a first alignment frame, a second alignment frame, and at least one residual between the first frame of image, the second frame of image, and the third frame of image. At least one residual frame can then be generated based on the at least one residual. Super resolution processing can then be performed on the second frame of image based on the at least one residual frame, the first alignment frame, and the second alignment frame to obtain an additional second frame of image obtained after super resolution.

Abstract: A method of decoding a motion vector includes: determining at least one prediction motion vector (PMV) candidate block used to determine a PMV of a current block; determining an availability of a motion vector of the at least one PMV candidate block; when there is a PMV candidate block determined to be unavailable, determining the PMV of the current block by using a default motion vector (MV); and obtaining a motion vector of the current block based on the determined PMV.

Abstract: A method of visual media processing method includes performing a conversion between a current video block of a current picture of a visual media data and a bitstream representation of the visual media data. The conversion is based on a reference region from the current picture comprising reference samples used for deriving a prediction block of the current video block. A virtual buffer of a defined size is used for tracking availability of the reference samples for deriving the prediction block.

Abstract: A video encoding method according to an embodiment of the present invention includes generating header information that includes information about resolutions of motion vectors of respective blocks, determined based on motion prediction for a unit image. Here, the header information includes flag information indicating whether resolutions of all motion vectors included in the unit image are integer-pixel resolutions. Further, a video decoding method according to another embodiment of the present invention includes extracting information about resolutions of motion vectors of each unit image from header information included in a target bitstream to be decoded; and a decoding unit for decoding the unit image based on the resolution information. Here, the header information includes flag information indicating whether resolutions of all motion vectors included in the unit image are integer-pixel resolutions.

Abstract: An electronic apparatus includes a memory configured to store an input image and at least one processor configured to obtain two consecutive frames of the input image as input frames; obtain a first interpolation frame of the input frames and a first confidence corresponding to the first interpolation frame based on a first interpolation method; obtain a second interpolation frame of the input frames and a second confidence corresponding to the second interpolation frame based on a second interpolation method that is different from the first interpolation method; obtain weights corresponding to the first interpolation frame and the second interpolation frame, based on the first confidence and the second confidence, respectively; and obtain an output image based on the weights.

Abstract: Techniques for an efficient inter-prediction structure and signaling for low-delay streaming of live video are described.

Abstract: An image encoding/decoding method and apparatus according to the present invention may determine a motion information encoding mode of a target block, configure a motion information prediction candidate group according to the motion information encoding mode, select one candidate from the motion information prediction candidate group so as to induce the selected candidate as motion information of the target block, and perform inter-prediction on the target block on the basis of the motion information of the target block.

Abstract: An integrated gaze tracker includes a pixel array configured to capture an image to provide an output signal comprising the image; a memory configured to store an image data unit to be read out in units of lines based on the output signal of the pixel array; and a processor configured to generate a gaze vector based on partial image data comprising the image data unit, among entire image data included in the output signal.

Abstract: Aspects of the disclosure provide methods and apparatuses for video processing. In some examples, an apparatus for video processing includes processing circuitry. The processing circuitry determines one or more parameters of a temporal filter based on video contents in an uncompressed video. The uncompressed video includes a sequence of frames. Then, the processing circuitry applies the temporal filter with the determined parameter on a first pixel in a first frame to determine a filtered value for the first pixel based on the first pixel in the first frame and second pixels in a group of reference frames for the first frame. Further, the processing circuitry encodes a filtered video that includes the filtered value for the first pixel in the first frame to generate a coded video bitstream that carries the filtered video.

Abstract: A method for predicting motion information of a picture block and a related product is provided. The method includes: determining a candidate motion information list of a current picture block, where the candidate motion information list includes at least one combined candidate motion information, one combined candidate motion information is obtained by weighting P candidate motion information by using corresponding weighting factors; determining target motion information in the candidate motion information list; and predicting motion information of the current picture block based on the target motion information.

Abstract: An encoder includes circuitry and memory connected to the circuitry. In operation, the circuitry: derives an average value of motion vector values of two prediction candidates in a prediction candidate list for a merge mode, and registers the average value derived as new motion vector information of a new prediction candidate into the prediction candidate list; and derives new correction processing information regarding correction processing of a prediction image, and registers the new correction processing information derived into the prediction candidate list in association with the new motion vector information.

Abstract: Methods and devices for decoding including a processor configured to determine which picture is a collocated picture, and determine a location of an associated block of the video data in the collocated picture that corresponds to the current block of video data in the current coding picture, based on using previously decoded blocks in the current coding picture to find an initial motion vector between the associated block in the collocated picture and the current block in the current coding picture, where the associated block of the video data includes at least one first derived motion vector. The processor configured to determine at least one second derived motion vector associated with the current block in the current coding picture, when the initial motion vector points to the collocated picture, based on the at least on first derived motion vector associated with the associated block in the collocated picture.

Abstract: A system comprises an encoder configured to compress media objects using a compression loop that includes a residual decomposition component that decomposes a residual signal for a block of the media object being compressed into multiple sub-error signals. The encoder is further configured to enable different transformation and/or quantization processes to be specified to be applied to different ones of the sub-errors. A corresponding decoder is configured to apply inverse transformation/quantization processing to the sub-error signals, based on the transformation/quantization processes that were applied at the encoder. The decoder then re-creates a residual signal from the processed sub-error signals and uses the re-created residual signal to correct predicted values at the decoder.

Abstract: An inter prediction method according to the present invention comprises: a step for deriving reference motion information related to a unit to be decoded in a current picture; and a step for performing motion compensation for the unit to be decoded, using the reference motion information that has been derived. According to the present invention, image encoding/decoding efficiency can be enhanced.

Abstract: A prediction processing system includes a processing circuit and a reference data buffer. The processing circuit performs a first inter prediction operation upon a first prediction block in a frame to generate a first inter prediction result, and further performs a second inter prediction operation upon a second prediction block during a first period. The reference data buffer buffers a reference data derived from the first inter prediction result. The processing circuit further fetches the reference data from the reference data buffer, and performs a non-inter prediction operation according to at least the reference data during a second period, wherein the second period overlaps the first period.

Abstract: Encoding or decoding picture information can involve determining a coding mode associated with a current coding unit including picture information; determining, based on the coding mode, a first precision level associated with a first portion of a motion vector information associated with the current coding unit, and a second precision level associated with a second portion of the motion vector information; obtaining a motion vector associated with the current coding unit based on the motion vector information and the first and second precision levels; and encoding or decoding at least a portion of the picture information included in the current coding unit based on the coding mode and the motion vector.

Abstract: The present invention relates to a method and apparatus for encoding or decoding a video signal. According to the present invention, a plurality of reference units for image prediction of the current unit is acquired and combined to obtain a unit prediction value, thereby improving the accuracy of image prediction. More particularly, the present invention relates to a method for inducing a variety of reference units using a motion vector prediction value or a motion vector which is used in conventional inter-prediction, and also relates to a method which combines the reference units so as to obtain the prediction value for the current unit. In addition, the present invention relates to a method which involves acquiring a plurality of reference units for a merging mode, and combining the reference units so as to perform image prediction.

Abstract: The general aspects extend motion modes, such as merge with motion vector difference, and symmetrical motion vector difference, to motion models beyond a simple translational model, for example in combination with merge and alternative temporal motion vector prediction modes. Embodiments extend the use of MMVD and SMVD motion vector coding tools to all the motion model derivation methods and temporal prediction methods that are supported in proposed video standards, so as to increase the overall compression performance. Particular embodiments describe combining MMVD or SMVD with the affine motion model, the ATMVP motion model, the planar motion model, the regressive motion field, the triangle-partition-based motion model, the GBI temporal prediction method, the LIC temporal prediction method and the Multi-hypothesis prediction method.

Abstract: Provided is an image decoding method including determining a current chroma block having a rectangular shape corresponding to a current luma block included in one of a plurality of luma blocks, determining a piece of motion information for the current chroma block and a chroma block adjacent to the current chroma block by using motion information of the current chroma block and the adjacent chroma block, and performing inter prediction on the current chroma block and the adjacent chroma block by using the piece of motion information for the current chroma block and the adjacent chroma block to generate prediction blocks of the current chroma block and the adjacent chroma block.

Abstract: Methods, apparatus, systems for video processing, including video encoding or video decoding are described. One example method includes performing a conversion between a video including a video picture that includes a video slice and a bitstream of the video. The bitstream conforms to a format rule specifying that a slice type of the video slice determines a manner by which certain information from a picture header for the video picture is inherited by a slice header of the video slice.

Abstract: A system and method for processing a video stream are provided. When coding or decoding a video stream a de-blocking filtering may be applied for reducing discontinuities caused by use of a block-based video coding. The de-blocking filtering is performed using a filter grid. The size of the filter grid is chosen adaptively based on the processing parameters. The adaptive size of the filtering grid is determined based on the number of samples used and modified in de-blocking filtering of an edge of a coding block. The filtering grid may be used both for vertical and horizontal edge filtering.

Abstract: An example method of decoding video data that includes receiving one or more syntax elements of the video data indicative of whether a first type of coding scheme or a second type of coding scheme is applied to residual values of a block of video data coded with transform skip, wherein the residual values are indicative of a difference between the block and a prediction block, and wherein, in transform skip, the residual values are not transformed from a sample domain to a frequency domain. The method includes determining a type of coding scheme to apply to the residual values based on the one or more syntax elements, determining the residual values based on the determined type of coding scheme, and reconstructing the block based on the determined residual values and the prediction block.

Abstract: Methods and systems for improving coding decoding efficiency of video by providing a syntax modeler, a buffer, and a decoder. The syntax modeler may associate a first sequence of symbols with syntax elements. The buffer may store tables, each represented by a symbol in the first sequence, and each used to associate a respective symbol in a second sequence of symbols with encoded data. The decoder decodes the data into a bitstream using the second sequence retrieved from a table.

Abstract: The present disclosure provides a computer-implemented method for encoding video. The method includes: receiving a video frame for processing; generating one or more coding units of the video frame; and processing one or more coding units using one or more palette predictors having palette entries, wherein each palette entry of the one or more palette predictors has a corresponding reuse flag, and wherein a number of reuse flags for each palette predictor is set to a fixed number for a corresponding coding unit.

Abstract: This disclosure relates to video coding and more particularly to techniques for performing motion vector prediction. According to an aspect of an invention, a motion vector and a corresponding reference picture identifier for the motion vector are received; a reference picture corresponding to a second motion vector is determined based on the reference picture corresponding to the received motion vector and a current picture; a scaling value is determined based on the determined reference picture, the reference picture corresponding to the received motion vector, and the current picture; and the second motion vector is generated from the received motion vector by scaling with the scaling value.

Abstract: A decoding method and apparatus are provided. A first candidate having a first motion vector that has been used to decode a first block, a first prediction direction that corresponds to the first motion vector, and a first reference picture index that identifies a first reference picture is derived. A second candidate having a second motion vector that has been used to decode a second block, a second prediction direction that corresponds to the second motion vector, and a second reference picture index that identifies a second reference picture is derived. When a total number of candidates is less than a maximum number, a third candidate is derived by combining the first motion vector and the first reference picture index for the first prediction direction of the first candidate and the second motion vector and the second reference picture index for the second prediction direction of the second candidate.

Abstract: A picture coding device includes: a block vector candidate derivation unit that derives block vector candidates of a target block in a target picture from coding information stored in coding information storage memory; a selector that selects a selected block vector from the block vector candidates; and a reference position correction unit that performs a correction regarding a reference block to be referred to by the selected block vector so that a reference position of the reference block is to be corrected to refer to an inside of a referenceable region, in which a decoded sample in the target picture is acquired from decoded picture memory as a prediction value of the target block based on the reference position of the reference block.

Abstract: A differential video rendering system, including a graphics processing unit (GPU); a graphical display coupled to the GPU; a video decoder configured to decode a bitstream of encoded data into a plurality of sets of decoded blocks; at least one processor configured to: generate, based on a first set of the plurality of sets of decoded blocks, a first differential video frame comprising a plurality of sets of differential regions, normalize each set of the plurality of sets of differential regions to a fixed size block to provide a normalized plurality of sets of differential regions, map a respective set of the normalized plurality of sets of differential regions to align with a respective tile size region of a plurality of tile size regions conforming with the GPU, generate a hierarchal region tree based on the normalized plurality of sets of differential regions mapped to the plurality of tile size regions, and generate a plurality of optimal regions based on the hierarchal region tree satisfying a predefin

Abstract: A method for decoding a current block in a current picture of a video bitstream includes decoding, from the video bitstream, a first motion vector for the current block relative to a first reference block of a first reference picture having a first picture order count, and decoding, from the video bitstream, a second motion vector for the current block relative to a second reference block of a second reference picture having a second picture order count. A similarity metric is generated based on a comparison of the first motion vector and the second motion vector. The method further includes determining whether to refine the first motion vector based on the similarity metric, generating a first refined motion vector from the first motion vector, and performing motion compensation to derive a first reference block from the first reference picture using the first refined motion vector.

Abstract: The present invention includes obtaining block type identification information on a partition of the current macroblock when the current macroblock is intra-mixed specifying a bock type of the current macroblock based on the block type identification information, obtaining an intra prediction mode of the current macroblock according to the block type of the partition of the current macroblock, and predicting the current macroblock using the intra prediction mode and a pixel value of a neighboring block.

Abstract: Systems, methods and apparatus for video processing are described. The video processing may include video encoding, video decoding, or video transcoding. One example method of video processing includes performing a conversion between a video and a bitstream of the video according to a format rule. The format rule specifies that a first field at a sequence level or a picture level or a slice level controls a value of a second field in an adaptation parameter set.

Abstract: A technique iteratively fits a rasterization distortion function to a distortion property of a display such as a head-mounted display (HMD). The technique also features reconstructing a distortion function from a rendered image with unknown distortion property.

Abstract: A method of performing motion vector prediction for a current block in a picture is provided which includes: deriving a candidate for a motion vector predictor to code a current motion vector of the current block, from a first motion vector of a first block that is spatially adjacent or temporally adjacent to the current block; adding the derived candidate to a list of candidates; and deriving at least one motion vector predictor based on a selected candidate from the list of candidates, wherein the deriving of the candidate includes determining whether to derive the candidate from the first motion vector, based on a type of a current reference picture and a type of a first reference picture, the current reference picture being referred to from the current block using the current motion vector, the first reference picture being referred to from the first block using the first motion vector.

Abstract: A method for inter prediction of a block of a picture and corresponding apparatus are provided. The method comprises: determining a first prediction block based on an initial first motion vector of a current block in a first reference picture, so as to obtain a first extension block; obtaining from the first reference picture, one or more first reference blocks each of which is associated with a combination of the initial first motion vector and one of motion vector offsets; obtaining a target motion vector offset with a smallest cost among the motion vector offsets; determining for the current block, a refined first motion vector which is a combination of the initial first motion vector and the target motion vector offset; and obtaining a refined prediction block of the current block based on the refined first motion vector, thereby improving coherence of refined motion vectors to achieve higher coding efficiencies.