Abstract: An information processing device includes: a displacement information acquisition unit that acquires displacement information corresponding to 3-dimensional displacement of a predetermined portion of an object that a user mounts in accordance with a body motion on the basis of positional information of the predetermined portion and an output control unit that performs control such that an output unit performs a predetermined output on the basis of the acquired displacement information. The object has, for example, a seatback on which a user can sit. The displacement information acquisition unit acquires a change in a position in at least one of front and rear directions, right and left directions, or upward and downward directions of a seatback.

Abstract: A superstereoscopic display with enhanced off-angle separation includes a first light source; a lenticular lens optically coupled to the first light source that, with the first light source, generates a first light output having viewing angle dependency; and a high-index optical volume optically coupled to the lenticular lens.

Abstract: Light from an array of laser light sources are spread to cover the modulating face of a DMD or other modulator. The spread may be performed, for example, by a varying curvature array of lenslets, each laser light directed at one of the lenslets. Light from neighboring and/or nearby light sources overlap at a modulator. The lasers are energized at different energy/brightness levels causing the light illuminating the modulator to itself be modulated (locally dimmed). The modulator then further modulates the locally dimmed lights to produce a desired image. A projector according to the invention may utilize, for example, a single modulator sequentially illuminated or separate primary color modulators simultaneously illuminated.

Abstract: Example implementations include a method, apparatus and computer-readable medium of video coding, comprising receiving the code block and one or more neighbor samples and determining the value of beta based on at least one of an average chroma value, a midrange chroma value, a median chroma value, an average luma value, a midrange luma value, or a median luma value of two or more neighbor samples.

Abstract: The present invention provides a method and apparatus for encoding/decoding an image to enhance inter prediction. According to the present invention, the method includes: determining a first reference picture and a second reference picture of a current block; determining both a first reference block in the first reference picture and a second reference block in the second reference picture; partitioning the current block into a plurality of sub blocks; and obtaining a prediction block of each of the sub blocks on the basis of reference candidate block index information of each of the sub blocks.

Abstract: A method for video processing is described. The method comprises: making a decision, for a conversion between a current video block of a video picture of a video and a coded representation of the video, regarding a size of a reference region of the video picture from which reference samples are used for predicting the current video block, based on a size of a virtual pipeline data unit (VPDU), a size of a coding tree block (CTB), or a size of a coding tree unit (CTU); and performing the conversion based on the decision.

Abstract: A prediction method, apparatus, and a computer storage medium for decoding, the method includes: acquiring reference samples adjacent to at least one side of a decoding block; determining a reference point from the at least one side and determining reference sample positions to be selected corresponding to the at least one side according to a preset number of samples; selecting reference samples corresponding to the reference sample positions to be selected from the reference samples based on the reference sample positions to be selected; and performing prediction decoding on the decoding block based on the selected reference samples.

Abstract: A prediction method, apparatus, and a computer storage medium for decoding, the method includes: acquiring reference samples adjacent to at least one side of a decoding block; determining a reference point from the at least one side and determining reference sample positions to be selected corresponding to the at least one side according to a preset number of samples; selecting reference samples corresponding to the reference sample positions to be selected from the reference samples based on the reference sample positions to be selected; and performing prediction decoding on the decoding block based on the selected reference samples.

Abstract: An example method of video processing includes determining, for a conversion between a current block of a current picture of a video and a bitstream of the video, whether to disable a coding tool for the current block; and performing the conversion based on the determining, wherein the coding tool is disabled when a dimension of a reference picture of one or more reference pictures of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture of one or more reference pictures of the current block is different from a dimension of a scaling window in the current picture.

Abstract: An image decoding method performed by a decoding device according to the present document comprises: a step for deriving the number of samples of upper peripheral chroma samples and left peripheral chroma samples of a current chroma block on the basis of a specific value and the width and height of the current chroma block; a step for deriving said number of upper peripheral chroma samples and said number of left peripheral chroma samples; and a step for deriving CCLM parameters on the basis of the upper peripheral chroma samples, the left peripheral chroma samples, and down-sampled peripheral luma samples, wherein, when the specific value is derived as 2 and the width and the height of the current chroma block are larger than the specific value, the number of samples is derived as the specific value.

Abstract: Image decoding of decoding a sequence of coded pictures on a block-by-block basis is provided. The image decoding incudes decoding a first high-level syntax element from a bitstream to determine, at a sequence level, whether affine motion prediction is allowed. A second high-level syntax element is extracted for each of at least one coding tool from the bitstream depending on the first high-level syntax element. At a picture level, the method determines whether each of the at least one coding tool is allowed. The coding tool includes sample-by-sample adjustment of affine motion prediction samples.

Abstract: Image decoding of decoding a sequence of coded pictures on a block-by-block basis is provided. The image decoding incudes decoding a first high-level syntax element from a bitstream to determine, at a sequence level, whether affine motion prediction is allowed. A second high-level syntax element is extracted for each of at least one coding tool from the bitstream depending on the first high-level syntax element. At a picture level, the method determines whether each of the at least one coding tool is allowed. The coding tool includes sample-by-sample adjustment of affine motion prediction samples.

Abstract: Image decoding of decoding a sequence of coded pictures on a block-by-block basis is provided. The image decoding incudes decoding a first high-level syntax element from a bitstream to determine, at a sequence level, whether affine motion prediction is allowed. A second high-level syntax element is extracted for each of at least one coding tool from the bitstream depending on the first high-level syntax element. At a picture level, the method determines whether each of the at least one coding tool is allowed. The coding tool includes sample-by-sample adjustment of affine motion prediction samples.

Abstract: An example system may include a primary mode decision module, included in a hardware video encoding pipeline, that (1) receives video data for encoding in accordance with a video encoding standard, and (2) identifies, from an initial set of prediction modes supported by the video encoding standard, a primary set of prediction modes for encoding the video data in accordance with the video encoding standard. The example system may also include a secondary mode decision module that (1) determines, for each prediction mode included in the primary set of prediction modes and based on the video data, a cost associated with the prediction mode, and (2) selects, from the primary set of prediction modes and based on the determined costs associated with the prediction modes included in the primary set of prediction modes, a prediction mode for encoding of the video data by the hardware video encoding pipeline.

Abstract: Video codec for supporting temporal inter-prediction, configured to perform padding of an area of a referenced portion of a reference picture which extends beyond a border of the reference picture, which referenced portion is referenced by an inter predicted block of a current picture by selecting one of a plurality of intra-prediction modes, and padding the area using the selected intra-prediction mode.

Abstract: An apparatus for decoding video data includes a decoder configured to decode, from a bitstream, a syntax element indicating an intra-prediction type of a current block of the video data, and an intra-predictor configured to generate a prediction block for the current block by selectively performing matrix based intra-prediction (MIP) or regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element.

Abstract: A method of decoding video data including decoding, from a video bitstream for which adaptive loop filtering is enabled for luma blocks of one or more of a picture, a slice, a tile, or a tile group, a first syntax element indicating a number of adaptive parameter sets for the luma blocks, decoding a plurality of first adaptive parameter set indices for the luma blocks based on the number of adaptive parameter sets for the luma blocks, and decoding, from the video bitstream for which adaptive loop filtering is enabled for chroma blocks of the one or more of the picture, the slice, the tile, or the tile group, a second adaptive parameter set index for the chroma blocks.

Abstract: An example method of video processing includes determining, for a conversion between a current video unit of a video and a bitstream representation of the video, availability of one or more samples in a first neighboring region of the current block for a coding process of the conversion independently from information of a second neighboring region of the current block. The second neighboring region is adjacent to the first neighboring region, and the one or more samples are padded in case determined to be unavailable. The method includes performing the conversion based on the determining.

Abstract: A method of decoding video data includes determining that a current block of the video data is coded in palette mode, determining, between single tree or dual tree partitioning, that the current block is coded with single tree partitioning enabled, determining that the current block is coded in monochrome format, when the current block is coded with single tree partitioning enabled and when the current block is coded in monochrome format, determining that a number of color components used for palette mode decoding the current block is equal to one, and palette mode decoding the current block based on the determined number of color components used for palette mode decoding the current block being equal to one.

Abstract: Systems and methods for coding and decoding of a coded bitstream is provided. A method comprises decoding a block of a picture from a coded bitstream. The decoding includes selecting a transform set based on at least one neighboring reconstructed sample from one or more previously decoded neighboring blocks or from a previously decoded picture and inverse transforming coefficients of the block using a transform from the transform set.

Abstract: Computer processor hardware receives image data specifying element settings for each image of multiple original images in a sequence. The computer processor hardware analyzes the element settings across the multiple original images. The computer processor hardware then utilizes the element settings of the multiple original images in the sequence to produce first encoded image data specifying a set of common image element settings, the set of common image element settings being a baseline to substantially reproduce each of the original images in the sequence.

Abstract: Various embodiments provide an encoder that performs an up-conversion and a down-conversion on a first quantization matrix to generate a second quantization matrix, and quantizes transform coefficients of a current block using the second quantization matrix. The first quantization matrix has a first number of rows and a first number of columns equal to the first number of rows, and the second quantization matrix has a second number of rows and a second number of columns different from the second number of rows. In the up-conversion, the circuitry generates the second quantization matrix such that one of the second number of rows or the second number of columns is larger than the first number of rows. In the down-conversion, the circuitry generates the second quantization matrix such that the other of the second number of rows or the second number of columns is smaller than the first number of rows.

Abstract: The present invention includes: a CCLM prediction derivation portion, for deriving a first parameter and a second parameter by using a sampled luminance value downsampled according to a chrominance format and an intra-frame prediction mode; and a CCLM prediction filter portion, for deriving a prediction image by using the first parameter and the second parameter, wherein the CCLM prediction derivation portion derives the first parameter by deriving a logarithmic value of a luminance difference value, deriving a first value by right-shifting a second value related to the luminance difference value by the logarithmic value, and using a third value acquired by multiplying a fourth value by a chrominance difference value and derives the second parameter by using the first parameter. The fourth value is determined from a reference table by using the first value.

Abstract: A method for performing video decoding by a decoding device according to the present document comprises the steps of: acquiring residual information of a current block; deriving residual samples of the current block on the basis of the residual information; and generating a reconstructed picture on the basis of the residual samples.

Abstract: A motion vector prediction method includes parsing a bitstream to obtain an index value of a candidate motion vector list and constructing the candidate motion vector list that includes. candidate motion vectors of K control points of a current block. The candidate motion vectors of K control points are obtained based on a 2N-parameter affine transform model used for a neighboring block of the current block, where N and K are integers greater than or equal to 2 and less than or equal to 4 with N not being equal to K. The method further includes determining, in the candidate motion vector list, target candidate motion vectors of the K control points based on the index value and obtaining a predicted motion vector of each subblock of the current block based on the target candidate motion vectors of the K control points.

Abstract: A video image encoding device includes: an image encoding unit that performs predictive encoding by obtaining a difference between a divided image included in a frame as a target of predictive encoding and a prediction image; local decode generation unit that decodes an encoding result of the divided image by the image encoding unit to generate a reference image; a first buffer that stores pixel data generated by the local decode generation unit; a compression unit that refers to the first buffer to compress the reference image and generates compressed data; an allowable data amount setting unit that presets an allowable data amount to be stored in the memory for each predetermined area of the frame as the target of the predictive encoding; and a reference image storage determination unit that determines whether the compressed data is store in the memory based on the allowable data amount, and stores the compressed data in the memory based on a determination result of storing the compressed data in the memory

Abstract: A disclosed system may include a hardware distortion data pipeline that may include (1) a quantization module that generates a quantized data set, (2) an inverse quantization module that generates, from the quantized data set, an inverse quantized data set by executing an inverse quantization of the quantized data set, and (3) an inverse transformation module that generates an inversely transformed data set by executing an inverse transformation of the inverse quantized data set. The system may also include a hardware determination pipeline that determines a distortion metric based on the inversely transformed data set and the residual frame data set, and a hardware token rate pipeline that determines, based on the quantized data set, a token rate for an encoding of the residual frame data set via a video encoding pipeline. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A method for video processing is provided. The method includes determining, for a conversion between a current video block of a video that is a chroma block and a coded representation of the video, multiple sets of parameters, wherein each set of parameters defines a cross-component linear model (CCLM) and is derived from a corresponding group of chroma samples at corresponding chroma sample positions; determining, based on the multiple sets of parameters, parameters for a final CCLM; and performing the conversion based on the final CCLM.

Abstract: Methods, systems, and devices for high-precision transform and quantization for image and video coding are described. A example method of video processing includes determining, for a conversion between a video comprising a current block and a bitstream representation of the video, that the conversion comprises an application of a transform to the current block, and performing, based on the determining, the conversion, wherein a bit-shifting operation of a scaling process for transform coefficients associated with the transform is based on whether the current block is coded with a block-based differential pulse code modulation (BDPCM) mode.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry can decode first prediction information of a current region in a current picture and second prediction information of a current block in the current region from a coded video bitstream. The second prediction information indicates that a prediction mode for reconstructing the current block is one of: an inter prediction mode and an intra block copy (IBC) mode. The processing circuitry can determine a first set of default vectors for the current region based on the first prediction information. The processing circuitry can add a vector from the first set of default vectors to a candidate list for the current block and reconstruct at least one sample in the current block based on the updated candidate list.

Abstract: The present invention relates to an image encoding and decoding technique, and more particularly, to an image encoder and decoder using unidirectional prediction. The image encoder includes a dividing unit to divide a macro block into a plurality of sub-blocks, a unidirectional application determining unit to determine whether an identical prediction mode is applied to each of the plurality of sub-blocks, and a prediction mode determining unit to determine a prediction mode with respect to each of the plurality of sub-blocks based on a determined result of the unidirectional application determining unit.

Abstract: Devices, systems and methods for video processing are described. An example method for video processing includes performing a conversion between a video comprising luma blocks and corresponding chroma blocks and a bitstream representation of the video according to a rule that specifies that, for a case that a current luma block is coded using a palette coding mode and a corresponding current chroma block coded with a derived mode, the current luma block is treated as having a default intra prediction mode and the current chroma block is coded with the default intra prediction mode.

Abstract: An apparatus includes processing circuitry, which determines a block vector that points to a reference block in a same picture as a current block in an intra block copy mode. The current block is one of a plurality of coding blocks in a coding tree block (CTB) with a right to left coding order being allowed within the CTB. The processing circuitry checks that two corner samples of the reference block have been reconstructed based on first outputs from a derivation process for block availability. The processing circuitry checks that a non corner sample of the reference block has been reconstructed based on a second output from the derivation process. The processing circuitry encodes the current block based on reconstructed samples of the reference block after a determination that the two corner samples of the reference block and the non corner sample of the reference block have been reconstructed.

Abstract: A decoding method is disclosed. The decoding method comprises: determining an index from a bitstream, the index identifying a coding element in a set of a plurality of coding elements; decoding a picture block from the bitstream using the coding element of the set identified by the index. In a specific embodiment, determining the index comprises: determining, for each coding element in the set, a probability that the coding element was used for encoding the picture block; and determining the index responsive to the determined probabilities.

Abstract: Disclosed are methods, apparatuses, and systems for encoding and decoding an image. The present invention provides an intra prediction unit receives an input image, removes high frequency ingredients by low pass filtering an encoded luma pixel value in the input image during intra prediction, and generates a prediction block by predicting a chroma pixel value by using a low pass filter (LPF) LM chroma mode for applying an LM chroma mode, which is an extended chroma mode technique for generating a prediction block by predicting the chroma pixel value by applying a correlation between color planes to the luma pixel value having removed therefrom the high frequency ingredients.

Abstract: In a conventional art, an output layer set having no output layer is sometimes defined. Consequently, even if the decoder decodes a bit stream to obtain each layer in the output layer set without the output layer, there is no picture to be outputted. There is a possibility that such coded data causes the decoder expecting an output to operate unexpectedly. Output layer sets having the same configuration may be defined. Consequently, the amount of code pertaining to the output layer sets defined in an overlapping manner is redundant. According to an aspect of the present disclosure, a specification of a bit stream conformance pertaining to the output layer set prevents occurrence of an output layer set without an output layer and a redundant output layer set.

Abstract: Techniques for detecting skipped prediction units in an encoder are disclosed. Control information associated with a prediction unit of a video frame is received at a node of a video encoding pipeline used to compress the video frame. A skip decision for the prediction unit is made by analyzing transform units comprising the prediction unit. The skip decision indicates whether or not the prediction unit comprises a skipped prediction unit during encoding. The skip decision for the prediction unit is provided to a downstream node of the video encoding pipeline.

Abstract: There is provided a method and devices for encoding and streaming a video sequence over a plurality of network connections. A video sequence is encoded (S04) in parallel into a number of encoded video sequences having different video properties. The encoded video sequences are then streamed (S06) in parallel over the plurality of network connections. Each encoded video sequence is streamed over at least one of the plurality of network connections, and, for each network connection, an encoded video sequence having video properties that match desired video properties of the network connection. In response to detecting (S08) that the desired video properties of one of the network connections have changed, the number of encoded video sequences is increased or decreased (S10).

Abstract: A method and a device for processing a video signal are disclosed. In particular, a method for decoding a video signal includes parsing a first syntax element indicating a primary transform kernel applied to a primary transform of a current block; determining whether a secondary transform is applicable to the current block based on the first syntax element; if the secondary transform is applicable to the current block, parsing a second syntax element indicating a secondary transform kernel applied to a secondary transform of the current block; deriving a secondary inverse-transformed block, by performing a secondary inverse-transform for a top-left specific region of the current block using a secondary transform kernel indicated by the second syntax element; and deriving a residual block of the current block, by performing a primary inverse-transform for the secondary inverse-transformed block using a primary transform kernel indicated by the first syntax element.

Abstract: Systems and methods for encoding a video stream are provided. A method includes signaling partitioning information in a coded bitstream that is based on a point cloud. The coded bitstream may be a coded video stream that includes a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same three-dimensional (3D) representation; frame partition information that indicates the frame is partitioned into a plurality of sub-frames, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures; and 3D bounding box information that specifies a 3D position corresponding to a sub-frame of the plurality of sub-frames.

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that decodes prediction information of a current block in a current picture that is a part of a video bitstream. The processing circuitry determines that a first plurality of coding tools is enabled and a second plurality of coding tools is disabled for the current block based on a syntax element included in the video bitstream. The first plurality of coding tools includes a deblocking filter. The second plurality of coding tools includes at least one of a sample adaptive offset filter, an intra sub-partitioning, and a matrix based intra prediction. The processing circuitry reconstructs the current block based on the first plurality of coding tools being enabled and the second plurality of coding tools being disabled.

Abstract: A method of video decoding at a video decoder can include receiving one or more syntax elements associated with a current first block that belongs to a plurality of first blocks partitioned from a picture, the one or more syntax elements indicating an optimal partition indicating how the current first block is partitioned into second blocks for intra-prediction, a set of block selection signals, wherein the current first block is re-partitioned into third blocks, each block selection signal corresponds to one of the third blocks and indicates whether the respective third block is coded using a first coding method or a second coding method, and a set of compressed representations each corresponding to one of the third blocks. The current first block can be reconstructed based on the one or more syntax elements to generate a reconstructed current first block.

Abstract: An apparatus for video coding includes processing circuitry that encodes prediction information of a current block in a video bitstream. The prediction information indicates a first set of intra prediction direction mode numbers for the current block. The processing circuitry determines whether a first intra prediction direction mode number of a neighboring block of the current block is in the first set of intra prediction direction mode numbers. In response to the first intra prediction direction mode number not being in the first set of intra prediction direction mode numbers, the processing circuitry determines a most probable mode for the current block based on a second intra prediction direction mode number in the first set of intra prediction direction mode numbers that is nearest to the first intra prediction direction mode number. The processing circuitry encodes the current block based on the most probable mode of the current block.

Abstract: A method of decoding video data may comprise decoding data from an encoded bitstream to generate motion vectors and performing a decoder-side motion vector refinement (DMVR) process on one or more of the motion vectors. Performing the DMVR process may include determining one or more characteristics of current video block being decoded and determining a search area for the DMVR process for the current video block based on the determined one or more characteristics of the current video block.

Abstract: An apparatus is provided and includes processing circuitry that determines a plurality of first sub-block motion vectors for a plurality of sub-blocks of a current block. The processing circuitry determines a plurality of second sub-block motion vectors by respectively constraining the plurality of first sub-block motion vectors according to a first target range. The processing circuitry determines a set of gradient values associated with a current sample location in a current sub-block from the plurality of sub-blocks according to a reference sub-block. The processing circuitry determines a set of adjustment values associated with the current sample location according to the set of gradient values and an adjustment vector associated with the current sample location. Further, the processing circuitry generates a predicted sample associated with the current sample location according to a combination of a corresponding sample in the reference sub-block and the set of adjustment values.

Abstract: This disclosure describes filtering techniques applied by an encoder and a decoder during the prediction stage of a video encoding and/or decoding process. The filtering techniques may enhance the accuracy of predictive data used during fractional interpolation, and may improve predictive data of integer blocks of pixels. There are several aspects to this disclosure, including a useful twelve-pixel filter support that may be used for interpolation, techniques that use coefficient symmetry and pixel symmetry to reduce the amount of data needed to be sent between an encoder and a decoder to configure the filter support for interpolation, and techniques for filtering data at integer pixel locations in a manner that is similar to sub-pixel interpolation. Other aspects of this disclosure concern techniques for encoding information in the bitstream to convey the type of filter used, and possibly the filter coefficients used. Predictive coding of filter coefficients is also described.

Abstract: The present invention relates to the performance of motion vector refinement in a search space for multi-reference inter-prediction. Two or more reference pictures are selected, one of those used for motion vector refinement. Based on an initial estimate of a motion vector to the reference picture for motion vector refinement, a search space in this reference image is constructed. Using template matching, the first motion vector is refined. The second motion vector to another reference picture is calculated using its initial estimate, the initial estimate of the first motion vector and the refined first motion vector.

Abstract: Disclosed herein are representative embodiments of generating representative motion information that can be used during processing of a video frame. In one exemplary embodiment disclosed herein, a reference frame comprising a group of blocks is processed, and motion information for the group of blocks is compressed at least by buffering representative motion-vector information and representative reference-frame index information for the group of blocks. The representative reference-frame index information comprises reference-frame index information of a representative block of the group of blocks, and the representative reference-frame index information represents reference-frame index information for the group of blocks during processing of a current frame.

Abstract: Innovations in adaptive encoding and decoding for units of a video sequence can improve coding efficiency. For example, some of the innovations relate to encoding/decoding that includes adaptive switching of color spaces between units within a video sequence. Other innovations relate encoding/decoding that includes adaptive switching of color sampling rates between units within a video sequence. Still other innovations relate encoding/decoding that includes adaptive switching of bit depths between units within a video sequence.

Abstract: Methods and apparatuses of encoding a video stream encoded using video point cloud coding include obtaining a plurality of frames including a first frame and remaining frames, wherein each frame of the plurality of frames is packed with a corresponding plurality of patches; grouping the remaining frames into a first group and a second group, wherein frames grouped into same group are temporally neighboring; processing the first frame; parallel processing frames in the first group after the first frame is processed; and generating an encoded video stream based on the processed first frame and the processed frames in the first group, wherein at least one frame of the first group depends from the first frame.