Abstract: Aspects of the disclosure provide methods and an apparatus for video decoding. In some embodiments, the apparatus for video decoding includes processing circuitry. The processing circuitry decodes at least one syntax element from a coded video bitstream. The at least one syntax element is indicative of a block size of a non-square block under reconstruction that has a rectangular shape. The block size includes a first size in a first dimension and a second size in a second dimension. The first size is different from the second size. The processing circuitry predicts a sample of the non-square block based on a first set of intra prediction directions for the non-square block. The first set of intra prediction directions does not include at least one of a second set of intra prediction directions for a square block.

Abstract: Methods and apparatus are provided for determining quantization parameter predictors from a plurality of neighboring quantization parameters. An apparatus includes an encoder for encoding image data for at least a portion of a picture using a quantization parameter predictor for a current quantization parameter to be applied to the image data. The quantization parameter predictor is determined using multiple quantization parameters from previously coded neighboring portions. A difference between the current quantization parameter and the quantization parameter predictor is encoded for signaling to a corresponding decoder.

Abstract: A method of adaptive chroma downsampling is presented. The method comprises converting a source image to a converted image in an output color format, applying a plurality of downsample filters to the converted image and estimating a distortion for each filter chose the filter that produces the minimum distortion. The distortion estimation includes applying an upsample filter, and a pixel is output based on the chosen filter. Methods for closed loop conversions are also presented.

Abstract: An encoder may perform a dynamic encoding that adapts the encoding of hyperspectral data according to the number of bands of the electromagnetic spectrum that are captured by different imaging devices, the amount of data that is contained in each band, and/or encoding criteria that are specified by a user or that are automatically generated by the encoder for an optimal encoding of the hyperspectral data. The encoder may receive hyperspectral data for different electromagnetic spectrum bands. The encoder may determine an encoding resolution based on one or more of a number of bands and a maximum resolution within the received bands. The encoder may configure a block size for a file format that is used to store an encoding of the hyperspectral data based on the encoding resolution, and may encode the hyperspectral data contained within each band to at least one block of the block size.

Abstract: Provided is an image decoding method including determining a predicted quantization parameter of a current quantization group determined according to at least one of block split information and block size information, determining a difference quantization parameter of the current quantization group, determining a quantization parameter of the current quantization group, based on the predicted quantization parameter and the difference quantization parameter of the current quantization group, and inverse quantizing a current block included in the current quantization group, according to the quantization parameter of the current quantization group.

Abstract: Provided is an image decoding method including determining a predicted quantization parameter of a current quantization group determined according to at least one of block split information and block size information, determining a difference quantization parameter of the current quantization group, determining a quantization parameter of the current quantization group, based on the predicted quantization parameter and the difference quantization parameter of the current quantization group, and inverse quantizing a current block included in the current quantization group, according to the quantization parameter of the current quantization group.

Abstract: Provided is an image decoding method including determining a predicted quantization parameter of a current quantization group determined according to at least one of block split information and block size information, determining a difference quantization parameter of the current quantization group, determining a quantization parameter of the current quantization group, based on the predicted quantization parameter and the difference quantization parameter of the current quantization group, and inverse quantizing a current block included in the current quantization group, according to the quantization parameter of the current quantization group.

Abstract: Provided is an image decoding method including determining a predicted quantization parameter of a current quantization group determined according to at least one of block split information and block size information, determining a difference quantization parameter of the current quantization group, determining a quantization parameter of the current quantization group, based on the predicted quantization parameter and the difference quantization parameter of the current quantization group, and inverse quantizing a current block included in the current quantization group, according to the quantization parameter of the current quantization group.

Abstract: A de-blocking filter includes a reconstructed memory that is configured to store reconstructed pixels corresponding to a current macroblock of a video image to be filtered. The current macroblock includes a set of sub-blocks, each sub-block having horizontal edges and vertical edges. An internal pixel buffer in the de-blocking filter is configured to store pixels corresponding to the set of sub-blocks from the reconstructed memory, and to store partially filtered pixels corresponding to a set of partially filtered macroblocks. An edge order controller in the de-blocking filter is configured to load the pixels corresponding to the set of sub-blocks into a filter engine from the internal pixel buffer, to filter the set of sub-blocks, such that, at least one horizontal edge is filtered before filtering all vertical edges of the set of sub-blocks.

Abstract: An image decoding method includes obtaining, from a bitstream, first information indicating a motion vector resolution of a current unit among plural motion vector resolutions including a first motion vector resolution and a second motion vector resolution, and obtaining, from the bitstream, second information indicating whether a merge mode is applied to the current unit or not when the first information indicates the first motion vector resolution. The current unit is decoded based on the merge mode when the second information indicates that the merge mode is applied to the current unit. When the first information indicates the second motion vector resolution, the second information is not obtained from the bitstream.

Abstract: An image decoding method includes obtaining, from a bitstream, first information indicating a motion vector resolution of a current unit among plural motion vector resolutions including a first motion vector resolution and a second motion vector resolution, and obtaining, from the bitstream, second information indicating whether a merge mode is applied to the current unit or not when the first information indicates the first motion vector resolution. The current unit is decoded based on the merge mode when the second information indicates that the merge mode is applied to the current unit. When the first information indicates the second motion vector resolution, the second information is not obtained from the bitstream. A picture is split into one or more largest coding units, and a largest coding unit among the one or more largest coding units is split into one or more coding units including the current unit.

Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining video data, obtaining a coding unit (CU) block, determining whether a flag of the CU block is set to a predetermined flag condition, determining whether a tree type of the CU block is set to a predetermined tree type, determining whether to signal an adaptive color transform (ACT) flag based on any of whether the flag of the CU block is set to the predetermined flag condition and whether the tree type of the CU block is set to the predetermined tree type, and coding the video data based on a whether the ACT flag is signaled.

Abstract: The present disclosure provides a method and an apparatus for coding a video, a device and a medium. An estimated quantization parameter of a target picture in a target GOP is determined. An inter-picture change degree of the target GOP is determined. A propagation ratio of a target picture block to a reference picture block in the target picture is determined based on the estimated quantization parameter of the target picture and the inter-picture change degree. The video is coded based on the propagation ratio.

Abstract: Aspects of the disclosure provide method and apparatus for video coding. In some examples, an apparatus includes receiving circuitry and processing circuitry. The processing circuitry decodes, from a coded video bitstream, a syntax element for an adjusted version of an initial quantization parameter (QP) value at a picture level for a picture. The adjusted version is in a range with an upper boundary that is changed with a maximum QP value. Then, the processing circuitry determines the initial QP value of a segment (such as a slice, a tile, a group of tiles and the like) in the picture based on the syntax element and determines a QP value for a block in the segment according to the initial QP value of the segment and adjustments associated with the block. Then, the processing circuitry performs an inverse quantization on quantized data of the block according to the determined QP value.

Abstract: An example disclosed system may include a hardware video encoding pipeline (HVEP), the HVEP that includes a prediction module that generates, using a primary prediction mode, a primary encode of a portion of a video stream, and using a secondary prediction mode, a secondary encode of the portion of the video stream. The HVEP may also include (1) a rate-distortion optimization (RDO) module that determines a primary cost associated with the primary encode and a secondary cost associated with the secondary encode, (2) a quality metric (QM) module that determines a primary QM associated with the primary encode and a secondary QM associated with the secondary encode, and (3) a decision module that selects, for an encoding of the video stream, at least one of the primary prediction mode and the secondary prediction mode based on the primary cost, the secondary cost, the primary QM, and the secondary QM.

Abstract: A method for encoding a multi-view frame in a video encoder is provided that includes computing a depth quality sensitivity measure for a multi-view coding block in the multi-view frame, computing a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block, wherein the depth-based perceptual quantization scale is based on the depth quality sensitive measure and a base quantization scale for the 2D frame including the 2D coding block, and encoding the 2D coding block using the depth-based perceptual quantization scale.

Abstract: A method for decoding an image according to the present document includes obtaining prediction mode information and residual related information from a bitstream, deriving prediction samples of a current block by performing prediction based on the prediction mode information, deriving residual samples of the current block based on the residual related information, and generating reconstruction samples of the current block based on the prediction samples and the residual samples, and the residual related information includes a transform skip flag based on a size of the current block and a maximum transform skip size, the transform skip flag represents whether a transform skip is applied to the current block, and information about the maximum transform skip size is obtained from the bitstream.

Abstract: The present disclosure relates to an image processing device and method that allow reduction in coding efficiency to be suppressed. A pixel value of a chroma component is predicted by linear prediction from a pixel value of a reference image of a luma component whose pixel location is changed by using a filter, and a prediction image of the chroma component is generated. A chroma component of encoded data in which an image is encoded is decoded by using the generated prediction image. The filter is selected on a basis of information regarding a pixel location of the chroma component and information regarding a color format. The present disclosure is applicable, for example, to an image processing device, an image encoding device, an image decoding device, or the like.

Abstract: A method for inverse quantization of a current block of a picture is provided. The method is performed by a decoder, and the picture comprises a luminance component and a chrominance component, where the luminance component and the chrominance component are partitioned into multiple blocks. The method includes obtaining one or more existing quantization parameter (QP) values from a received bitstream, wherein the one or more existing QP values are associated with a current block in the chrominance component; determining a QP value for the current block in the chrominance component based on the one or more existing QP values; performing inverse quantization on the current block in the chrominance component using the determined QP value.

Abstract: A hybrid apparatus for coding a video stream includes a first encoder. The first encoder includes a neural network having at least one hidden layer, and the neural network receives source data from the video stream at a first hidden layer of the at least one hidden layer, receives side information correlated with the source data at the first hidden layer, and generates guided information using the source data and the side information. The first encoder outputs the guided information and the side information for a decoder to reconstruct the source data.

Abstract: Some embodiments provide a method of decoding a current video block in a video picture. From several partitioning schemes, the method identifies a partitioning scheme that is used to partition the current video block. Based on the identified partitioning scheme, the method selects one derivation to compute a first quantization parameter for the current video block from several candidate derivations for computing the first quantization parameter. The method computes a second quantization parameter for the current video block based at least in part on the computed first quantization parameter. The method then uses the computed second quantization parameter to decode the current video block.

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry decoding prediction information of a current block, which indicates a plurality of combinations of processed reconstructed samples and corresponding output values of a filter process. The processing circuitry performs the filter process on processed reconstructed samples of a first color component of the current block. The processed reconstructed samples of the first color are not included in the plurality of combinations of the processed reconstructed samples. The processing circuitry determines an output value of the filter process based on one of a default value, a predicted output value, and one of the output values indicated in the prediction information.

Abstract: A video processing method is provided, including: performing a conversion between a coded representation of a video including one or more video regions and the video, wherein the coded representation includes reshaping model information applicable for in-loop reshaping (ILR) of some of the one or more video regions, wherein the reshaping model information provides information for a reconstruction of a video unit of a video region based on a representation in a first domain and a second domain and/or scaling chroma residue of a chroma video unit, wherein the reshaping model information includes a parameter set that includes a first syntax element that derives a number of bits used to represent a second syntax element specifying an absolute delta codeword value from a corresponding bin, and wherein the first syntax element has a value smaller than a threshold.

Abstract: The present disclosure, in a method of decoding a video signal, provides a method including checking whether a transform skip is applied to a current block; acquiring a transform index indicating transform types applied to a horizontal direction and a vertical direction of the current block from among a plurality of predefined transform types from the video signal when the transform skip is not applied to the current block; and performing an inverse primary transform on the current block using the transform types indicated by the transform index, wherein the transform types applied to the horizontal direction and the vertical direction of the current block are determined from among transform types defined according to an intra prediction mode of the current block based on the transform index.

Abstract: An encoder includes circuitry and memory coupled to the circuitry. In operation, the circuitry: performs quantization on a plurality of transform coefficients of a current block to be encoded, using a quantization matrix when orthogonal transform is performed on the current block and secondary transform is not performed on the current block; and performs quantization on the plurality of transform coefficients of the current block without using the quantization matrix when orthogonal transform is not performed on the current block and when both orthogonal transform and secondary transform are performed on the current block.

Abstract: Method and system for extracting metadata from an observed scene comprising the use of high-speed image sensor array observing the scene through a field-of-view, filtering, matching of interesting information defined as activity/incident in the observed scene with a predefined-library, adapting the filtering to enhance frequencies of interest and suppress all others, and extracting metadata of interest.

Abstract: An information processing device that executes calculation of a neural network, includes a memory; and a processor coupled to the memory and the processor configured to: set a division position for quantization of a variable to be used for the calculation so that a quantization error based on a difference between the variable before the quantization and the variable after the quantization is reduced; and quantize the variable based on the division position set.

Abstract: This present disclosure describes a system and methods for encoding optimization in streaming multimedia. At least one method includes training an optimization engine to discover the optimal encoding settings for a specific type of content; a user playing video games or content on a computer, using streaming software to combine all or part of their computer session with their local camera feed, the streaming software retrieving a graphical overlay for insertion into the video, the streaming software encoding the video using encoder settings optimized to the video game or content being played, and the streaming software publishing the encoded video to one or more streaming services for viewers to consume.

Abstract: Devices, systems and methods for digital video coding, which includes reference picture resampling, are described. An example method for video processing includes performing a conversion between a video comprising one or more video segments comprising one or more video units and a bitstream representation of the video, wherein the bitstream representation conforms to a format rule and comprises information related to an adaptive resolution conversion (ARC) process, wherein the format rule specifies the applicability of the ARC process to a video segment, wherein an indication that the one or more video units of the video segment are coded with different resolutions is included in the bitstream representation in a syntax structure that is different from a header syntax structure, a decoder parameter set, a video parameter set, a picture parameter set, a sequence parameter set, and an adaptation parameter set.

Abstract: A video encoding method, performed by a computer device, includes: obtaining a reference frame corresponding to a current frame from a video input to be encoded; determining a sampling manner corresponding to the current frame; sampling the reference frame based on the sampling manner according to resolution information of the current frame, to obtain a target reference frame corresponding to the reference frame; and encoding the current frame according to the target reference frame.

Abstract: Techniques are disclosed relating to compression of pixel data using different quantization for different regions of a block of pixels being compressed. In some embodiments, compression circuitry is configured to determine, for multiple components included in pixels of the block of pixels being compressed, respective smallest and greatest component values in respective regions of the block of pixels. The compression circuitry may determine, based on the determined smallest and greatest component values, to use a first number of bits to represent delta values relative to a base value for a first component in a first region and a second, different number of bits to represent delta values relative to a base value for a second component in the first region. The compression circuitry may then quantize delta values for the first and second components of pixels in the first region of the block of pixels using the determined first and second numbers of bits.

Abstract: A method of signaling additional chroma QP offset values that are specific to quantization groups is provided, in which each quantization group explicitly specifies its own set of chroma QP offset values. Alternatively, a table of possible sets of chroma QP offset values is specified in the header area of the picture, and each quantization group uses an index to select an entry from the table for determining its own set of chroma QP offset values. The quantization group specific chroma QP offset values are then used to determine the chroma QP values for blocks within the quantization group in addition to chroma QP offset values already specified for higher levels of the video coding hierarchy.

Abstract: A video decoding device and method, including extracting PCM block size information including a threshold, from a bitstream, determining the threshold based on the extracted PCM block size information; parsing a PCM header from the bitstream with respect to an encoded block, only when said encoded block is prediction mode of intra prediction and a block size of said encoded block is equal to or greater than the determined threshold, controlling an entropy decoding process and a PCM decoding process based on the parsed PCM header; parsing transformed data of a prediction error data of an image in the bitstream; and PCM-decoding PCM data of the image in the bitstream, wherein the decoding performs the decoding operation based on the prediction mode being intra prediction and based on the block size of the encoded block being equal to or greater than the determined threshold.

Abstract: A video signal processing method and device for encoding or decoding a video signal may perform operations of determining whether a coding tree block is divided into a plurality of blocks; determining whether an upper boundary of a current block is adjacent to an upper boundary of the coding tree block, determining a first intra prediction mode for prediction of the current block based on whether the upper boundary of the current block is adjacent to the upper boundary of the coding tree block, reconstructing the current block based on the first intra prediction mode.

Abstract: Disclosed are a method of encoding a division block in video encoding and a method of decoding a division block in video decoding. An input picture is divided into encoding unit blocks. The encoding unit blocks are divided into sub-blocks. The sub-blocks are encoded by selectively using at least one of intra prediction encoding and inter prediction encoding. A decoding process is performed through a reverse process of the encoding method. When pixel values of an encoding unit block are encoded in video encoding, the flexibility in selecting an encoding mode is increased and the efficiency of encoding is increased.

Abstract: A video decoding device and method, including extracting PCM block size information including a threshold, from a bitstream, determining the threshold based on the extracted PCM block size information; parsing a PCM header from the bitstream with respect to an encoded block, only when said encoded block is prediction mode of intra prediction and a block size of said encoded block is equal to or greater than the determined threshold, controlling an entropy decoding process and a PCM decoding process based on the parsed PCM header; parsing transformed data of a prediction error data of an image in the bitstream; and PCM-decoding PCM data of the image in the bitstream, wherein the decoding performs the decoding operation based on the prediction mode being intra prediction and based on the block size of the encoded block being equal to or greater than the determined threshold.

Abstract: A system and method for regenerating high dynamic range (HDR) video data from encoded video data, extracts, from the encoded video data, a self-referential metadata structure specifying a video data reshaping transfer function. The video data reshaping transfer function is regenerated using data from the metadata structure and the extracted reshaping transfer function is used to generate the HDR video data by applying decoded video data values to the reshaping transfer function.

Abstract: Provided is a method of decoding an image, the method including: determining at least one coding unit for splitting an image, based on block shape information of a current coding unit; determining at least one transformation unit, based on a shape of the current coding unit included in the at least one coding unit; and decoding the image by performing inverse transformation based on the at least one transformation unit, wherein the block shape information indicates whether the current coding unit is a square shape or a non-square shape. Also, provided is an encoding method corresponding to the decoding method. In addition, provided is an encoding apparatus or decoding apparatus capable of performing the encoding or decoding method.

Abstract: An example device for coding (encoding or decoding) video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine a first number of neighboring blocks to a current block of the video data that are intra-predicted; determine a second number of the neighboring blocks that are inter-predicted; determine a first weight value to be applied to intra-prediction samples of an intra-prediction block for the current block; determine a second weight value to be applied to inter-prediction samples of an inter-prediction block for the current block; generate a prediction block for the current block as a weighted combination of the intra-prediction block to which the first weight value is applied and the inter-prediction block to which the second weight value is applied; and code the current block using the prediction block.

Abstract: An image coding apparatus configured to divide an image into one or more slices each including a plurality of blocks and to code each slice on a block-by-block basis includes a first coding unit configured to code blocks included in a first portion of the slice, and a second coding unit configured to code blocks included in a second portion of the slice, wherein, when the second coding unit codes an initial block in the second portion, the second coding unit codes the initial included in the second portion by referring to a first quantization parameter provided to the slice as an initial value and referred to by the first coding unit when the first coding units codes the initial block in the first portion.

Abstract: A method and apparatus for video coding comprising computer code configured to cause at least one processor to perform obtaining an input video stream, generating a coded video bitstream based on the input video stream using a neural network, the coded video bitstream including a plurality of supplemental enhancement information (SEI) messages and blocks, determining a plurality of pieces of neural network topology information associated with the neural network, and signaling the determined plurality of pieces of neural network topology information in a plurality of syntax elements associated with the coded video bitstream.

Abstract: In an embodiment, a method involves receiving a pixel array, compressing the pixel array by, for each pixel block of multiple pixel blocks: accessing pixel values associated with pixels in the pixel block, determining a range of the pixel values and an endpoint pixel value in the range, determining quantization levels corresponding to different values within the range of the pixel values, selecting a quantization level from the quantization levels for each of the pixel values in the pixel block, and encoding the pixel values in the pixel block using their respective selected quantization levels and the endpoint pixel value.

Abstract: A method and apparatus for encoding/decoding images according to the present invention may configure a prediction mode candidate group on a screen of a target block, determine a reference pixel for a prediction mode on the screen of the target block, perform at least one of filtering and interpolation on the reference pixel, and perform prediction on the screen of the target block on the basis of the prediction mode candidate group on the screen and the reference pixel.

Abstract: A video processing method is provided, including: performing a conversion between a coded representation of a video including one or more video regions and the video, wherein the coded representation includes reshaping model information applicable for in-loop reshaping (ILR) of some of the one or more video regions, wherein the reshaping model information provides information for a reconstruction of a video unit of a video region based on a representation in a first domain and a second domain and/or scaling chroma residue of a chroma video unit, wherein the reshaping model information includes a parameter set that includes a first syntax element that derives a number of bits used to represent a second syntax element specifying an absolute delta codeword value from a corresponding bin, and wherein the first syntax element has a value smaller than a threshold.

Abstract: An image decoding method performed by a decoding device, according to the present document, comprises the steps of: receiving a bitstream including residual information of a current block; deriving a specific number of context-encoding bins for context syntax elements for a current sub-block of the current block; decoding the context syntax elements for the current sub-block included in the residual information on the basis of the specific number; deriving transform coefficients for the current sub-block on the basis of the decoded context syntax elements; deriving residual samples for the current block on the basis of the transform coefficients; and generating a reconstructed picture on the basis of the residual samples.

Abstract: Systems, methods and instrumentalities are disclosed for adaptively selecting an adaptive loop filter (ALF) procedure for a frame based on which temporal layer the frame is in. ALF procedures may vary in computational complexity. One or more frames including the current frame may be in a temporal layer of a coding scheme. The decoder may determine the current frame's temporal layer level within the coding scheme. The decoder may select an ALF procedure based on the current frame's temporal layer level. If the current frame's temporal layer level is higher within the coding scheme than some other temporal layer levels, an ALF procedure that is less computationally complex may be selected for the current frame. Then the decoder may perform the selected ALF procedure on the current frame.

Abstract: A video processing method includes determining, fora conversion between a video block of a video and a coded representation of the video, factors of a scaling tool based on a coding mode of the video block; and performing the conversion using the scaling tool, wherein the use of the scaling tool comprises: scaling at least some coefficients representing the video block during encoding or descaling at least some coefficients from the coded representation during decoding.

Abstract: Innovations in adaptive encoding for units of a video sequence can improve coding efficiency. For example, some of the innovations relate to encoding that includes adaptive switching of color spaces between units within a video sequence. Other innovations relate encoding that includes adaptive switching of color sampling rates between units within a video sequence. Still other innovations relate encoding that includes adaptive switching of bit depths between units within a video sequence.

Abstract: An example method of video processing includes performing a conversion between a video comprising one or more coding units and a bitstream representation of the video. The bitstream representation conforms to a format rule that specifies that chroma quantization parameters are included in the bitstream representation at a coding unit level or a transform unit level according to the format rule.

Abstract: A method for decoding a data stream representative of an image split into blocks. The method includes: for a current block, determining whether the size of the current block is less than or equal to a threshold, and if so, decoding information indicating a coding mode of the block among first and second coding modes, and reconstructing the current block according to the indicated coding mode, and otherwise reconstructing according to the first coding mode. According to the first coding mode, the current block is reconstructed using an inverse transform of a transformed prediction residue decoded for the current block, and according to the second coding mode the current block is reconstructed, for each pixel, by obtaining a prediction of the pixel from another previously decoded pixel belonging to the current block or to a previously decoded block, and reconstructing the pixel from the prediction and a decoded prediction residue.