Abstract: The present disclosure provides a method of reconstructing a video signal based on a reduced secondary transform, which includes: obtaining a secondary transform index from the video signal; deriving a secondary transform corresponding to the secondary transform index, wherein the secondary transform represents a reduced secondary transform, and the reduced secondary transform represents a transform outputting L (L<N) transform coefficient data (L×1 transform coefficient vectors) based on inputted N residual data (N×1 residual vectors); obtaining a transform coefficient block by performing an entropy decoding and a dequantization for a current block (N×N); performing an inverse secondary transform for the transform coefficient block using the reduced secondary transform; performing an inverse primary transform for a block which the inverse secondary transform is applied to; and reconstructing the current block using a block which the inverse primary transform is applied to.

Abstract: A method, system, and computer program product for trick play using partial video file chunks includes a processor to retrieve the selected video file from an HLS server, the video file having a plurality of video chunks, and each one of the video chunks beginning with an I-frame. The processor may determine an average size of the plurality of I-frames. The average I-frame size may be based on a bitrate speed of the video file. The processor may retrieve a portion equal to the average I-frame size of from the beginning of each one of the plurality of chunks of the video. The processor may receive a begin trick play request of the selected video and initiate trick play of the selected video. The trick play of the video includes displaying each portion of each one of the plurality of chunks of the video.

Abstract: A Method of decoding an encoded video bitstream using at least one processor includes: obtaining an encoded video bitstream, the encoded video bitstream including encoded color components; entropy parsing the encoded color components; dequantizing the color components and obtaining transform coefficients of the color components; applying a joint components secondary transform (JCST) on the transform coefficients of the color components, thereby generating JCST outputs; performing a backward transform on the JCST outputs, thereby obtaining residual components of the color components; and decoding the encoded video bitstream based on the residual components of the color components.

Abstract: Lossy or lossless compression and transmission, comprising the steps of: (i) receiving an input image; (ii) encoding it to produce a y latent representation; (iii) encoding the y latent representation to produce a z hyperlatent representation; (iv) quantizing the z hyperlatent representation to produce a quantized z hyperlatent representation; (v) entropy encoding the quantized z hyperlatent representation into a first bitstream, (vi) processing the quantized z hyperlatent representation to obtain a location entropy parameter ?y, an entropy scale parameter ?y, and a context matrix Ay of the y latent representation; (vii) processing the y latent representation, the location entropy parameter ?y and the context matrix Ay, to obtain quantized latent residuals; (viii) entropy encoding the quantized latent residuals into a second bitstream; and (ix) transmitting the bitstreams.

Abstract: A video processing method includes determining, fora conversion between a video block of a video and a coded representation of the video, factors of a scaling tool based on a coding mode of the video block; and performing the conversion using the scaling tool, wherein the use of the scaling tool comprises: scaling at least some coefficients representing the video block during encoding or descaling at least some coefficients from the coded representation during decoding.

Abstract: A video encoder is configured to encode, by block based predictive encoding, pictures of a video into coding data, wherein the block based predictive encoding includes an intra-picture prediction. The video encoder is configured to use, for the intra-picture prediction, for encoding a prediction block of a picture, a plurality of nearest reference samples of the picture directly neighboring the prediction block and a plurality of extended reference samples, each extended reference sample of the plurality of extended reference samples separated from the prediction block at least by one nearest reference sample of the plurality of reference samples. The video encoder is further configured to sequentially determine an availability or unavailability of each of the plurality of nearest reference samples and to substitute a nearest reference sample being determined as unavailable by a substitution sample. The video encoder is configured to use the substitution sample for the intra-picture prediction.

Abstract: An apparatus and method for geometrically correcting a distorted input frame and generating an undistorted output frame. The apparatus includes an external memory block that stores the input frame, a counter block to compute output coordinates of the output frame for a region based on a block size of the region, a back mapping block to generate input coordinates corresponding to each of the output coordinates, a bounding module to compute input blocks corresponding to each of the input coordinates, a buffer module to fetch data corresponding to each of the input blocks, an interpolation module to interpolate data from the buffer module and a display module that receives the interpolated data for each of the regions and stitch an output image. The method includes determining the size of the output block based on a magnification data.

Abstract: A video decoding method includes determining a usage of an SVT-vertical (V) or an SVT-horizontal (H) for a residual block; determining a transform block position of a transform block of the residual block; determining a transform type of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein at least one of the horizontal transform or the vertical transform is a discrete sine transform (DST)-7; and reconstructing the residual block based on the transform type, the transform block position, and transform coefficients of the transform block.

Abstract: Methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding are provided. In a method, prediction information of a current block of a coding unit tree is generated. The prediction information indicates at least one block partitioning structure is allowed for the current block and a SBT mode is used for the current block. A partition direction and a partition size of the SBT mode for the current block is determined based on the at least one allowed block partitioning structure indicated in the prediction information and based on a comparison between at least one dimension of the current block and a first threshold. A partition of the current block based on the partition direction and the partition size of the SBT mode is different from at least one partition of the current block based on the at least one allowed block partitioning structure indicated in the prediction information.

Abstract: Systems, apparatuses, and methods may provide for multi-session encoding to optimize multiple encoding sessions on Wi-Fi display (WFD) source devices when the WFD source devices are connected to multiple sink devices. The multiple encoding sessions may be optimized with encoding hints that are generated by a compositor and transmitted to a pre-encoding checking device. The encoding session that has the highest encoding resolution is subjected to hierarchical motion estimation (HME) processing, and the encoding sessions that have lower resolutions are optimized based on a motion vector prediction hint generated by the encoding session that has the highest encoding resolution and a scaling factor.

Abstract: An image decoding method according to the present document can comprise the steps of: on the basis of first flag information indicating whether or not matrix-based intra prediction (MIP) can be applied to a current block, receiving second flag information indicating whether or not the MIP is used for the current block; receiving matrix-based intra prediction (MIP) mode information on the basis of the second flag information; generating intra prediction samples for the current block on the basis of the MIP mode information; and generating reconstructed samples for the current block on the basis of the intra prediction samples.

Abstract: The present invention relates to a block partitioning structure from among the video coding schemes and to a method and apparatus for encoding and decoding the block partitioning structure, the method comprising the steps of: acquiring block partitioning data; partitioning a block by means of the acquired block partitioning data; and encoding and decoding by means of the partitioned block. The encoding and decoding method and apparatus according to the present invention has the benefit of improving encoding efficiency with respect to the existing video compression schemes.

Abstract: A method and apparatus for video coding utilizing a current block, a maximum side of the transform block of the current block corresponds to 64. A scaling matrix is derived from elements of an 8×8 base scaling matrix, where the elements in a bottom-right 4×4 region of the 8×8 base scaling matrix are skipped, either not signaled or set to zero. According to another method, a current block belongs to a current picture in a first color format that has only a first color component. A first scaling matrix is signaled at the video encoder side or parsed at the video decoder side for the first color component of the current block. Signaling any second scaling matrix is disabled at the video encoder side or parsing any second scaling matrix is disabled at the video decoder side for a second or third color component of the current block.

Abstract: A method of multi-scale neural image compression with intra-prediction residuals is performed by at least one processor and includes downsampling an input image, generating a current predicted image, based on a previously-recovered predicted image, and generating a prediction residual based on a difference between the downsampled input image and the generated current predicted image. The method further includes encoding the generated prediction residual, decoding the encoded prediction residual, and generating a currently-recovered predicted image based on an addition of the current predicted image and the decoded prediction residual. The method further includes upsampling the currently-recovered predicted image, generating a scale residual based on a difference between the input image and the upsampled currently-recovered predicted image, and encoding the scale residual.

Abstract: The present invention relates to an image encoding method and an image decoding method. The image decoding method includes partitioning a picture into a plurality of coding units, constructing a coding unit group including at least one coding unit of the plurality of coding units, obtaining coding information in units of one coding unit group, and decoding at least one coding unit of the plurality of coding units included in the coding unit group by using the obtained coding information.

Abstract: In the present invention, a method for processing an image on the basis of an intra prediction mode and an apparatus therefor are disclosed. Particularly, the method for processing an image on the basis of an intra prediction mode may comprise the steps of: partitioning a block to be processed, on the basis of an intra prediction mode of the block to be processed; and performing intra prediction for the split block to be processed, wherein the direction in which the block to be processed is split is perpendicular to the prediction direction of the intra prediction mode of the block to be processed.

Abstract: In a method of video decoding at a video decoder, a first high level syntax (HLS) element and a second HLS element can be received. The first HLS element can indicate whether an explicit multiple transform selection (MTS) is enabled or disabled for an intra coded block. The second HLS element can indicate whether the explicit MTS is enabled or disabled for an inter coded block. The first and second HLS elements can control a same set of coding blocks that include the intra coded block and the inter coded block. An implicit MTS can be enabled for the intra coded block when the first HLS element indicates the explicit MTS is disabled for the intra coded block, and the second HLS element indicates the explicit MTS is enabled for the inter coded block.

Abstract: A method for transforming high dynamic range (HDR) video data into standard dynamic range (SDR) video data and encoding the SDR video data so that the HDR video data may be recovered at the decoder includes generating a tone map describing a transformation applied to the HDR video data to generate the SDR video data. The generated tone map describes the transformation as the multiplication of each HDR pixel in the HDR video data by a scalar to generate the SDR video data. The tone map is then modeled as a reshaping transfer function and the HDR video data is processed by the reshaping transfer function to generate the SDR video data. The reshaping transfer function is then inverted and described in a self-referential metadata structure. The SDR video data is then encoded including the metadata structure defining the inverse reshaping transfer function.

Abstract: A camera module includes a compressor configured to divide a plurality of pixels included in image data, into a plurality of pixel groups, with respect to each of the plurality of pixel groups into which the plurality of pixels is divided, calculate a representative pixel value of a corresponding pixel group, based on pixel values of multiple pixels included in the corresponding pixel group, generate first compressed data, based on the calculated representative pixel value of each of the plurality of pixel groups, with respect to each of the plurality of pixel groups into which the plurality of pixels is divided, calculate residual values representing differences between the pixel values of the multiple pixels included in the corresponding pixel group and the representative pixel value of the corresponding pixel group, and generate second compressed data, based on the calculated residual values of each of the plurality of pixel groups.

Abstract: An image decoding method is disclosed in the present specification. A method of decoding an image, the method may comprises determining whether to perform a context update for a first syntax element of a current block, updating, on the basis of the determination, a context for entropy decoding of the first syntax element and generating, on the basis of the updated context, a bin for the first syntax element, and wherein whether to perform the context update is determined on the basis of the number of pre-decoded predetermined syntax elements for the current block.

Abstract: An inverse quantization method is implemented by an inverse quantization device, the method configured for acquiring quantized coefficients, estimating a quantization parameter in quantization groups or quantization parameter prediction group units, generating an inverse quantization matrix for adaptive quantization, and generating transform coefficients from the quantized coefficients using the quantization parameter and the inverse quantization matrix.

Abstract: A video decoding method according to the present document comprises a step of deriving a modified transform coefficient, and the step of deriving the transform coefficient may comprise the steps of: determining whether an LFNST can be applied to the height and width of a current block on the basis of the tree type and color format of the current block; parsing an LFNST index if the LFNST can be applied; and deriving the modified transform coefficient on the basis of the LFNST index and an LFNST matrix.

Abstract: A technique for determining an adaptive quantization parameter offset for a block of encoded video includes obtaining a rate control factor for the quantization parameter, determining a content-based quantization parameter factor for the quantization parameter, determining an adaptive variance based quantization offset based on content-based quantization parameter factors for a frame prior to the current frame, and combining the rate control factor, the content-based quantization parameter factor, and the adaptive offset to generate the quantization parameter.

Abstract: An example device for filtering a decoded block of video data includes one or more processors implemented in circuitry and configured to decode a current block of a current picture of the video data, select a filter (such as an adaptive loop filter) to be used to filter pixels of the current block, calculate a gradient of at least one pixel for the current block, select a geometric transform to be performed on one of a filter support region or coefficients of the selected filter, wherein the one or more processors are configured to select the geometric transform that corresponds to an orientation of the gradient of the at least one pixel, perform the geometric transform on either the filter support region or the coefficients of the selected filter, and filter the at least one pixel of the current block using the selected filter after performing the geometric transform.

Abstract: Apparatus and methods for encoding and decoding video data having improved quantization parameter prediction are presented and can include using a combination of quantization parameter prediction values obtained from respective ones of a plurality of quantization parameter prediction methods to encode or decode the video data.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Abstract: An extension to the motion-constrained tile sets SEI message provides functionality to signal all tiles are independently decodable and to signal the ROIs that may have more than one tile per ROI. With this extension, the functionality to redefine any independently decodable region-of-interest in a CVS at a coding tree unit level based on user interactivity is enabled. The extension supports the interactivity utilized in various applications such as interactive Ultra High Definition Television (UHDTV), dynamic high-quality zoom-in application, interactive on-demand, e-learning, smart surveillance and many other applications. Additionally, the temporal MCTS SEI message is able to be used by an encoder for tiled streaming to signal explicitly to the decoder that the decoder need only to display the ROI.

Abstract: A three-dimensional data encoding method includes: quantizing geometry information of each of three-dimensional points, using a first quantization parameter; quantizing a first luminance using a second quantization parameter and quantizing a first chrominance using a third quantization parameter, the first luminance and the first chrominance indicating a first color among attribute information of each of the three dimensional points; and generating a bitstream including the geometry information quantized, the first luminance quantized, the first chrominance quantized, the first quantization parameter, the second quantization parameter, and a first difference between the second quantization parameter and the third quantization parameter.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Abstract: A filtering method comprises: determining at least one block boundary to which filtering is to be applied in a reconstructed image; setting a boundary strength of the block boundary based on prediction modes of two target luma blocks forming the block boundary among a plurality of prediction modes, a type of the block boundary and preset conditions; calculating an average value of quantization parameters which are respectively applied to the target luma blocks, and deriving a variable by adding the average value to an offset value derived based on offset information to be encoded at a level of a sequence parameter set that is a header which is referenced in common by the pictures belonging to the sequence; and determining whether to perform the filtering on the block boundary and performing the filtering based on the set boundary strength and the variable.

Abstract: Provided is a method of coding blocks of video data representing an image using an encoder, the method including identifying, by the encoder, a first region of the image and a second region of the image, a sum of a first number of pixels in the first region and a second number of pixels in the second region being equal to a total number of pixels of the image, and allocating, by the encoder, a first number of bits including base bits for encoding the first region, and a second number of bits including base bits and enhancement bits for encoding the second region, a sum of the first number of bits and the second number of bits being equal to a total number of bits for encoding all of the pixels, wherein the second region is encoded with a greater number of bits per pixel than the first region.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Abstract: An image processing device and method that enable suppression of an increase in the amount of coding of a scaling list. The image processing device sets a coefficient located at the beginning of a quantization matrix by adding a replacement difference coefficient that is a difference between a replacement coefficient used to replace a coefficient located at the beginning of the quantization matrix and the coefficient located at the beginning of the quantization matrix to the coefficient located at the beginning of the quantization matrix; up-converts the set quantization matrix; and dequantizes quantized data using an up-converted quantization matrix in which a coefficient located at the beginning of the up-converted quantization matrix has been replaced with the replacement coefficient. The device and method can be applied to an image processing device.

Abstract: A method for processing a video signal comprises the steps of: obtaining, from the video signal, an intra sub-partitions (ISP) mode flag indicating whether the ISP mode is applied to a current block; when the ISP mode is applied to the current block, obtaining, from the video signal, an ISP partitioning flag indicating a partitioning direction of the current block; partitioning the current block into a plurality of transform blocks on the basis of the partitioning direction; generating residual blocks of the transform blocks by performing an inverse transformation on each of the transform blocks; and restoring the current block on the basis of the residual blocks.

Abstract: An example device for processing video data includes memory configured to store the video data and one or more processors implemented in circuitry and coupled to the memory. The one or more processors are configured to parse a first parameter set, the first parameter set being signaled in a bitstream data once per sequence of a group of encoded pictures. The one or more processors are configured to parse one or more dynamic range adjustment (DRA) syntax elements in a second parameter set, the second parameter set being signaled in the bitstream and being related to at least one picture in the group of encoded pictures, wherein the parsing of the one or more DRA syntax elements is not dependent on any syntax element of the first parameter set, and process the at least one picture based on the first parameter set and the second parameter set.

Abstract: A method for decoding encoded blocks of pixels from an encoded video bit stream is provided that includes decoding a block vector corresponding to an encoded block of pixels from the encoded bit stream, verifying that the block vector indicates a block of reconstructed pixels in a search area including reconstructed pixels of a largest coding unit (LCU) including the encoded block of pixels and N left neighboring reconstructed LCUs of the LCU, and decoding the encoded block of pixels, wherein the block of reconstructed pixels is used as a predictor for the encoded block of pixels.

Abstract: The coding of a media signal is rendered more efficient by describing the media signal using a sequence of samples and sequentially encoding this sequence by selecting, for a current sample, a set of quantization levels out of a plurality of quantization level sets depending on indices encoded into the data stream for previous samples of the sequence of samples, quantizing the current sample onto one level of the set of quantization levels, and encoding a quantization index to the one level for the current sample into the data stream. In other words, scalar quantization of the individual samples of the sequence of samples is used, but it is rendered dependent on quantization indices encoded into the data stream for previous samples of the sequence of samples.

Abstract: Method and decoder for reconstructing at least a sample of a block using an intra prediction angle determined from an intra prediction mode. The method includes decoding at least one syntax element from a coded video sequence. The at least one symax element is indicative of an intra prediction mode. An intra prediction angle is determined that corresponds to the indicated intra prediction mode based on a stored relationship between a plurality of intra prediction modes and a plurality of intra prediction angles. At least one sample of a block is reconstructed using the infra prediction angle that is determined to correspond to the indicated intra prediction mode. The plurality of intra prediction modes in the stored relationship can include at least one of a first plurality of wide angle prediction modes and a second plurality of wide angle prediction modes.

Abstract: An image decoding method performed by a decoding device, according to the present document, comprises the steps of: obtaining image information; and generating a reconstructed picture on the basis of the image information.

Abstract: A method for processing an online video stream may include determining a transmission performance of a network for a queue of video frames, wherein each video frame in the queue may be associated with a priority level. The method may also include determining a maximum discarding level based on the transmission performance of the network. The method may further include removing a target video frame of which the associated priority level is lower than or equal to the maximum discarding level from the queue.

Abstract: An encoder includes a frame level processing circuit, a coding tree unit (CTU) level processing circuit and an encoding circuit. The frame level processing circuit is arranged to calculate a bit number of a current frame according a target bitrate and a frame rate, and the frame level processing circuit is further arranged to calculate a quantization parameter of the current frame according to the bit number of the current frame and at least one parameter. The CTU level processing circuit is arranged to use an adaptive quantization mode to adjust the quantization parameter to generate an adjusted quantization parameter. The encoding circuit is arranged to encode the current frame to generate output data according to the adjusted quantization parameter.

Abstract: In one method, the current block is partitioned into multiple final sub-blocks using one or more stages of sub-tree partition comprising ternary tree partition and at least one other-type partition, where ternary partition tree is excluded from the sub-tree partition if a current sub-tree depth associated with a current sub-block is greater than a first threshold and the first threshold is an integer greater than or equal to 1. In another method, if a test condition is satisfied, the current block is encoded or decoded using a current Inter mode selected from a modified group of Inter tools, where the modified group of Inter tools is derived from an initial group of Inter tools by removing one or more first Inter tools from the initial group of Inter tools, replacing one or more second Inter tools with one or more complexity-reduced Inter tools, or both.

Abstract: Techniques and systems are provided for compressing data in a neural network. For example, output data can be obtained from a node of the neural network. Re-arranged output data having a re-arranged scanning pattern can be generated. The re-arranged output data can be generated by re-arranging the output data into the re-arranged scanning pattern. One or more residual values can be determined for the re-arranged output data by applying a prediction mode to the re-arranged output data. The one or more residual values can then be compressed using a coding mode.

Abstract: The present disclosure relates to systems, methods, and computer-readable media for selectively identifying pixel data to provide as an input to an image processing model based on motion data associated with the content of a digital video. For example, systems disclosed herein include receiving a compressed digital video and decompressing the compressed digital video to generate a decompressed digital video. The systems disclosed herein further include extracting or otherwise identifying motion data while decompressing the compressed digital video. The systems disclosed herein also include analyzing the motion data to determine a subset of pixel data from the decompressed digital video to provide as input to an image processing model trained to generate an output based on input pixel data.

Abstract: A method and device is provided that compensates for different reflectivity/absorption coefficients of objects in a scene/object when performing active depth sensing using structured light. A receiver sensor captures an image of a scene onto which a code mask is projected. One or more parameters are ascertained from the captured image. Then a light source power for a projecting light source is dynamically adjusted according to the one or more parameters to improve decoding of the code mask in a subsequently captured image. Depth information for the scene may then be ascertained based on the captured image based on the code mask. In one example, the light source power is fixed at a particular illumination while an exposure time for the receiver sensor is adjusted. In another example, an exposure time for the receiver sensor is maintained/kept at a fixed value while the light source power is adjusted.

Abstract: A system and method for transmission of a video stream are provided. The system may include: an encoder adapted to generate a video stream comprising a plurality of encoded frames, encoded according to at least one encoding parameter; a comparator in communication with the encoder, the comparator adapted to compare encoded frames of the plurality of encoded frames with input frames to determine a fitness metric reflective of visual quality of the encoded frames; and a controller in communication with the comparator, the controller adapted to adjust the at least one encoding parameter based on the fitness metric.

Abstract: Provided are method and device for inverse quantization and inverse transformation and non-transitory computer-readable storage medium.

Abstract: In a video decoding device, a quantization step size decoding unit calculates a quantization step size that controls a granularity of the inverse quantization by, based on an image prediction, selectively using a mean value of at least a quantization step size assigned to a leftwardly adjacent neighboring image block already decoded and a quantization step size assigned to a upwardly adjacent neighboring image block already decoded or a quantization step size assigned to an image block decoded immediately before.

Abstract: A video decoder can be configured to determine that a block of video data is encoded without transforming residual data for the block; determine a quantization parameter for the block of video data; based on the determined quantization parameter, determine a range for levels of quantized residual values of the block; divide the range into k intervals, wherein k is an integer value; determine a level for a quantized residual value of the block based on the k intervals by receiving information indicating the level for the quantized residual value is within a particular interval of the k intervals, receiving information indicating a difference value that represents a difference between a reference level value for the particular interval and the level for the quantized residual value of the block, and based on the reference level value and the difference value, determining the level for the quantized residual value.