Abstract: Some embodiments of a method may include: identifying two-dimensional (2D) content present in an image of a real-world scene; retrieving metadata comprising depth information associated with the 2D content; generating a plurality of focal plane images using the metadata, the plurality of focal plane images comprising depth cues for the 2D content; and displaying the plurality of focal plane images as a see-through overlay synchronized with the 2D content.

Abstract: A video decoding method includes obtaining a to-be-entropy-decoded syntax element in a current block by parsing a received bitstream, where the to-be-entropy-decoded syntax element includes a syntax element 1 or a syntax element 2 in the current block, obtaining a context model corresponding to the to-be-entropy-decoded syntax element, where both of a context model corresponding to the syntax element 1 and a context model corresponding to the syntax element 2 are determined from the same preset context model set, entropy decoding the to-be-entropy-decoded syntax element based on the context model corresponding to the to-be-entropy-decoded syntax element, and obtaining a reconstructed image of the current block based on the syntax element obtained by entropy decoding.

Abstract: The present disclosure relates to image modification such as an image enhancement. The image enhancement may be applied for any image modification and it may be applied during or after image encoding and/or decoding, e.g. as a loop filter or a post filter. In particular, the image modification includes a multi-channel processing in which a primary channel is processed separately and secondary channels are processed based on the processed primary channel. The processing is based on a neural network. In order to enhance the image modification performance, prior to applying the modification, the image channels are analyzed and a primary channel and the secondary channels are determined, which may vary for multiples of images, images or image areas.

Abstract: A coding method encodes an image by dividing the image into blocks, and comprises: dividing a coding target image into a plurality of coding unit blocks; determining whether or not to encode by dividing the coding unit block into a plurality of sub-coding unit blocks, on a basis of an edge direction and an edge strength of an edge obtained for each pixel in the coding unit block; and encoding, in a case of determining to divide the coding unit block into a plurality of sub-coding unit blocks in the determining step, a first sub-coding unit block by referencing a second sub-coding unit block inside the same coding unit block as the first sub-coding unit block.

Abstract: An image decoding method according to the present document comprises a step for deriving a residual sample, wherein the step for deriving the residual sample comprises the steps of: deriving a zero out block for a current block; deriving a context model for last significant coefficient location information on the basis of the width or height of the current block; deriving a value of a last significant coefficient location on the basis of the context model; and deriving the last significant coefficient location on the basis of a value of the last significant coefficient location information and the width or height of the zero out block.

Abstract: Disclosed are an electronic apparatus and a method of controlling the same. The electronic apparatus includes: an interface circuitry; and a processor configured to receive a low resolution image for each of a plurality of frames of content and characteristic data from an external apparatus through the interface circuitry, generate, based on the low resolution image and the characteristic data, a high resolution image that has a larger amount of data than the low resolution image and has characteristics corresponding to the characteristic data, and control to display the generated high resolution image on a display.

Abstract: The present disclosure relates to a method of operating a graphics processing system for providing frames over communication channel in a communication network, the graphics processing system being configured to process data for an application executed thereon to render frames for the application to be output for transmission over the communication channel to a client device, the method comprising: determining network characteristics of the communication network and/or server characteristics of the server; adaptively selecting a first prediction method from a plurality of prediction methods to be used for displaying frames based on the determined network characteristics and/or server characteristics; generating a plurality of frames based on the first prediction method; and selectively providing, based on the first prediction method, one or more output frames from the plurality of frames to the application to be output for transmission over the communication channel.

Abstract: Implementations related to coding and/or decoding image data employing video coding with embedded motion are disclosed.

Abstract: Decoder for decoding a transformed representation of a sample block from a data stream. If a first coded coefficient is located inside a predetermined subarea of the transform coefficient block and if the underlying transform is within a first set of available transforms, the decoder decodes coefficients along a first coefficient scan order. If the transform is within a second set of In available transforms, the decoder decodes coefficients located within the predetermined subarea along a second coefficient scan order, and infers that coefficients located outside the predetermined subarea are zero. The first coefficient scan order is so that coefficients outside the predetermined subarea are scanned between two transform coefficients located inside the predetermined subarea. The second coefficient scan order does not scan any coefficient outside the predetermined subarea between scanning the coefficients within the predetermined subarea.

Abstract: An image information decoding method performed by means of a decoding device according to the present invention comprises the steps of: decoding a non-separable secondary transform (NSST) index from a bitstream if NSST is applied to a target block; decoding information relating to transform coefficients with respect to the target block from the bitstream on the basis of the decoded NSST index; and deriving the transform coefficients with respect to the target block on the basis of the decoded information relating to the transform coefficients, wherein the NSST index is decoded prior to the information relating to the transform coefficients with respect to the target block.

Abstract: An example method may include identifying a first block of a first image, the first block comprising a plurality of pixel values, generating a frequency-based representation of the first block, where the frequency-based representation comprises a transformation matrix having a plurality of coefficients, where each coefficient specifies a weight of a respective frequency in the frequency-based representation of the first block, generating at least one frequency domain parameter of the first block in view of a sum of a plurality of the coefficients of the transformation matrix, generating a visual content classification value in view of the at least one frequency domain parameter of the first block, selecting, in view of a determination of whether the visual content classification value satisfies a visual content-specific threshold, an encoding, and generating, using the selected encoding, an encoded block in view of the first block.

Abstract: A method, computer program, and computer system is provided for coding video data. Video data is received. One or more transform cores corresponding to a transform associated with the video data are identified. The one or more transform cores include one or more of a line graph transform (LGT) and a discrete sine transform (DST) The video data is decoded based on the identified transform core. The transform cores correspond to one or more from among an 8-bit transform core and a 10-bit transform core. The transform corresponds to one or more from among a 2-point transform, a 4-point transform, an 8-point transform, and a 16-point transform.

Abstract: An image encoding/decoding method and apparatus are provided. The image decoding method performed by the image decoding apparatus, according to the present disclosure, comprises the steps of determining a current block by splitting an image on the basis of split information acquired from a bitstream; determining a quantization parameter of the current block; and determining a transform coefficient of the current block on the basis of the quantization parameter.

Abstract: In prediction, one of a first mode for deriving, using pixels in an image including a target block, predicted pixels in the target block, a second mode for deriving the predicted pixels in the target block using pixels in an image different from the image including the target block, a third mode for generating the predicted pixels in the target block using both the pixels in the image including the target block and pixels in the different image can be used. If the third mode is used in at least one of the first and second blocks, the intensity of deblocking filter to be performed for the boundary between the first and second blocks is set to the same intensity as in a case in which the first mode is used in at least one of the first and second blocks.

Abstract: A display device includes pixels, an image converter which generates a second image by correcting grayscales of a first logo in a first image for the pixels, and a data driver which provides data signals corresponding to the second image to the pixels. The image converter detects the first logo based on value and saturation of the first image, generates first map data corresponding to the first logo, and specifies pixels corresponding to the first logo based on the first map data.

Abstract: Embodiments in the present specification provide a method and device for processing video signal including steps of: obtaining a sub-block transform (SBT) flag indicating whether a SBT is applied, wherein the SBT represents a transform applied to a transform unit corresponding to one of subblocks split from a coding unit; determining a variable value related to a transform target region based on the SBT flag and a size value of the transform unit, wherein if the SBT flag equals to 1 and the size value is greater than a threshold value, the variable value is determined as the threshold value; obtaining position information of a last significant coefficient according to a scan order within the transform unit, wherein the position information of the last significant coefficient is coded based on the variable value; and performing an inverse-transform based on the position information of the last significant coefficient.

Abstract: A lossless coding mode is proposed in a video coding system comprising a plurality of coding tools, some being lossy by design, some of which can be adapted to become lossless or near lossless. To enable a lossless mode in such system, it is proposed to disable the tools that are lossy by design and use only lossless tools, to adapt some tools to enable lossless coding, and adapt some tools to enable near-lossless coding so that a secondary lossless coding may be applied after residual coding. In a specific embodiment, it is proposed to determine the type of residual coding by, when an information indicates that a transform skip residual coding is used, obtaining a flag representative of a special mode, and when this flag is true, determine that regular residual coding must be used instead of the transform skip residual coding that should be used.

Abstract: An encoding method and decoding method, and a device implementing the same are provided. The encoding method obtains an intra prediction mode related to a current block from a video signal, obtains prediction samples of the current block by performing intra prediction on the current block based on the intra prediction mode, scans transform coefficients of the current block based on a scanning type of the current block, obtains dequantized transform coefficients of the current block by dequantizing the transform coefficients, obtains residual samples of the current block by performing an inverse-transform on the dequantized transform coefficients, the inverse-transform being performed in a horizontal direction and a vertical direction, reconstructs the current block using the residual samples and the prediction samples, and applies a deblocking filter on the reconstructed current block.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method of decoding an image includes receiving a bitstream in which the image is encoded; obtaining index information for specifying a block division type of a current block in the image; and determining the block division type of the current block from a candidate group pre-defined in the decoding apparatus. The candidate group includes a plurality of candidate division types, including at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division. The method also includes dividing the current block into a plurality of sub-blocks; and decoding each of the sub-blocks with reference to syntax information obtained from the bitstream.

Abstract: A context modeling method includes: determining, for a current block, whether a first preset condition is satisfied and whether a second preset condition is satisfied, where the first preset condition is a preset condition related to a first neighboring block neighboring to the current block in a first direction, the second preset condition is a preset condition related to a second neighboring block neighboring to the current block in a second direction; determining a subclass index of a context model of a first flag of the current block based on the height and the width of the current block; and determining the context model of the first flag of the current block based on a satisfaction status of the first preset condition, a satisfaction status of the second preset condition, and the subclass index of the context model of the first flag.

Abstract: An orthogonal transform unit orthogonally transforms prediction residuals in a block of a P×Q array of pixels, thereby generating an N×M (N is an integer satisfying N<P, and M is an integer satisfying M<Q) array of orthogonal transform coefficients. A quantization unit quantizes the N×M array of the orthogonal transform coefficients using at least a quantization matrix of an N×M array of elements, and thereby generates an N×M array of quantized coefficients.

Abstract: Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. In a method, prediction information for a current block is decoded. The prediction information indicates a first intra prediction mode and a secondary transform index, based on which a secondary transform core is determined. A first transform coefficient block is de-quantized from the prediction information. A size of the first transform coefficient block is less than a size of the secondary transform core. A part of a second transform coefficient block is generated based on the first transform coefficient block and the secondary transform core. A size of the second transform coefficient block equals the size of the secondary transform core. A size of the part of the second transform coefficient equals the size of the first transform coefficient block. The current block is reconstructed based on the part of the second transform coefficient block.

Abstract: Provided is a method of decoding a video according to an embodiment, the method including determining at least one processing block for splitting the video; determining an order of determining at least one largest coding unit in the at least one processing block; determining at least one largest coding unit on the basis of the determined order; and decoding the determined at least one largest coding unit, wherein the order is one of a plurality of orders for determining a largest coding unit.

Abstract: An image decoding method according to the present document can comprise the steps of: acquiring, from a bitstream, intra prediction mode information and an LFNST index; deriving, as a cross-component linear model (CCLM) mode, an intra prediction mode of a chroma block on the basis of the intra prediction mode information; changing the intra prediction mode of the chroma block from the CCLM mode to an intra prediction mode of a luma block corresponding to the chroma block; determining an LFNST set, including LFNST matrices, on the basis of the intra prediction mode of the luma block; selecting one of the LFNST matrices on the basis of the LFNST set and the LFNST index; and deriving transform coefficients for the chroma block on the basis of the selected LFNST matrix.

Abstract: Provided is a method of decoding a video according to an embodiment, the method including determining at least one processing block for splitting the video; determining an order of determining at least one largest coding unit in the at least one processing block; determining at least one largest coding unit on the basis of the determined order; and decoding the determined at least one largest coding unit, wherein the order is one of a plurality of orders for determining a largest coding unit.

Abstract: An image decoding method according to the present disclosure includes deriving transform coefficients through dequantization based on the quantized transform coefficients for the target block; deriving modified transform coefficients based on an inverse reduced secondary transform (RST) for the transform coefficients; deriving residual samples for the target block based on an inverse primary transform for the modified transform coefficients; and generating a reconstructed samples based on the residual samples, and prediction samples derived based on an intra prediction mode for the target block, wherein the inverse RST is performed based on a transform kernel matrix selected from a transform set including a plurality of transform kernel matrices, the transform set is determined based on a mapping relationship according to the intra prediction mode applied to the target block, and a plurality of intra prediction modes including the intra prediction mode of the target block are mapped to one transform set.

Abstract: Decoder for block-based decoding of a picture from a data stream, configured to decode an intra-coding mode for a predetermined block of the picture from the data stream, configured to decode a partition dimension flag for the predetermined block of the picture from the data stream and set a partition dimension depending on the partition dimension flag to be horizontal or vertical and the decoder is configured to partition, along the predetermined dimension, the predetermined block into transform partitions which are as wide as the predetermined block perpendicular to predetermined dimension, furthermore configured to decode, for each transform partition, a transform of a prediction residual from the data stream; intra-predicting the predetermined block depending on one or more already reconstructed samples neighboring the predetermined block in a manner depending on the intra-coding mode to obtain a predictor for the predetermined block; and reconstructing the predetermined block by correcting the predictor

Abstract: A video decoding method according to the present document is characterized by comprising: a step for deriving transform coefficients through inverse quantization on the basis of quantized transform coefficients for a target block; a step for deriving modified transform coefficients on the basis of an inverse reduced secondary transform (RST) of the transform coefficients; and a step for generating a reconstructed picture on the basis of residual samples for the target block on the basis of an inverse primary transform of the modified transform coefficients, wherein the inverse RST using a transform kernel matrix is performed on transform coefficients of the upper-left 4×4 region of an 8×8 region of the target block, and the modified transform coefficients of the upper-left 4×4 region, upper-right 4×4 region, and lower-left 4×4 region of the 8×8 region are derived through the inverse RST.

Abstract: An image decoding method according to the present document comprises the steps of: deriving flag information indicating whether valid coefficients are present in a second area excluding a first area of the upper left corner of the current block; parsing an MTS index from a bitstream on the basis of the flag information indicating the absence of valid coefficients in the second area; and deriving residual samples for the current block by applying a conversion kernel derived on the basis of the MTS index to conversion coefficients of the first area, wherein the flag information may be derived by determining, for each scan sub-block in which the valid coefficients are scanned, whether the valid coefficients are present in the second area.

Abstract: Provided is a method of decoding a video according to an embodiment, the method including determining at least one processing block for splitting the video; determining an order of determining at least one largest coding unit in the at least one processing block; determining at least one largest coding unit on the basis of the determined order; and decoding the determined at least one largest coding unit, wherein the order is one of a plurality of orders for determining a largest coding unit.

Abstract: According to the present invention, there is provided a method of decoding an image, the method including: determining whether a non-zero residual coefficient is included in a current block; and decoding residual coefficients included in the current block according to a scanning order of the current block, when it is determined that the non-zero residual coefficient is included in the current block. Herein, an absolute value of the residual coefficient of which a scanning index is greater than a residual coefficient adjustment index is equal to or less than a residual coefficient adjustment reference value.

Abstract: Provided is a method of decoding a video according to an embodiment, the method including determining at least one processing block for splitting the video; determining an order of determining at least one largest coding unit in the at least one processing block; determining at least one largest coding unit on the basis of the determined order; and decoding the determined at least one largest coding unit, wherein the order is one of a plurality of orders for determining a largest coding unit.

Abstract: Provided is a method of decoding a video according to an embodiment, the method including determining at least one processing block for splitting the video; determining an order of determining at least one largest coding unit in the at least one processing block; determining at least one largest coding unit on the basis of the determined order; and decoding the determined at least one largest coding unit, wherein the order is one of a plurality of orders for determining a largest coding unit.

Abstract: An example method includes determining a color component of a unit of video data; determining, based at least on the color component, a context for context-adaptive binary arithmetic coding (CABAC) a syntax element that specifies a value of a low-frequency non-separable transform (LFNST) index for the unit of video data; CABAC decoding, based on the determined context and via a syntax structure for the unit of video data, the syntax element that specifies the value of the LFNST index for the unit of video data; and inverse-transforming, based on a transform indicated by the value of the LFNST index, transform coefficients of the unit of video data.

Abstract: Methods for determining a prediction value, an encoder, and a decoder are provided. Reconstructed values of neighboring samples of a current block are acquired, and then filtered to obtain a reference value set of the current block. When a size of the current block is smaller than a preset threshold value, a first constant value is calculated according to a bit depth value of a luma component of a sample in the current block. A difference between the first constant value and a first reference value in the reference value set is determined as a first prediction input value in a prediction input value set. Other prediction input values in the prediction input value set other than the first prediction input value are determined according to the reference value set. Prediction values of samples at specific positions in the current block is calculated and then filtered.

Abstract: An image decoding method according to the present document may comprise the steps of: receiving image information including residual information and an LFNST index from a bitstream; deriving a transform coefficient on the basis of the residual information; deriving a flag variable related to whether LFNST is applied to a current block on the basis of the LFNST index; and performing the LFNST on the basis of the flag variable and the transform coefficient, wherein the flag variable is derived for each color component of the current block.

Abstract: A method for inverse discrete cosine transformation (IDCT) in video coding is provided that includes receiving a transform block, identifying a region of non-zero transform coefficients in the transform block using a group significance map corresponding to the transform block, wherein any transform coefficients not in the region have a value of zero, applying a one-dimensional (1D) IDCT to the region of non-zero transform coefficients in a first direction to generate an interim results block, wherein 1D IDCT computations are not performed on transform coefficients outside the region, and applying a 1D IDCT to the interim results block in a second direction to generate a residual block.

Abstract: Techniques for coding and deriving (e.g., determining) one or more coded-block-flags associated with video content are described herein. A coded-block-flag of a last node may be determined when coded-block-flags of preceding nodes are determined to be a particular value and when a predetermined condition is satisfied. In some instances, the predetermined condition may be satisfied when log2(size of current transform unit) is less than log2(size of maximum transform unit) or log2(size of current coding unit) is less than or equal to log2(size of maximum transform unit)+1. The preceding nodes may be nodes that precede the last node on a particular level in a residual tree.

Abstract: An image encoding/decoding method and an apparatus thereof are provided. The decoding method includes: determining a coding unit by splitting an image; determining a transform unit in the coding unit; determining whether to decode residual data of the transform unit according to a transform skip mode; obtaining a significant subgroup flag about a subgroup in the transform unit; based on the significant subgroup flag indicating that the subgroup includes at least one non-zero significant coefficient and scanning information about coefficients of the subgroup, obtaining a first bin about a significant coefficient flag, a sign flag, a first flag, and a parity flag of a coefficient of a scan position; obtaining the residual data including a coefficient in the subgroup based on the base level and a remainder of an absolute value excluding the base level; and obtaining a reconstruction block of the coding unit, based on the residual data.

Abstract: An apparatus for video decoding, includes processing circuitry configured to determine an affine model for a current block coded with an interweaved affine mode. Based on the affine model, a first prediction block corresponding to a first pattern for partitioning the current block into first sub-blocks and a second prediction block corresponding to a second pattern for partitioning the current block into second sub-blocks can be generated. The first and second prediction blocks include interpolated samples having an intermediate bit-depth larger than an input bit-depth of the current block. Co-located first and samples in the first and second prediction blocks with a precision corresponding to the intermediate bit-depth are weighted averaged to obtain averaged samples. The averaged samples are rounded to the input bit-depth to obtain corresponding third samples in a final prediction block of the current block.

Abstract: A decoder includes circuitry configured to receive a bitstream identify, in the bitstream, a current frame, wherein the current frame includes a plurality of regions, detect, in the bitstream, an indication that a first region is encoded according to a lossless encoding protocol and another region is encoded according to a lossy encoding protocol, and decode the current frame, wherein decoding the current frame further comprises decoding the first region using a lossless decoding protocol corresponding to the lossless encoding protocol.

Abstract: A data encoding method comprises: encoding an ordered array of data values as data representing a data value magnitude and data representing a data value sign; predicting, for a set of data values comprising at least some of the data values, the respective data value sign from a property of one or more other data values in the ordered array; and encoding the data value sign for the set of data values in dependence upon the respective predicted value.

Abstract: A video decoder configured to set a context index variable to a first value, wherein the first value for the context index variable is associated with a first context; context decode a first bin for a syntax element indicating a transform using the first context; determine a new value for the context index variable based on a value of the first bin; context decode a second bin for the syntax element indicating the transform using a context associated with the new value; determine an inverse transform from a set of inverse transform candidates based on the first bin and the second bin; and apply the inverse transform to a set of coefficients to determine a block of residual data.

Abstract: Embodiments of the present disclosure provide a coefficient coding method, an encoder, and a decoder. The method includes the following. A bitstream is parsed to obtain a video flag. When the video flag indicates that a video satisfies a preset condition, the bitstream is parsed to obtain a last-significant-coefficient position-reverse flag and coordinate information of a last significant coefficient. When the last-significant-coefficient position-reverse flag indicates that a position of the last significant coefficient is reversed for a current block, the position of the last significant coefficient is determined by calculation with the coordinate information of the last significant coefficient. According to a preset scanning order, all coefficients before the position of the last significant coefficient are decoded to determine coefficients of the current block.

Abstract: A method and apparatus for performing a frequency-dependent joint component secondary transform (FD-JCST). The method includes obtaining a plurality of transform coefficients in a transform coefficient block; determining whether at least one of the plurality of transform coefficients is a low-frequency coefficient; based on determining that the at least one of the plurality of transform coefficients is the low-frequency coefficient, determining whether the low-frequency coefficient is a non-zero value; and based on determining that the low-frequency coefficient is the non-zero value, performing a joint component secondary transform (JCST) on the low-frequency coefficient and signaling a related syntax to indicate that the JCST is performed.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method of decoding an image includes receiving a bitstream in which the image is encoded; obtaining index information for specifying a block division type of a current block in the image; and determining the block division type of the current block from a candidate group pre-defined in the decoding apparatus. The candidate group includes a plurality of candidate division types, including at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division. The method also includes dividing the current block into a plurality of sub-blocks; and decoding each of the sub-blocks with reference to syntax information obtained from the bitstream.

Abstract: The present invention relates to an entropy decoding method which includes: generating context related to a bin that forms a codeword of a syntax element; and performing arithmetic decoding of the bin based on the context.

Abstract: The present disclosure provides methods for convolutional-neural-network (CNN) based filter for video coding. An exemplary method includes: applying motion estimation to a target coding block, to determine a reference block of the target coding block; inputting, to a convolutional neural network (CNN) filter, image data associated with the target coding block and the reference block; and executing the CNN filter to determine a residual associated with the target coding block based on the input image data.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method of decoding an image includes receiving a bitstream in which the image is encoded; obtaining index information for specifying a block division type of a current block in the image; and determining the block division type of the current block from a candidate group pre-defined in the decoding apparatus. The candidate group includes a plurality of candidate division types, including at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division. The method also includes dividing the current block into a plurality of sub-blocks; and decoding each of the sub-blocks with reference to syntax information obtained from the bitstream.

Abstract: A method of video decoding performed in a video decoder is disclosed. A syntax element can be received from a bitstream of a coded video indicating that residual blocks of a current coding unit (CU) are processed with a color space conversion. The residual blocks of the current CU can include a luma residual block, a first chroma residual block, and a second chroma residual block. In response to receiving the syntax element indicating that the residual blocks of the current CU are processed with the color space conversion, one of two options of color space conversion equations can be selected based on a transform skip flag and a quantization parameter (QP) corresponding to each of the residual blocks of the current CU. An inverse color space conversion can be applied using the selected option of color space conversion equations to the residual blocks of the current CU.