Abstract: A video coder may determine contexts for entropy coding bins of a last significant coefficient position syntax element. For example, a video coder may determine a respective context for each of one or more bins of a syntax element indicating the position of the last significant coefficient in a transform block using a function of a size of the transform block, wherein the function outputs the respective context such that the same context is not used for transform blocks of differing sizes.

Abstract: Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. In a method, prediction information for a current block is decoded. The current block is in a current picture that is a part of a coded video sequence. The prediction information indicates a first intra prediction mode and a secondary transform index for the current block. A secondary transform core is determined based on the first intra prediction mode and the secondary transform index. A primary transform coefficient block is generated based on the secondary transform core and a first transform coefficient block of the current block. The first transform coefficient block is de-quantized from the prediction information. A size of the first transform coefficient block is less than a size of the secondary transform core. The current block is reconstructed based on the primary transform coefficient block.

Abstract: In one example, a head mounted display system includes at least one memory; and at least one processor to execute instructions to: detect a first position and a first view direction of a head of a user based on sensor data generated by at least one of an accelerometer, at least one camera, or a gyroscope at a first point in time; determine a latency associated with a time to cause an image to be presented on the display; determine a predicted position and a predicted view direction of the head of the user at a second point in time based on the latency; render, prior to the second point in time, the image for presentation on the display based on the predicted position and the predicted view direction of the head of the user; and cause the display to present the rendered image.

Abstract: Provided is a video decoding method including determining encoding modes applicable to a current picture according to a temporal layer depth of the current picture, generating a prediction block and a transform block for blocks included in the current picture according to the encoding modes applicable to the current picture, and reconstructing the current picture by using the prediction block and the transform block.

Abstract: Disclosed herein is a region-based reference management system using in video frame encoding. Source content, such as video game streaming or remote desktop sharing, that includes scene changes or significant instantaneous changes in a region from one frame to the next can present encoding challenges. Techniques disclosed herein use hints about changes in regional frame content, dissect frame content into regions, and associate the dissected regions with stored reference frame data using the hints and information about the regions to more efficiently encode frames.

Abstract: An encoder includes memory, and circuitry accessible to the memory. The circuitry accessible to the memory: determines whether OBMC is applicable to generation of a prediction image of a current block, according to whether BIO is to be applied to the generation of the prediction image of the current block; when BIO is to be applied to the generation of the prediction image of the current block, determines that OBMC is not applicable to the generation of the prediction image of the current block, and applies BIO to the generation of the prediction image of the current block without applying OBMC.

Abstract: The present invention relates to a method of performing motion compensation by using motion vector prediction. To this end, a method of decoding an image may include: generating multiple motion vector candidate lists according to an inter-prediction direction of a current block; deriving multiple motion vectors for the current block by using the multiple motion vector candidate lists; determining multiple prediction blocks for the current block by using the multiple motion vectors; and obtaining a final prediction block for the current block based on the multiple prediction blocks.

Abstract: A video coder is configured to form, in a symmetric motion vector difference mode, a List 0 (L0) base vector using a L0 Advanced Motion Vector Prediction (AMVP) candidate list and a List 1 (L1) base vector using a L1 AMVP candidate list; determine a refined L0 motion vector and a refined L1 motion vector by performing a decoder-side motion vector refinement process that refines the L0 base vector and the L1 base vector; and use the refined L0 motion vector and the refined L1 motion vector to determine a prediction block for a current block of a current picture of the video data.

Abstract: A method of encoding input data to generate corresponding encoded data is provided. The method includes encoding the input data into a plurality of symbols in the encoded data, wherein the plurality of symbols represent data as defined by a plurality of palettes indicated and/or included in the encoded data. The method further includes determining mutually different palettes to be used for encoding mutually different parts of the input data, and using the mutually different palettes for encoding the mutually different parts of the input data. Moreover, the method also includes including, within the encoded data, information associating the mutually different palettes with their respective parts of the input data encoded into the encoded data, wherein the information includes palette selection indices for referencing the mutually different palettes on a block-by-block basis.

Abstract: An image encoding/decoding method and apparatus for predicting a second color component block using a first color component block are provided. An image decoding method of the present invention comprises deriving a prediction parameter using the first color component block, and predicting the second color component block using the derived prediction parameter.

Abstract: A video data encoding method is provided for an encoding device. The method includes obtaining first video data, and encoding the first video data to generate a plurality of sequentially arranged groups-of-pictures. A frame type of a first frame of an initial group-of-pictures in the plurality of groups-of-pictures is an I frame, frame types of first frames of the other groups-of-pictures are GF frames, and each GF frame is configured to record change information of a current frame of a corresponding group-of-pictures relative to an I frame or a GF frame in a previous group-of-pictures. The method also includes successively outputting the plurality of groups-of-pictures according to a sequence of the plurality of groups-of-pictures, to obtain second video data.

Abstract: A method (400) performed by a decoder (260, 600, 701) for decoding a bitstream comprising a picture parameter set, PPS, and a first set of slices. The method includes obtaining (s402) the picture parameter set. The method also includes decoding (s404) a syntax element included in the picture parameter set to obtain an indicator value. The decoder is configured such that if the indicator value is set to a first value then the decoder determines that a picture header included in the bitstream comprises a parameter value corresponding to a particular parameter, otherwise the decoder determines that each slice included in the first set of slices comprises a parameter value corresponding to the particular parameter. If the picture header comprises the parameter value corresponding to the particular parameter, then this parameter value is used to decode slice data of each slice included in the first set of slices.

Abstract: A video coder determines a plurality of available Matrix Intra Prediction (MIP) parameter sets (MPS's) for a picture of video data. The plurality of available MPS's is a union of (i) a subset of all default MPS's and (ii) a set of additional MPS's that are signaled in the bitstream. Each of the default MPS's is associated with a predefined MIP mode in a codec. Each of the set of additional MPS's is associated with a new MIP mode in a set of new MIP modes. The video decoder uses a MIP mode associated with an MPS in the plurality of available MPS's to generate a prediction block for a current block of the picture.

Abstract: A technique for varying firmware for different virtual functions in a virtualized device is provided. The virtualized device includes a hardware accelerator and a microcontroller that executes firmware. The virtualized device is virtualized in that the virtualized device performs work for different virtual functions (with different virtual functions associated with different virtual machines), each function getting a “time-slice” during which work is performed for that function. To vary the firmware, each time the virtualized device switches from performing work for a current virtual function to work for a subsequent virtual function, one or more microcontrollers of the virtualized device examines memory storing addresses for firmware for the subsequent virtual function and begins executing the firmware for that subsequent virtual function. The addresses for the firmware are provided by a corresponding virtual machine at configuration time.

Abstract: An image processing device is described. The circuitry of the image processing device obtains an image that is generated on a basis of an incident light and a transfer function related to a conversion between the incident light and the image, and determines a cost function for prediction mode selection according to the transfer function. The cost function calculates a cost value based on a first parameter corresponding to a prediction residual code amount and a second parameter corresponding to a prediction mode code amount. The cost function is determined in a manner in favor of increasing the prediction residual code amount or decreasing the prediction mode code amount as a dynamic range of the transfer function increases. The circuitry determines a prediction mode for coding a coding unit of the image according to the determined cost function, and encodes the coding unit according to the determined prediction mode.

Abstract: An image filtering method and apparatus, where the method includes determining a filter coefficient of a chroma filter based on a filter coefficient of a luma filter, where the luma filter and the chroma filter are respectively applied to perform filtering processing on luma samples and chroma samples of a to-be-processed image, all filter coefficients of the luma filter present a first geometric distribution, all filter coefficients of the chroma filter present a second geometric distribution, the first geometric distribution and the second geometric distribution are similar shapes, and a filter coefficient of the chroma filter at an edge of the second geometric distribution is calculated using one or more filter coefficients of the luma filter at an edge of the first geometric distribution, and respectively performing filtering processing on the luma samples and the chroma samples using the luma filter and the chroma filter.

Abstract: An encoder which encodes a video including a plurality of pictures includes circuitry and memory. Using the memory, the circuitry performs: encoding a first picture among the plurality of pictures; and performing (i) a first operation for encoding a parameter set for a second picture which follows the first picture in coding order among the plurality of pictures after encoding the first picture, and encoding the second picture after encoding the parameter set, or (ii) a second operation for encoding the second picture without encoding the parameter set after encoding the first picture. The circuitry performs the first operation when the second picture is a determined picture, in the performing of the first operation or the second operation.

Abstract: An image processing device includes a multimedia intellectual (IP) block which processes image data; a memory; and a frame buffer compressor (FBC) which compresses the image data to generate compressed data and stores the compressed data in the memory. The frame buffer compressor includes a logic circuit which determines a combination of a quantization parameter (QP) table and an entropy table and controls compression of the image data based on the determined combination of the QP table and the entropy table.

Abstract: A video decoder is configured to decode one or more first adaptation parameter set (APS) indices for a current picture that indicate one or more first APSs that may be used for decoding the current picture. The video decoder may determine, for a block of a sub-picture of the current picture, an APS from the one or more first APSs indicated for the current picture, and decode the block of the sub-picture using the determined APS. In some examples, the video decoder may determine, for the block of the sub-picture of the current picture, the APS from the one or more first APSs indicated for the current picture without decoding any syntax elements, at a sub-picture level, indicating APSs that may be used for decoding the sub-picture.

Abstract: A method for decoding an image by a decoding device according to the present invention comprises the steps of: deriving, from a bit stream, transform coefficients of a block to be decoded; deriving residual samples of the block to be decoded, on the basis of a selective transform of the transform coefficients; and generating a reconstructed picture on the basis of the residual samples of the block to be decoded and prediction samples of the block to be decoded, wherein the selective transform is performed on the basis of a modified transform matrix, the modified transform matrix comprises a matrix including a modified basis vector, and the modified basis vector contains a certain number of elements selected from N elements.

Abstract: According to one embodiment of the present invention, an electronic device comprises a wireless communication circuit, a memory, and a processor electrically connected to the wireless communication circuit and the memory, wherein the processor can be configured to acquire a plurality of encoded image frames on the basis of at least a part of image data stored in the memory, compare each data size of the plurality of encoded image frames with a threshold value, and change transmission setting of at least one among the plurality of encoded image frames through the wireless communication circuit on the basis of at least a part of the result of the comparison. Additional various embodiments are possible.

Abstract: An image decoding method includes: receiving a bitstream that includes video data and signaling data; decoding base layer video data; and decoding at least one enhancement layer video data based on the signaling data and the base layer video data, wherein the video data includes the base layer video data for a base layer and the at least one enhancement layer video data for at least one enhancement layer predicted from the base layer, wherein the signaling data includes region of interest information indicating a region of interest corresponding to a gaze direction of a user in an entire region of a virtual space for video conferencing service.

Abstract: A disclosed computer-implemented method may include receiving a media item for encoding via a content optimized encoding algorithm. The method may also include determining, in accordance with the content optimized encoding algorithm, an overall error model for the media item. The overall error model may include (1) a rate-distortion model for the media item, and (2) a downsampling-distortion model for the media item. The method may also include determining, based on the overall error model, a bitrate cost associated with streaming of the media item within a bitrate lane. The method may further include adjusting the overall error model based on the bitrate cost associated with streaming of the media item within the bitrate lane and encoding the media item for streaming within the bitrate lane based on the adjusted overall error model.

Abstract: A method for video processing is provided to include: performing a conversion between a current video block of a video that is a chroma block and a coded representation of the video, wherein, during the conversion, the current video block is constructed based on a first domain and a second domain, and wherein the conversion further includes applying a forward reshaping process and/or an inverse reshaping process to one or more chroma components of the current video block.

Abstract: A method of selecting a reference sample used to encode a current block in an encoded video bitstream using at least one processor includes determining that a constrained intra prediction (CIP) mode is enabled; determining that a neighboring sample of the current block belongs to a coding block that is coded using intra block copy (IBC) coding; based on the determining that the neighboring sample belongs to the coding block that is coded using the IBC coding, selecting the neighboring sample as the reference sample; and encoding the current block using intra prediction coding based on the reference sample.

Abstract: An example method for entropy decoding of video data includes retrieving a pre-defined initialization value for a context of a plurality of contexts used in a context-adaptive entropy coding process to entropy code a value for a syntax element for an independently codable unit of video data; determining, based on the pre-defined initialization value and in a linear domain, an initial probability state of the context; and entropy decoding, from a bitstream and based on the initial probability state of the context, a bin of the value for the syntax element.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry that decodes prediction information for a current block in a current coded picture that is part of a coded video sequence. The prediction information indicates a fractional motion vector for the current block. The processing circuitry determines whether one of a block width and a block height of the current block is below a first threshold. The processing circuitry selects one of an integer motion vector, a first interpolation filter, and a second interpolation filter for the current block when the one of the block width and the block height of the current block is determined to be below the first threshold. The processing circuitry reconstructs the current block based on the selected one of the integer motion vector, the first interpolation filter, and the second interpolation filter.

Abstract: A method, computer program, and computer system is provided for video coding. Video data comprising a chroma component and a luma component is received. Luma samples are extracted from the luma component of the received video data. The chroma component is filtered by a cross-component adaptive loop filter (CC-ALF) based on a location of a chroma sample associated with the chroma component, the extracted luma samples, filter weights associated with the extracted luma samples, and an offset value.

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to

Abstract: A method and apparatus for decoding multiple semantically independent picture parts into a single video picture includes decoding unique picture order count values for each coded picture, coded slice, or coded tile in a coded video sequence, with multiple decoded pictures, cycles, and tiles belonging to a same access unit representing a frame of the video. A value representing the amount of pictures, cycles, or tiles, is then assigned to each access unit for assigning sequential access unit count values to the access units. As a result, each access unit, which represents multiple pictures, slices, or tiles to be combined into a single frame, is decoded for display processing.

Abstract: Systems, methods, and computer readable media are described for generating a regional nesting message. In some examples, a video bitstream is obtained and an encoded video bitstream is generated using the video data. The encoded video bitstream includes a regional nesting message that contains a plurality of nested messages and a plurality of region data defining a plurality of regions of a picture of the encoded video bitstream. For example, a first nested message of the regional nesting message includes a first set of data and a first region identifier indicating that the first set of data is to be applied to a first region of the plurality of regions of the picture.

Abstract: A method for decoding a video according to the present invention may comprise: decoding information indicating whether a non-zero transform coefficient exists in a current block, when the information indicates that the non-zero transform coefficient exists in the current block, determining a scanning order of the current block, and decoding a transform coefficient included in the current block according to the determined scanning order.

Abstract: An information processing apparatus (2000) includes a first analyzing unit (2020), a second analyzing unit (2040), and an estimating unit (2060). The first analyzing unit (2020) calculates a flow of a crowd in a capturing range of a fixed camera (10) using a first surveillance image (12). The second analyzing unit (2040) calculates a distribution of an attribute of objects in a capturing range of a moving camera (20) using a second surveillance image (22). The estimating unit (2060) estimates an attribute distribution for a range that is not included in the capturing range of the moving camera (20).

Abstract: According to a method for Adaptive Loop Filter (ALF) processing of reconstructed video, multiple indicators are signaled in slice at an encoder side or parsed at a decoder side, where the multiple indicators are Adaptive Parameter Set (APS) indices associated with temporal ALF filter sets for the ALF processing. A current indicator is determined from the multiple indicators, where the current indicator is used to select a current ALF filter set. Filtered-reconstructed pixels are derived for the current block by applying the current ALF filter to the current block. In another method, if the ALF processing applied at a target sample requires an outside sample on other side of a target virtual boundary from the target sample, the outside sample is replaced by a padded sample.

Abstract: A video image processing method includes dividing a coding unit into one or more sub-blocks, constructing first and second motion vector candidate lists, and performing prediction for the coding unit according to the first and second motion vector candidate lists. The first motion vector candidate list includes a motion vector of a sub-block of the coding unit, and the second motion vector candidate list includes a motion vector of the coding unit. Constructing the first motion vector candidate list includes determining a reference motion vector of the coding unit, determining a related reference block of the sub-block of the coding unit in a co-located reference image of the coding unit according to the reference motion vector, determining a scaling factor of the motion vector of the related reference block, and adding the scaled motion vector into the first motion vector candidate list.

Abstract: A variable bit rate generative compression method based on adversarial learning is provided. According to the method, a variance of a feature map of an encoding-decoding fill convolutional network is quantized to train a single generative model to perform variable bit rate compression. The method includes the following implementation steps of: constructing training and testing data sets through an image acquisition device; constructing a generative compression network based on an auto-encoder structure; according to a rate-distortion error calculation unit, alternately training a generative network; according to a target compression rate, calculating a mask threshold; based on a feature map channel redundancy index, calculating a mask; and performing lossless compression and decoding on the mask and the feature map. According to the invention, only a single model is trained, but compression results with different bit rates can be generated, and on a limit compression rate below 0.1 bpp.

Abstract: An electronic apparatus is provided. The electronic apparatus includes a storage configured to store a compression rate network model configured to determine a compression rate applied to an image block from among a plurality of compression rates, and a plurality of compression noise removing network models configured to remove compression noise for each of the plurality of compression rates, and a processor configured to: obtain a compression rate of each of a plurality of image blocks included in a frame of a decoded moving picture based on the compression rate network model, obtain the compression rate of the frame based on the plurality of obtained compression rates, and remove compression noise of the frame based on a compression noise removing network model corresponding to the compression rate of the frame from among the plurality of compression noise removing network models.

Abstract: Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that decodes prediction information for a current block in a current picture that is a part of a coded video sequence. The prediction information includes an adaptive color transform (ACT) flag indicating whether ACT is enabled for the current block. The processing circuitry determines whether a transform unit (TU) split is performed on the current block based on a maximum transform size that is determined according to whether the ACT flag indicates the ACT is enabled for the current block. The processing circuitry determines a type of the TU split in response to the TU split being determined to be performed on the current block. The processing circuitry performs the TU split on the current block based on the determined type of the TU split.

Abstract: Provided is an encoder which includes circuitry and memory. Using the memory, the circuitry: splits an image block into a plurality of partitions; generates a motion vector candidate list; obtains a motion vector from the motion vector candidate list; performs inter prediction processing using the motion vector; and encodes the image block using a result of the inter prediction processing. When a partition is a non-rectangular partition, the circuitry generates the motion vector candidate list using at least one motion vector among a plurality of motion vectors for a plurality of spatially neighboring partitions or a plurality of motion vectors for a plurality of temporally neighboring partitions, without using a plurality of motion vectors for a plurality of sub-partitions.

Abstract: Disclosed is a mechanism for selecting an interpolation filter for use in conjunction with an affine block in video coding. A motion vector is determined for a sub-block of the affine block based on control points. A sub-block size of the sub-block is also determined. The interpolation filter is selected for application to a reference block corresponding to the sub-block. The interpolation filter is selected based on the sub-block size. The motion vector of the sub-block and an offset of a current sample of the sub-block are employed to determine a reference sample at the reference block. This includes applying the interpolation filter to the reference block to determine the reference sample when the motion vector at the offset points to a fractional position at the reference block. The reference samples are employed to determine residual information in order to encode the affine block.

Abstract: A method and apparatus for decoding a video bitstream, a method and apparatus for generating a video bitstream, storage medium and an electronic device are provided. The method for decoding the video bitstream includes that: a first parameter of a reference position of a slice in a video picture is acquired; a second parameter of the slice is acquired, the second parameter being used for determining a starting position of the slice in the video picture; and a starting position coordinate parameter of the slice in the video picture is calculated according to the first parameter and the second parameter.

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to

Abstract: Provided is an image decoding method including: determining a first coding block and a second coding block corresponding to the first coding block; when a size of the first coding block is equal to or smaller than a preset size, obtaining first split shape mode information and second split shape mode information from a bitstream; determining a split mode of the first coding block, based on the first split shape mode information, and determining a split mode of the second coding block, based on the second split shape mode information; and decoding a coding block of a first color component which is determined based on the split mode of the first coding block and a coding block of a second color component which is determined based on the split mode of the second coding block.

Abstract: A method of adaptive point cloud attribute coding is performed by at least one processor and includes determining a centroid of k candidate points of a point cloud, k being a predetermined sampling rate of all points of the point cloud, and selecting one of the k candidate points that is closest to the centroid. The method further includes determining a first levels-of-detail (LoD) layer comprising the one of the k candidate points, and a second LoD layer without the one of the k candidate points, and performing coding of attributes of the all points, based on the first LoD layer and the second LoD layer.

Abstract: A method for encoding image signal, according to the present invention, can: encode a partial block coefficient flag indicating whether a coefficient of a current partial block is a non-zero coefficient; encode a first flag indicating whether an absolute value of the coefficient is greater than 1, encode a second flag indicating whether the absolute value of the coefficient is greater than 2; encode the residual coefficients, which have not been encoded, on the basis of the first flag or the second flag in the current partial block; and encode a code for the coefficient of the current partial block.

Abstract: Devices, systems and methods for digital video coding, which includes constructing separate motion candidate lists for video coding, are described. An exemplary method for video processing includes constructing, for a first video block of a video, a first motion candidate list using a first motion candidate list construction method that includes motion candidates that only relate to history-based motion vector prediction (HMVP) candidates, and performing a conversion between the first video block and a bitstream representation of the video including the first video block according to the constructed first motion candidate list.

Abstract: According to the present invention, there is provided a method of decoding an image, the method including: deriving a spatial merge candidate of a current block; generating a first merge candidate list including the spatial merge candidate; obtaining motion information of the current block on the basis of the first merge candidate list; and performing motion compensation on the current block by using the motion information. Herein, when the number of merge candidates included in the first merge candidate list is smaller than the maximum number, at least one merge candidate included in a second merge candidate list is added to the first merge candidate list.

Abstract: Techniques are described for temporal prediction for adaptive loop filter (ALF) in video coding. A video coder may determine that temporal prediction for ALF is enabled for one or more intra coded slices of a picture, determine ALF coefficients for one or more blocks of the one or more intra coded slices, for which the temporal prediction for ALF is enabled, based on ALF coefficients of a previously coded picture or slice, and apply the determined ALF coefficients to the one or more blocks to generate one or more filtered blocks.

Abstract: A method for encoding image signal, according to the present invention, can: encode a partial block coefficient flag indicating whether a coefficient of a current partial block is a non-zero coefficient; encode a first flag indicating whether an absolute value of the coefficient is greater than 1, encode a second flag indicating whether the absolute value of the coefficient is greater than 2; encode the residual coefficients, which have not been encoded, on the basis of the first flag or the second flag in the current partial block; and encode a code for the coefficient of the current partial block.

Abstract: In some embodiments, a method determines a plurality of classes of bins that are used to determine a context model for entropy coding of a current block in a video. The method calculates a first value for a first class of bins in the plurality of classes of bins and calculates a second value for a second class of bins in the plurality of classes of bins. The first value for the first class of bins is weighted by a first weight to generate a weighted first value and the second value for the second class of bins is weighted by a second weight to generate a weighted second value. The method then selects a context model based on the first weighted value and the second weighted value.