Abstract: A video encoder maintains a first reference picture list; maintains a second reference picture list; determines that a picture is an instantaneous decoding refresh (IDR) picture; determines that reference picture list syntax elements are present in a slice header for the IDR picture; and in response to determining that the picture is the IDR picture and that the reference picture list syntax elements are present in the slice header for the IDR picture, updates the first reference picture list and the second reference picture list such that no picture in the first reference picture list and no picture in the second reference picture list precedes, in output order or decoding order, any preceding instant random access point (IRAP) picture in decoding order.

Abstract: A method for in-loop sample offset filtering in a video decoder is disclosed. The method includes extracting at least one loop filtering parameter from a coded video bitstream for a reconstructed sample of a first color component in a current picture reconstructed from the coded video bitstream, the at least one loop filtering parameter comprising a flag, and determining based on the flag a type of sample offset filter to be applied to the reconstructed sample of the first color component, the type of sample offset filter being either a predefined sample offset filter type or an encoder-derived sample offset filter type.

Abstract: An apparatus for video decoding includes processing circuitry. The processing circuitry is configured to receive a syntax element in a bit stream indicating a maximum number of merge candidates on a merge candidate list for a set of coding blocks, and receive a merge with motion vector difference (MMVD) flag syntax element in the bit stream indicating that an MMVD mode is used to generate a motion vector predictor of a current block included in the set of coding blocks. The processing circuitry is further configured to infer a base candidate index of the MMVD mode to be a predetermined value when the maximum number of the merge candidates is less than 2.

Abstract: This disclosure relates to video coding and more particularly to techniques for performing deblocking of reconstructed video data. According to an aspect of an invention, a maximum filter length is determined based on whether a P-block or a Q-block has an edge which is perpendicular to a deblocking boundary and whose size is greater than or equal to 32.

Abstract: An image decoding method performed by a decoding device according to the present document is characterized by comprising the steps of: acquiring a block-based delta pulse code modulation (BDPCM) available flag about whether a BDPCM is available for a chroma block and a luma block; acquiring, on the basis of the BDPCM available flag, a BDPCM luma flag about whether to apply the BDPCM to the current luma block; and acquiring, on the basis of the BDPCM available flag, a BDPCM chroma flag about whether to apply the BDPCM to the current chroma blocks.

Abstract: An intra prediction system is provided. The system may determine a coding unit in an image, the coding unit including a plurality of pixels. The system may determine at least one first reference line and at least one second reference line associated with the coding unit. For each of the plurality of pixels in the coding unit, the system may determine a target predicted value of the pixel based on the at least one first reference line and the at least one second reference line according to a prediction mode. The system may determine a predicted coding unit corresponding to the coding unit based on a plurality of target predicted values of the plurality of pixels in the coding unit.

Abstract: The embodiments of the present disclosure provides a method and apparatus for video signal processing. A method for decoding an image signal according to an embodiment of the present disclosure may include determining an input length and an output length of a non-separable transform based on a height and a width of a current block; determining a non-separable transform matrix corresponding to the input length and the output length of a non-separable transform; and applying the non-separable transform matrix to coefficients by a number of the input length in the current block, wherein the height and the width of a current block is greater than or equal to 8, wherein, if each of the height and the width of a current block is equal to 8, the input length of the non-separable transform is determined as 8.

Abstract: Methods, devices and systems for signaling the use of subpictures in coded video pictures are described. One example method of video processing includes performing a conversion between a video and a bitstream of a video, wherein the bitstream conforms to a format rule, wherein the format rule specifies that a first syntax element signaled in a sequence parameter set (SPS) of the bitstream is indicative of a length of identifiers of subpictures in the SPS, and wherein the signaling of the first syntax element is independent of a value of a second syntax element that is indicative of explicit signaling of the identifiers of the subpictures in the SPS or a picture parameter set (PPS).

Abstract: Devices, systems and methods for digital video coding, which includes cross-component prediction, are described. In a representative aspect, a method for video coding includes receiving a bitstream representation of a current block of video data comprising a luma component and a chroma component, determining parameters of a linear model based on a first set of samples that are generated by down-sampling a second set of samples of the luma component, and processing, based on the parameters of the linear model, the bitstream representation to generate the current block.

Abstract: A method includes performing a conversion between a video that includes at least a video tile and a bitstream of the video according to a rule. The rule specifies that a height of a slice in the video tile in units of coding tree units is derived based on a value of a first syntax element in the bitstream indicating a number of explicitly provided slice heights for slices in the video tile that includes the slice.

Abstract: An image decoding method includes a step of deriving a modified transform coefficient, wherein the step of deriving the modified transform coefficient includes the steps of: deriving a first variable indicating whether the transform coefficient exists in an area excluding a DC location of the current block; parsing an LFNST index based on the derivation result; and deriving the modified transform coefficient based on the LFNST index and an LFNST matrix, and based on the fact that the current block is divided into a plurality of sub-partition blocks, the LFNST index can be parsed without deriving the first variable.

Abstract: A method of image compression includes receiving an image. Multiple quantized latent representations are generated to represent features of the image. Each of the quantized latent representations has a different resolution and is generated at staggered timings. Each of the later generated quantized latent representations is conditioned on each of the prior generated quantized latent representations. The multiple quantized latent representations are decoded to reconstruct the image.

Abstract: A video coding mechanism is disclosed. The mechanism includes encoding a coded picture into a bitstream. A current supplemental enhancement information (SEI) message that comprises a decoding unit (DU) hypothetical reference decoder (HRD) parameters present flag (du_hrd_params_present_flag) is also encoded into the bitstream. The du_hrd_params_present_flag specifies whether DU level HRD parameters are present in the bitstream. A set of bitstream conformance tests is performed on the bitstream based on the current SEI message. The bitstream is stored for communication toward a decoder.

Abstract: A system to process imaging data includes an imaging system configured to capture image data and event data of a scene, compress the image data and the event data, and transmit the compressed image data and compressed event data to a host. The host is operatively coupled to the imaging system, and includes a processor configured to perform object detection on the compressed image data and the compressed event data to identify one or more objects. The processor is also configured to perform object tracking on the one or more objects. The processor is also configured to predict one or more regions of interest for subsequent data capture based on the object detection and the object tracking. The processor is further configured to provide the one or more regions of interest to the imaging system to control capture of additional image data and additional event data by the imaging system.

Abstract: A method of video decoding includes acquiring a current and identifying, for a current block included in the current picture, a reference block included in a reference picture that is different from the current picture, where the current block is divided into a plurality of sub-blocks (CBSBs), and the reference block has a plurality of sub-blocks (RBSBs). The method includes, determining whether the reference picture for the RBSB is the current picture, and in response to determining that the reference picture for the RBSB is the current picture, determining a coding mode of the RBSB as an intra mode. The method further includes, in response to determining that the reference picture for the RBSB is not the current picture determining a motion vector predictor for the one of the CBSBs based on whether the coding mode of the corresponding RBSB is one of the intra mode and the inter mode.

Abstract: A client device is communicatively coupled to a platform that distributes live streams over a network to multiple client devices. The live streams provide a live broadcast of a live event from multiple viewpoints captured by source devices including a first source device. A first live stream is provided to the client device, which renders a first viewpoint captured from the first source device. The client device is displays a second viewpoint with a different vantage point by rendering a second live stream of a second source device. The second live stream is delayed for rendering until a beginning of a next scene of the first live stream.

Abstract: An image decoding method performed by a decoding device according to the present disclosure comprises the steps of: receiving a bitstream including prediction information for a current block; deriving a chroma array type for the current block on the basis of a separate color plane flag indicating whether three color components are separately coded and a chroma format index indicating a chroma format sampling structure for the current block, which are included in the prediction information for the current block; deriving prediction samples for the current block on the basis of the derived chroma array type; and deriving reconstructed samples for the current block on the basis of the prediction samples.

Abstract: According to a method for Adaptive Loop Filter (ALF) processing of reconstructed video, multiple indicators are signaled in slice at an encoder side or parsed at a decoder side, where the multiple indicators are Adaptive Parameter Set (APS) indices associated with temporal ALF filter sets for the ALF processing. A current indicator is determined from the multiple indicators, where the current indicator is used to select a current ALF filter set. Filtered-reconstructed pixels are derived for the current block by applying the current ALF filter to the current block. In another method, if the ALF processing applied at a target sample requires an outside sample on other side of a target virtual boundary from the target sample, the outside sample is replaced by a padded sample.

Abstract: Disclosed herein are a video decoding method and apparatus and a video encoding method and apparatus. In video encoding and decoding, inter-prediction information for a target block may be derived, and inter prediction for a target block may be performed using the derived inter-prediction information. Combined inter-prediction information may be performed by combining multiple pieces of inter-prediction information, and the combined inter-prediction information may be added as a candidate to a list used for inter prediction. One of candidates in the list may be selected for inter prediction for the target block, and inter prediction using the selected candidate may be performed.

Abstract: A video decoder for decoding multi-layer video data can be configured to maintain a decoded picture buffer (DPB) for storing reference pictures for a plurality of layers, wherein the plurality of layers comprise at least a first layer and a second layer; prior to decoding a current picture of an access unit of the first layer, perform a picture output and removal process on the DPB, wherein to perform the picture output and removal process on the DPB, the one or more processors are further configured to remove from the DPB only decoded pictures that belong to the first layer; and after removing a last decoding unit of the current picture from a coded picture buffer (CPB), perform a picture bumping process across all layers of the DPB.

Abstract: A method and apparatus of video coding for a video encoding system or video decoding system are disclosed. According to one method, the current block region is partitioned into one or more leaf blocks using quadtree (QT) partition and/or 1D (one-dimensional) partition by firstly signalling or parsing a first syntax element to indicate whether the current block region is split into multiple smaller blocks. According to a second method, a target syntax model from multiple syntax models is determined. The current block region is partitioned into one or more leaf blocks using QT partition and/or 1D partition and signalling block partition information according to the target syntax model at an encoder side, or the block partition information is parsed according to the target syntax model and the current block region is partitioned into one or more leaf blocks at a decoder side.

Abstract: Methods, systems, and apparatuses may encode a media content item based on metadata from previous encoding. The encoding may also generate encoding metadata, which may comprise a qualitative or quantitative characterization of the encoded media content item. A prediction engine may, based on this metadata, determine new encoding settings for the same or a different video resolution. The prediction engine may cause an encoded media content item to be stored and may cause encoding of the media content item using the new encoding settings.

Abstract: Disclosed herein are aspects for altering avatar backgrounds and rendering volumetric avatars in a three-dimensional virtual environment. An aspect begins by receiving, from a first device of a first user, configuration settings specifying how a background of a first user's avatar is to be presented to a second user in the 3D virtual environment. The aspect continues by capturing a video stream of the first user and altering portions of the video stream. The configuration settings and the video stream with the altered background are used to render the first user's avatar. Another aspect begins by receiving configuration settings and a video stream with a background. The aspect continues by rendering a front surface, back surface, and side surface of an avatar based on the configuration settings and video stream.

Abstract: To provide a learning apparatus and an inferring apparatus that can prevent problems such that a computation amount increases, efficiency of a learning process decreases, and an inferring result does not have high accuracy. A learning apparatus and an inferring apparatus include a predictable area determining unit that determines whether target data has a predictable area in which an inferring result of an inferring process can be easily predicted. In the learning apparatus and the inferring apparatus, predetermined data processing is performed on a data area that is determined to be a predictable area, data required to infer an area that is not a predictable area is output to a machine learning model, and data processing is performed in an average time shorter than that of the inferring process.

Abstract: The disclosure provides a sample adaptive offset (SAO) encoder. The SAO encoder includes a statistics collection (SC) block and a rate distortion optimization (RDO) block coupled to the SC block. The SC block receives a set of deblocked pixels and a set of original pixels. The SC block categorizes each deblocked pixel of the set of deblocked pixels in at least one of a plurality of band and edge categories. The SC block estimates an error in each category as difference between a deblocked pixel of the set of deblocked pixels and corresponding original pixel of the set of original pixels. The RDO block determines a set of candidate offsets associated with each category and selects a candidate offset with a minimum RD cost. The minimum RD cost is used by a SAO type block and a decision block to generate final offsets for the SAO encoder.

Abstract: A method of generating an encoded video bitstream, including obtaining an IRAP AU from a video bitstream; determining whether the IRAP AU is a first AU in a decoding order, whether each picture is an IDR picture, or whether each picture is a first picture of a layer following an EOS NAL unit; if so, setting a first flag for the IRAP AU equal to one; if not, determining whether a second flag for the IRAP AU is externally set to an external value; if so, setting the first flag for the IRAP AU equal to the external value; and if not, setting the first flag for the IRAP AU and the second flag for the IRAP AU equal to zero; encoding the video bitstream based on the first flag and the second flag; and transmitting the encoded video bitstream.

Abstract: Methods, devices and systems for signaling the use of subpictures in coded video pictures are described. One example method of video processing includes performing a conversion between a video and a bitstream of a video, wherein the bitstream conforms to a format rule, wherein the format rule specifies that a first syntax element signaled in a sequence parameter set (SPS) of the bitstream is indicative of a length of identifiers of subpictures in the SPS, and wherein the signaling of the first syntax element is independent of a value of a second syntax element that is indicative of explicit signaling of the identifiers of the subpictures in the SPS or a picture parameter set (PPS).

Abstract: A pruning method of neural network based video coding of a current block of a picture of a video sequence is performed by at least one processor and includes categorizing parameters of a neural network into groups, setting a first index to indicate that a first group of the groups is to be pruned, and a second index to indicate that a second group of the groups is not to be pruned, and transmitting, to a decoder, the set first index and the set second index. Based on the transmitted first index and the transmitted second index, the current block is processed using the parameters of which the first group of the groups is pruned.

Abstract: Methods, systems and apparatus for video processing including coding or decoding are described. One example method of video processing includes determining, for a conversion between a video region of a chroma component of a video and a bitstream of the video, a manner of applying a cross-component adaptive loop filtering (CC-ALF) operation to a first sample of the chroma component based on a position of a second sample associated with the first sample. The method also includes performing the conversion based on the determining.

Abstract: The present invention relates to a method and apparatus for video encoding/decoding by using a geometric modified picture. The encoding method according to the present invention includes: generating a geometric modified picture by geometrically modifying a reference picture; and generating a first prediction block of a current block by performing inter prediction referencing the geometric modified picture.

Abstract: A method for for signaling high-level information in image and video coding is provided. A video decoder receives data from a bitstream to be decoded as a current picture of a video. The video decoder parses a picture header of the current picture that includes a set of one or more slice information syntax elements in the picture header for indicating presence of one or more types of slices that are present in the current picture. The video decoder reconstructs the slices of the current picture by using the set of slice information syntax elements.

Abstract: Provided is a method of decoding motion information characterized in that information for determining motion-related information includes spatial information and time information, wherein the spatial information indicates a direction of spatial prediction candidates used for sub-units from among spatial prediction candidates located on a left side and an upper side of a current prediction unit, and the time information indicates a reference prediction unit of a previous picture used for prediction of the current prediction unit. Further, an encoding apparatus or a decoding apparatus capable of performing the above described encoding or decoding method may be provided.

Abstract: Aspects of the disclosure provide methods, apparatuses, and a non-transitory computer-readable storage medium for video encoding and video decoding. An apparatus for video decoding can include processing circuitry. The processing circuitry is configured to decode neural network update information in a coded bitstream for at least one neural network in the video decoder. The at least one neural network is configured with a set of pretrained parameters, and the neural network update information indicates a first modification parameter. The processing circuitry is configured to update the set of pretrained parameters in the at least one neural network in the video decoder based on the first modification parameter. The processing circuitry is configured to decode an encoded image based on the updated at least one neural network.

Abstract: A method and apparatus for adaptively processing video samples in a video signal frame, the video samples being arranged in a Largest Coding Unit. The method comprises extracting a plurality of video samples from the Largest Coding Unit, calculating a correction offset for a first video sample of the extracted plurality of video samples upon the basis of a first value of the first video sample and a second value of a second video sample of the extracted plurality of video samples, and weighting the first video sample with the correction offset.

Abstract: The present invention relates to a method and apparatus for encoding and decoding a video image based on transform. The method for decoding a video includes: determining a transform mode of a current block; inverse-transforming residual data of the current block according to the transform mode of the current block; and rearranging the inverse-transformed residual data of the current block according to the transform mode of the current block, wherein the transform mode includes at least one of SDST (Shuffling Discrete Sine Transform), SDCT (Shuffling Discrete cosine Transform), DST (Discrete Sine Transform) or DCT (Discrete Cosine Transform).

Abstract: An example method of video processing includes performing a conversion between a block of a chroma component of a video and a bitstream representation of the video using a partitioning mode coding tool in which a final prediction of the chroma block is determined by blending predictions of the chroma block using weights that are based on the partitions. During the conversion, the weights are determined based on a type of chroma sample locations in the chroma component of the block.

Abstract: A method of controlling an Adaptive Loop Filter for one or more image portions of an image, the method comprising controlling filtering on a first sample of an image portion based on one or more neighbouring sample value(s) of the first sample value, wherein the controlling uses a nonlinear function which has one or more variables based on one or more of the neighbouring sample value(s).

Abstract: A method and apparatus of for video enhancement based on neural network based loop filtering using meta learning may include receiving reconstructed video data; receiving one or more quality factors associated with the reconstructed video data; determining a neural network based loop filter comprising neural network based loop filter parameters and a plurality of layers, wherein the neural network based loop filter parameters include shared parameters and adaptive parameters; and generating enhanced video data with artefact reduction, based on the one or more quality factors and the reconstructed video data, using a neural network based loop filter, wherein the neural network based loop filter comprises neural network based loop filter parameters that include shared parameters and adaptive parameters.

Abstract: The present invention relates to a method of performing motion compensation by using motion vector prediction. To this end, a method of decoding an image may include: generating multiple motion vector candidate lists according to an inter-prediction direction of a current block; deriving multiple motion vectors for the current block by using the multiple motion vector candidate lists; determining multiple prediction blocks for the current block by using the multiple motion vectors; and obtaining a final prediction block for the current block based on the multiple prediction blocks.

Abstract: Systems and methods for decoding are provided, a method includes: encoding a first sub-picture of a picture, independently from a second sub-picture of the picture, using sub-picture, tile group, and tile partitioning: and sending, to at least one decoder, at least one coded sub-bitstream of a coded video stream that includes the first sub-picture and the second sub-picture, wherein (i) the first sub-picture is a first rectangular region of the picture and the second sub-picture is a second rectangular region of the picture, the second rectangular region being different from the first rectangular region, (ii) the first sub-picture includes a first plurality of tiles, and the second sub-picture includes at least one tile, (iii) the first sub-picture and the second sub-picture do not share a common tile, and (iv) the first plurality of tiles of the first sub-picture are grouped into at least two first tile groups.

Abstract: A method, computer program, and computer system is provided for video coding. Video data comprising a chroma component and a luma component is received. Luma samples are extracted from the luma component of the received video data. The chroma component is filtered by a cross-component adaptive loop filter (CC-ALF) based on a location of a chroma sample associated with the chroma component, the extracted luma samples, filter weights associated with the extracted luma samples, and an offset value.

Abstract: Systems and methods for encoding a plurality of alternative streams of video content using multiple encoders in accordance with embodiments of the invention are disclosed. An encoding system includes multiple encoders. Each of the encoders receives a source stream of video content that is divided into portions. Each of the encoders generates portions of the plurality of alternative streams from the portions of the source stream. The portions of the alternative streams generated by a particular encoder are stored in a container for the particular encoder. Each encoder also generates index information for the portion of the alternative stream generated by the encoder that is stored in a manifest for the encoder.

Abstract: A pruning method of neural network based video coding of a current block of a picture of a video sequence is performed by at least one processor and includes categorizing parameters of a neural network into groups, setting a first index to indicate that a first group of the groups is to be pruned, and a second index to indicate that a second group of the groups is not to be pruned, and transmitting, to a decoder, the set first index and the set second index. Based on the transmitted first index and the transmitted second index, the current block is processed using the parameters of which the first group of the groups is pruned.

Abstract: According to the disclosure of the present document, the resources necessary for an LMCS process may be reduced by limiting the range that an LMCS APS occupies in all APSs. Thus, the degree of complexity in LMCS may be reduced, and video/image coding efficiency may be increased.

Abstract: In one example, a head mounted display system includes at least one memory; and at least one processor to execute instructions to: detect a first position and a first view direction of a head of a user based on sensor data generated by at least one of an accelerometer, at least one camera, or a gyroscope at a first point in time; determine a latency associated with a time to cause an image to be presented on the display; determine a predicted position and a predicted view direction of the head of the user at a second point in time based on the latency; render, prior to the second point in time, the image for presentation on the display based on the predicted position and the predicted view direction of the head of the user; and cause the display to present the rendered image.

Abstract: An example method includes predicting, based on a plurality of color components of a block of video data coded using joint coding of chroma residuals (JCCR), a sign of a coefficient of a plurality of coefficients of a joint residual block of the block of video data; generating, for each respective color component of the plurality of color components and based on the plurality of coefficients of the joint residual block, coefficients of a respective residual block of a plurality of residual blocks; and reconstructing, based on the plurality of residual blocks, the block of video data.

Abstract: In image encoding, to raise the degree of concentration of coefficient energy (concentrate the transform coefficients at low frequencies), there is disclosed the application of a secondary transform different from a primary transform to the transform coefficients after the primary transform. Since the transform coefficients after multiple transforms are applied may be transformed to a different domain than the frequency domain with respect to the original image characteristics, bandwidth control using a scaling list for the frequency domain (quantization matrix) is affected. It is an object to provide a mechanism enabling bandwidth control using a scaling list.

Abstract: A device capable of compressing video data includes a memory configured to store a luma new filter value, a chroma new filter value, a cross component Cb new filter value, and a cross component Cr new filter value. The device may also include one or more processors, coupled to the memory, configured to set a joint constraint on the luma new filter value, the chroma new filter value, the cross component Cb new filter value, and the cross component Cr new filter value, such that each of the luma new filter value, the chroma new filter value, the cross component Cb new filter value, and the cross component Cr new filter value are not disabled in a unit associated with an adaptation parameter set having a first adaptation parameter set identification (APS ID).

Abstract: An intra-prediction method includes: determining, by an intra-prediction apparatus, a directional intra-prediction mode for a rectangular video coding block from an extended set of directional intra-prediction modes, wherein the extended set of directional intra-prediction modes includes extended directional intra-prediction modes and conventional directional intra-prediction modes and determining, by the intra-prediction apparatus, a plurality of available reference samples based on a direction of the directional intra-prediction mode. The method further includes: intra-predicting, by the intra-prediction apparatus, pixel values of pixels of the rectangular video coding block based on the plurality of available reference samples.

Abstract: A display device includes a first display layer including display elements disposed on an object; a power supply that supplies a power signal to the display elements; and a signal controller having an encoder that encodes first image data into second image data and that supplies it to the display elements. Each display element includes a base member; a pixel a driving circuit unit having a decoder that decodes the second image data into the first image data and that provides a pixel driving signal to the pixel; a first antenna unit that receives the power signal and that provides the power signal to the driving circuit unit; a second antenna unit that receives the second image data and that provides the second image data to the decoder; and a third antenna unit that transmits and receives an addressing signal for detecting a relative position between the display elements.