Abstract: A method performed by a video decoder includes receiving a coded video bitstream including a current picture, a first reference picture, a second reference picture, and a joint motion vector difference (JMVD) associated with at least one block in the current picture. The method includes determining whether one or more scaling factors are used for an adaptive motion vector difference resolution (AMVD) based JMVD based on a predetermined condition. The method includes, in response to determining the one or more scaling factors are used for the AMVD based JMVD, scaling the JMVD based on the one or more scaling factors. The method includes deriving a first MVD for the first reference picture based on the scaled JMVD. The method includes deriving a second MVD for the second reference picture based on the derived first MVD. The method includes reconstructing the at least one block based on the derived first MVD and the derived second MVD.

Abstract: Aspects of the disclosure provide an optical system that includes a first lens including a first optically transparent member having a first surface and a second surface and a reflective polarizer on the first surface. The first surface of the first lens includes a first region and a second region, the first region of the first surface is smooth and at a center of the first surface, and the second region of the first surface includes a Fresnel structure and surrounds the first region. The reflective polarizer includes a first region and a second region, the first region of the reflective polarizer matches a profile of the first region of the first surface of the first lens, and the second region of the reflective polarizer matches a profile of the second region of the first surface of the first lens.

Abstract: A method is provided. The method includes selecting media content including a full scene description, selecting a 5th generation (5G) media streaming downlink (5GMSd) application server (AS) to stream the media content based on the full scene description, deriving a simplified scene description based on the full scene description, and creating an augmented reality (AR)/mixed reality (MR) session based on the simplified scene description.

Abstract: A method of video decoding performed in a video decoder is disclosed. A first syntax element indicating whether a video is monochrome or includes color components that are encoded separately is generated. A second syntax element that indicates whether joint coding of chroma residuals is enabled based on whether the video is monochrome or includes color components that are encoded separately is generated. Further, a coded video bitstream that includes the first syntax element is generated. The coded video bitstream includes the second syntax element based on whether the video is monochrome or includes color components that are encoded separately. The first syntax element and the second syntax element are different syntax elements.

Abstract: Aspects of the disclosure provide methods and apparatuses for audio processing. In some examples, an apparatus for media processing includes processing circuitry. The processing circuitry receives first six degrees of freedom (6 DoF) information associated with a media content for a scene in a media application. The first 6 DoF information includes a first spatial location and a first rotation orientation for rotation about a center at the first spatial location. The processing circuitry determines that a rendering platform for rendering the media content is a three degrees of freedom (3 DoF) platform; and calculates, a revolution orientation of the media content on a sphere centered other than the first spatial location, according to at least the first spatial location. The revolution orientation is 3 DoF information associated with the media content for rendering on the 3 DoF platform.

Abstract: A technique for encoding video for machine vision and human/machine hybrid vision, including receiving at a hybrid codec, input including at least one of video or image data, the hybrid codec including a first and second codec wherein the first codec is a traditional codec designed for human consumption and the second codec is a learning-based codec designed for machine vision; compressing the input using the first codec, wherein the compressing includes down-sampling the input using a down-sampling module and up-sampling the compressed input using an up-sampling module producing a residual signal; quantizing the residual signal to obtain a quantized representation of the input; entropy encoding the quantized representation of the input using one or more convolutional filter modules; and training one or more networks using the entropy encoded quantized representation.

Abstract: A method for video decoding includes determining, based on prediction information, whether the current block uses a flexible partition type. Reconstructed samples of the reference block are stored in a cache memory, which stores reconstructed samples of coding regions of a first size comprising a coding tree unit (CTU) of the current block and reconstructed samples of at least one coding region of the first size comprising a CTU adjacent to the CTU of the current block. The cache memory stores either (i) only reconstructed samples of the coding regions of the CTU of the current block or (ii) reconstructed samples of coding regions of a second size of the CTU of the current block and reconstructed samples of at least one coding region of the second size of the CTU adjacent to the CTU of the current block.

Abstract: An approach for encoding/decoding video data, performed by at least one processor, including: obtaining video data; parsing the obtained video data into blocks; generating a set of parameters of a current block, the set of parameters including at least block position information, motion vector information, and delta values; storing a subset of parameters included in the set of parameters in association with the current block; selecting a first warp model of the current block based on a subset of parameters; and decoding the video data based on the first warp model.

Abstract: This disclosure relates to improved video coding scheme for zero residual or zero coefficient flags. For example, a method for decoding a current block in a video stream is disclosed. The method may include determining a zero-skip flag of at least one neighboring block of the current block as a reference zero-skip flag; determining a prediction mode for the current block as being either an intra prediction mode or inter prediction mode; deriving at least one context for decoding the zero-skip flag of the current block based on the reference zero-skip flag and the current prediction mode; and decoding the zero-skip flag of the current block according to the at least one context.

Abstract: In a method of processing UV coordinates of a three-dimensional (3D) mesh, the UV coordinates of the 3D mesh are received. The UV coordinates are two-dimensional (2D) texture coordinates that include U coordinates in a first axis and V coordinates in a second axis, and are mapped with vertices of the 3D mesh. The UV coordinates of the 3D mesh are processed based on at least one of a quantization process, a separation process, and a transformation process. The quantization process is configured to convert the UV coordinates into a plurality of indicators. The separation process is configured to separate the UV coordinates into the U coordinates and the V coordinates respectively. The transformation process is configured to convert the UV coordinates from a spatial domain into a transform domain. Compression is performed on the processed UV coordinates after the processing of the UV coordinates.

Abstract: A method of utilizing an 8-bit primary transform core matrix to decode compressed video or image data or encode uncompressed video or image data. The method may include determining whether to use a first transform core matrix that is of a first size type or a second transform core matrix that is of a second size type that is smaller than the first size type. When a result of the determination is to use the first transform core matrix, encoding or decoding the target file using the 8-bit primary transform core matrix that has the size that is 64-point or larger. If not, the method may include extracting the second transform core matrix of the second size type from the first transform matrix and encoding or decoding the target file using the extracted second transform core matrix.

Abstract: A method, computer program, and computer system is provided for signaling output layer sets in a coded video stream. Video data having multiple layers is received. One or more syntax elements are identified. The syntax elements specify one or more output layer sets corresponding to output layers from among the multiple layers of the received video data. The one or more output layers corresponding to the specified output layer sets are decoded and displayed.

Abstract: An apparatus for video decoding includes processing circuitry configured to receive a splitting direction syntax element, a first merge triangle index syntax element, and a second merge triangle index syntax element that are associated with a coding block of a picture. The coding block is coded according to a triangular prediction mode and partitioned into a first prediction unit and a second prediction unit according to a split direction. A first merge index identifies first motion information in a merge candidate list of the coding block. A second merge index identifies second motion information in the merge candidate list of the coding block. The coding block is reconstructed according to first prediction samples of the first prediction unit and second prediction samples of the second prediction unit. A value of the second merge triangle index syntax element is based on the first merge index.

Abstract: Systems and methods for coding and decoding are provided. A method includes encoding a video stream including video data partitioned into a plurality of layers, wherein the encoding includes determining whether a first picture of the video stream is to be output based on a syntax element that indicates a mode of output layer set signaling.

Abstract: Aspects of the disclosure provide a method and an apparatus for video encoding/decoding. The apparatus includes processing circuitry for: receiving prediction information of a current coding block in a current picture from a coded video bitstream, the prediction information indicating that the current coding block is coded using a subblock-based temporal motion vector prediction (SbTMVP) mode; deriving multiple displacement vector (DV) candidates by applying multiple DV offset candidates to a fixed DV predictor of the current coding block; comparing a template of the current coding block with each of multiple templates, each template of the multiple templates being located at a position specified by a corresponding one of the multiple DV candidates; calculating a cost value associated with each one of the multiple DV offset candidates based on the comparing; and reordering DV offset indices of the multiple DV offset candidates based on their calculated cost values.

Abstract: A method, computer system, and computer readable medium are provided for displaying video content. An interface to a presentation engine to enable real-time rendering of a plurality of objects is created whereby the plurality of objects are logically organized together through a plurality of scene graphs, and whereby the plurality of scene graphs is organized a media interchange format. Geometry information of the plurality of scene graphs is updated through the interface to a representation engine. The plurality of objects is streamed based on multi-resolution or multi-tesselation of heterogenous visual geometric objects in each of the scene graphs from among the plurality of scene graphs using the media interchange format.

Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to impement obtaining a dynamic adaptive streaming over HTTP (DASH) video bitstream comprising one or more subpictures, determining whether the one or more subpictures include Versatile Video Coding (VVC) compliant subpictures, in response to the DASH video bitstream including the VVC compliant subpictures, annotating the one or more subpictures based on one or more flags, and manipulating the DASH video stream based on the annotated one or more subpictures.

Abstract: Optimizing media distribution of a media steam performed by at least one processor, is provided, including: receiving immersive media data for an immersive presentation from a content source; acquiring asset information corresponding to media assets in a set of scenes included in the immersive media data; analyzing characteristics of the media assets, from the asset information, used in the set of scenes to determine whether a respective media asset is unique among the media assets; and generating metadata information that uniquely identifies the respective media asset for reusing the respective media asset in the set of scenes, based on determining that the respective media asset is not unique among the media assets in the set of scenes included in the immersive media data for the immersive presentation.

Abstract: A method for streaming scene-based media assets during a media streaming session performed by a computing device is provided. The method includes providing a bi-directional interface for communicating information about scene-based media assets between a network server and the computing device acting as a client device; and providing, to the network server via the interface, client device attributes and corresponding information related to availability of client device resources when requested, wherein the client device attributes and the information are used by the computing device for rendering the scene-based media assets. For example, the computing device receives a request from the network server and then determines whether the requested scene-based media assets is to be streamed from the network server or not by accessing a list of locally stored, previously streamed scene-based media assets.

Abstract: Aspects of the disclosure provide a method and an apparatus for video decoding. The apparatus includes processing circuitry that can determine multiple transform selection (MTS) selection information of a plurality of transform coefficient blocks in a coded video bitstream. The MTS selection information indicates at least one of (i) threshold information or (ii) a plurality of MTS candidate subsets for a transform coefficient block in the plurality of transform coefficient blocks. The processing circuitry can determine which MTS candidate subset in the plurality of MTS candidate subsets is selected for the transform coefficient block based on the MTS selection information and inversely transform the transform coefficient block based on an MTS candidate included in the determined MTS candidate subset.