Abstract: A processing circuitry decodes a plurality of maps in 2D from a bitstream carrying a mesh frame. The mesh frame represents a surface of an object with polygons. The plurality of maps includes a decoded geometry map and a decoded attribute map with an adaptive 2D atlas sampling applied. The processing circuitry determines at least a first sampling rate and a second sampling rate according to syntaxes signaled in the bitstream. The first sampling rate is applied to a first region of the mesh frame and the second sampling rate is applied to a second region of the mesh frame during the adaptive 2D atlas sampling. The processing circuitry reconstructs, based on the plurality of maps, at least a first vertex of the mesh frame according to the first sampling rate, and a second vertex of the mesh frame according to the second sampling rate.

Abstract: A method of decoding or encoding including receiving information regarding a video sequence for encoding or decoding, determining, for the encoding or decoding of the video sequence, whether to use a first transform core matrix that is of a first size type or a second transform core matrix that is of a second size type, and based on the determining, transmitting information that causes the video sequence to be encoded or decoded using the determined first transform core matrix or second transform core matrix.

Abstract: Coding information of a mesh is received. The coding information includes a plurality of first coordinates and a plurality of second coordinates corresponding to a plurality of vertices and a texture map that are associated with the mesh. A respective first coordinate and a respective second coordinate associated with each of the plurality of vertices are normalized by adjusting the respective first coordinate based on a first factor and the respective second coordinate based on a second factor. The first factor and the second factor are associated with at least one of (i) a bit depth value indicating a coded range of the first coordinates and the second coordinates and (ii) a size of the texture map. The normalized respective first coordinate and the normalized respective second coordinate are expanded based on the first factor and the second factor respectively.

Abstract: This disclosure relates generally to video coding and particularly to methods and systems for determination of temporal motion vector predictor (TMVP) candidates for inter-prediction in video coding. The disclosed methods, for example, include restricting the number of TMVP candidates in a motion vector predictor (MVP) list and provide various search mechanism in order to promote MVP candidate diversity among TMVP and other types of MVP candidates and to improve coding efficiency.

Abstract: A method of video decoding in a decoder is provided. A first template magnitude of a first transform coefficient in a specific frequency region of the transform block is determined. The first template magnitude is a first single value representing magnitudes of a first local template of the first transform coefficient. A first context model is identified for coding the syntax element of the first transform coefficient, the first context model being shared with at least a second transform coefficient in the specific frequency region of the transform block, a second template magnitude of the second transform coefficient having a second single value that belongs to a first subinterval. A first bin of the syntax element of the first transform coefficient and a second bin of the syntax element of the second transform coefficient is determined, from the coded bits, based on the first context model.

Abstract: Aspects of the disclosure provide a method and an apparatus for video encoding. The apparatus includes processing circuitry configured to generate an initial feature representation from an input image to be encoded and perform an iterative update of values of a plurality of elements in the initial feature representation. The iterative update includes generate a coded representation corresponding to a final feature representation based on the final feature representation that has been updated from the initial feature representation by a number of iterations of the iterative update. A reconstructed image corresponding to the final feature representation is generated based on the coded representation. An encoded image corresponding to the final feature representation having updated values of the plurality of elements is generated. One of (i) a rate-distortion loss corresponding to the final feature representation or (ii) the number of iterations of the iterative update satisfies a pre-determined condition.

Abstract: There is includes a method and apparatus comprising computer code configured to cause a hardware processor or processors to perform intra prediction among a plurality of reference lines, to set a plurality of intra prediction modes for a zero reference line nearest to a current block of the intra prediction among non-zero reference lines, and to set one or more most probable modes for one of the non-zero reference lines.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. Processing circuitry decodes prediction information of a block from a coded video bitstream. The prediction information is indicative of a matrix based intra prediction for the block. The processing circuitry determines entries of a vector based on neighboring samples of the block. An entry can be determined based on one or more neighboring samples of the block. The processing circuitry converts the entries into a reduced bit form with a number of bits satisfying a requirement of using a first multiplication tool that processes fewer bits than a second multiplication tool. Then, the processing circuitry multiplies, using the first multiplication tool, the entries of the vector in the reduced bit form with entries of a matrix to calculate a subset of prediction samples of the block, and determines other prediction samples of the block based on the subset.

Abstract: End-to-end neural image compression using deep reinforcement learning (DRL) is performed by at least one processor and includes encoding an input, generating encoded representations of the input, generating a set of quantization keys using a first neural network, based on a set of previous quantization states, wherein each quantization key in the set of quantization keys and each previous quantization state in the set of previous quantization states correspond to the encoded representations of the input, generating a set of dequantized numbers representing dequantized representations of the encoded representations of the input, based on the set of quantization keys, using a second neural network, and generating a reconstructed output, based on the set of dequantized numbers.

Abstract: A method and apparatus for performing a frequency-dependent joint component secondary transform (FD-JCST). The method includes obtaining a plurality of transform coefficients in a transform coefficient block; determining whether at least one of the plurality of transform coefficients is a low-frequency coefficient; based on determining that the at least one of the plurality of transform coefficients is the low-frequency coefficient, determining whether the low-frequency coefficient is a non-zero value; and based on determining that the low-frequency coefficient is the non-zero value, performing a joint component secondary transform (JCST) on the low-frequency coefficient and signaling a related syntax to indicate that the JCST is performed.

Abstract: Methods and apparatuses for video encoding/decoding are provided. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry decodes prediction information of a current block in a current picture from a coded video bitstream. The prediction information is indicative of an inter prediction mode. Then, the processing circuitry determines a usage of a first DMVD process on the current block at least partially based on a second DMVD process not being used on the current block. Further, the processing circuitry reconstructs the current block according to the inter prediction mode with the first DMVD process.

Abstract: Methods, apparatus, and computer readable storage medium for intra prediction mode coding in video decoding. The method includes receiving, by a device, a coded video bitstream for a block. The device includes a memory storing instructions and a processor in communication with the memory. The method also includes dividing, by the device, a list of intra modes into a plurality of intra mode sets for the block based on mode information of each intra mode in the list, the list of intra modes corresponding to an intra prediction mode of at least one neighboring block of the block; extracting, by the device from the coded video bitstream, a set index indicating an intra mode set from the plurality of intra mode sets; extracting, by the device from the coded video bitstream, a mode index indicating an intra prediction mode from the intra mode set; and determining, by the device, the intra prediction mode for the block based on the set index and the mode index.

Abstract: A method of encoding video data corresponding to a point cloud by at least one processor, the method including obtaining a plurality of transform coefficients corresponding to attributes of the point cloud; and encoding the plurality of transform coefficients to generate an embedded bitstream, the encoding including iterating over a plurality of bit-planes of the plurality of transform coefficients to process all points in the point cloud.

Abstract: A method of adaptive neural image compression with rate control by meta-learning includes receiving an input image and a hyperparameter; and encoding the received input image, based on the received hyperparameter, using an encoding neural network, to generate a compressed representation. The encoding includes performing a first shared encoding on the received input image, using a first shared encoding layer having first shared encoding parameters, performing a first adaptive encoding on the received input image, using a first adaptive encoding layer having first adaptive encoding parameters, combining the first shared encoded input image and the first adaptive encoded input image, to generate a first combined output, and performing a second shared encoding on the first combined output, using a second shared encoding layer having second shared encoding parameters.

Abstract: Aspects of the disclosure provide a method and an apparatus for video decoding. The apparatus includes processing circuitry receiving prediction information of a plurality of blocks in a current picture from a coded video bitstream. The processing circuitry determines, based on the prediction information, whether at least one of a decoder-side motion vector refinement (DMVR) mode or a bi-directional optical flow (BDOF) mode is allowed for the plurality of blocks. If the DMVR mode or the BDOF mode is allowed for the plurality of blocks, the processing circuitry determines that a plurality of merge with motion vector difference (MMVD) merge flags indicating whether a MMVD mode is applied to the plurality of blocks, respectively, is inferred as false for the plurality of blocks. If the plurality of MMVD merge flags is inferred as false, the processing circuitry reconstructs each block in the plurality of blocks without applying the MMVD mode.

Abstract: A method of utilizing an 8-bit primary transform core matrix to decode compressed video or image data or encode uncompressed video or image data. The method may include determining whether to use a first transform core matrix that is of a first size type or a second transform core matrix that is of a second size type that is smaller than the first size type. When a result of the determination is to use the first transform core matrix, encoding or decoding the target file using the 8-bit primary transform core matrix that has the size that is 64-point or larger. If not, the method may include extracting the second transform core matrix of the second size type from the first transform matrix and encoding or decoding the target file using the extracted second transform core matrix.

Abstract: A method and apparatus that renders a mesh from one or more virtual camera views of an object, the one or more virtual camera views being projections of the mesh onto a plurality of 2D planes; inputs the one or more virtual camera views into a fully-convolutional model for real-time segmentation; generates one or more 2D pixel-wise masks based on the fully-convolutional model, the 2D pixel-wise masks being associated with one or more segmented elements; performs remeshing and mesh optimization using the one or more 2D pixel-wise masks; and generates an output mesh based on the remeshing and mesh optimization.

Abstract: Aspects of the disclosure provide methods and apparatuses for point cloud processing. In some examples, an apparatus for point cloud processing includes processing circuitry. For example, the processing circuitry obtains point cloud data corresponding to a point cloud in a three dimensional (3D) space, projects the point cloud in the 3D space to one or more two dimensional (2D) planes to generate one or more images. The processing circuitry generates a pixel wise mask for object instances in the point cloud according to the one or more images. The pixel wise mask includes first pixels that are associated with a first object instance in the point cloud. The processing circuitry processes the point cloud based on the pixel wise mask, a portion of the point cloud corresponding the first pixels in the pixel wise mask is processed based on one or more processing parameters determined for the first object instance.

Abstract: Provided herein are multispecific antigen binding proteins (ABPs). Also provided herein are multispecific ABPs that are engineered to form diabodies or stay in extended (dual scFv) conformation and methods for purifying ABPs based on avidity.

Abstract: A method and apparatus comprising computer code configured to cause a processor or processors to obtain a mesh sequence comprising a plurality of meshes corresponding to volumetric data of at least one three-dimensional (3D) visual content, obtain a frame of the mesh sequence corresponding to the volumetric data, the frame including a plurality of vertices of a mesh of the mesh sequence, determine a motion field comprising motion vectors of the plurality of vertices of the mesh, and encode the volumetric data based on the motion field.