Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for processing media streams. An apparatus includes processing circuitry that sends a message to a media aware network element that is configured to process a plurality of audio streams of a conference call. The message indicates that the plurality of audio streams is to be down mixed by the media aware network element. The processing circuitry receives the down mixed plurality of audio streams from the media aware network element and decodes the down mixed plurality of audio streams to receive the conference call.

Abstract: A method includes determining whether at least one of a height or width of a residual coding block, that corresponds to a data block of an image, is greater than or equal to a threshold; and based on determining that the at least one of the height or width of the residual coding block is greater than or equal to the threshold: obtaining a reduced-complexity residual coding block based on the residual coding block and performing transform coding of the reduced-complexity residual coding block using a line graph transform (LGT) core to perform direct matrix multiplications for each of the horizontal and vertical dimensions of the reduced-complexity residual coding block, wherein the performing includes determining an order of performing horizontal and vertical transforms to the reduced-complexity residual coding block when zero-out is enabled on LGT, depending on a ratio of width to height of the residual coding block.

Abstract: A method of utilizing an N-point primary transform core matrix to encode may include determining whether to use a first transform core matrix that is an N-point 8-bit primary transform core matrix. When a result of the determination is to use the first transform core matrix, the method may include: (i) constructing the first transform core based on a set of unique numbers, and (ii) encoding using the derived primary transform core. The method may further include, when a result of the determination is to not use the first primary transform: (i) deriving a second transform core based on the same set of unique numbers, and (ii) encoding using the derived second transform core.

Abstract: A method, computer program, and computer system is provided for coding video data. Video data is received, and a set of hybrid transform kernels corresponding to the video data is identified. A subset of hybrid transform kernels is selected, either explicitly or implicitly, from among the set of hybrid transform kernels. The video data is decoded based on the selected subset of hybrid transform kernels.

Abstract: There is includes a method and apparatus comprising computer code configured to cause a hardware processor or processors to perform intra prediction among a plurality of reference lines, to set a plurality of intra prediction modes for a zero reference line nearest to a current block of the intra prediction among non-zero reference lines, and to set one or more most probable modes for one of the non-zero reference lines.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. For example, the processing circuitry decodes prediction information of a current block in a current coding tree unit (CTU) from a coded video bitstream. The prediction information is indicative of an intra block copy mode. A size of the current CTU is smaller than a maximum size of a reference sample memory for storing reconstructed samples. The processing circuitry determines a block vector that points to a reference block in a same picture as the current block. The reference block has reconstructed samples buffered in the reference sample memory. Then, the processing circuitry reconstructs at least a sample of the current block based on the reconstructed samples of the reference block that are retrieved from the reference sample memory.

Abstract: A method of acoustic echo suppression using a recurrent neural network, performed by at least one processor, is provided. The method includes receiving a microphone signal and a far-end reference signal, estimating an echo suppressed signal and an echo signal based on the microphone signal and the far-end reference signal, estimating enhancement filters for the microphone signal based on the echo suppressed signal and the echo signal, generating an enhanced signal based on the enhancement filters, and adjusting the enhanced signal using automatic gain control (AGC) and outputting the adjusted signal.

Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform acquiring an input bitstream comprising metadata and video data, decoding the video data, determining whether the metadata comprises at least one flag signaling at least one component of a picture size of at least one picture of the video data, and signaling, in a case where it is determined that the metadata comprises the at least one flag, a display device to display the at least one picture from the video data according to the at least one flag.

Abstract: A method, computer program, and computer system is provided for coding video data. Video data including a reference view and a current view is received. A co-located block in the reference view is identified for a current block in the current view. A predicted block vector is calculated based on an offset vector between the current block and the co-located block, and a disparity vector between the co-located block and the reference block in the reference view. The video data is encoded/decoded based on the calculated predicted block vector.

Abstract: A method, computer program, and computer system is provided for video coding. Video data comprising a reference frame and residual blocks is received. Transform coefficients associated with the residual blocks are identified. The video data corresponding to the one or more residual blocks is encoded based on an extended dynamic range associated with the transform coefficients.

Abstract: This disclosure generally relates to media application development and deployment using an NBMP system. More specifically, this disclosure describes methods and apparatuses for instance level configuration of functions used in NBMP workflows. Example mechanisms are provided for configuring different instances of a same function in various tasks in a media processing workflow with customized configurations and restrictions based on a format of a general configuration descriptor of the function.

Abstract: Processing circuitry receives, from a coded video bitstream, a first flag for a current block of an affine mode in a current picture, the first flag is associated with a first reference picture. The first flag indicates whether one or more motion vector differences of a reduced counting number are signaled. The reduced counting number is smaller than a number of first control points in a first affine model associated with the first reference picture. The processing circuitry decodes the one or more motion vector differences of the reduced counting number from the coded video bitstream in response to the first flag indicating the reduced counting number. The processing circuitry determines first control point motion vectors for the first control points in the first affine model according to the one or more motion vector differences of the reduced counting number, and reconstructs the current block accordingly.

Abstract: Methods and apparatuses for performing cross-component intra prediction, including: receiving a current chroma block from a coded bitstream; determining, from the coded bitstream, that a scaling factor used for the current chroma block in a chroma for luma (CfL) intra prediction mode; deriving a predicted scaling factor based on first neighboring samples of the current chroma block and second neighboring samples of a luma block that is co-located with the current chroma block; using the predicted scaling factor as the scaling factor used for the current chroma block in the CfL intra prediction mode; reconstructing the current chroma block after scaling the current chroma block based on the predicted scaling factor.

Abstract: A method, computer program, and computer system is provided for an all-deep-learning based AEC system by recurrent neural networks. The model consists of two stages, echo estimation stage and echo suppression stage, respectively. Two different schemes for echo estimation are presented herein: linear echo estimation by multi-tap filtering on far-end reference signal and non-linear echo estimation by single-tap masking on microphone signal. A microphone signal waveform and a far-end reference signal waveform are received. An echo signal waveform is estimated based on the microphone signal waveform and a far-end reference signal waveform. A near-end speech signal waveform is output based on subtracting the estimated echo signal waveform from the microphone signal waveform, and echoes are suppressed within the near-end speech signal waveform.

Abstract: Method, device, and non-transitory storage medium for interleaved motion vector prediction (MVP) for video coding are provided. A MVP candidate list for a current block may be generated based on spatial motion vectors associated with neighboring blocks and non-neighboring blocks. A first spatial motion vector predictor (SMVP) associated with an adjacent neighboring block to the left of the current block may be inserted into the MVP candidate list, and a second SMVP associated with an adjacent neighboring block to the top of the current block may be inserted into the MVP candidate list. One or more candidates in the MVP candidate list may be pruned based on determining that the one or more candidates have a same SMVP.

Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform controlling a delivery of a video conference call to a viewport, setting an event-based threshold with respect to the video conference call, determining whether the event-based threshold has been triggered based on an event and whether an amount of time having elapsed from another event is less than a predetermined amount of time, and further controlling the delivery of the video conference call to the viewport based on determining whether the event-based threshold has been triggered and whether the amount of time having elapsed from the other event is less than the predetermined amount of time.

Abstract: Methods, apparatus, and computer readable storage medium for intra bi-prediction and multiple reference line intra prediction in video decoding. The method includes receiving, by a device, a coded video bitstream for a block. The method also includes determining, by the device, whether a single directional intra prediction or an intra bi-prediction applies to the block, based on mode information of the block, the mode information of the block comprising at least one of: a reference line index of the block, an intra prediction mode of the block, and a size of the block; in response to determining that the single directional intra prediction applies to the block, performing, by the device, the single directional intra prediction to the block; and in response to determining that the intra bi-prediction applies to the block, performing, by the device, the intra bi-prediction to the block.

Abstract: Aspects of the disclosure provide methods and apparatuses for cloud gaming. In some examples, an apparatus for cloud gaming includes processing circuitry. For example, the processing circuitry receives a video sequence and metadata associated with the video sequence. The video sequence includes a sequence of picture frames generated in response to gaming control information, and the metadata is determined based on the gaming control information. The processing circuitry can determine, based on the metadata, an encoding configuration for encoding the video sequence. Then the processing circuitry encodes, based on the encoding configuration, the video sequence into a coded video bitstream.

Abstract: Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. In a method, whether an adaptive color transform (ACT) is enabled for a current block is determined. A maximum transform size is determined based on whether the ACT is enabled for the current block. Whether a subblock transform (SBT) is applied to the current block is determined based at least on the maximum transform size. Further, the SBT is performed on the current block based on the SBT being determined to be applied to the current block.

Abstract: A method and apparatus may be provided for building a linear media source extension (MSE) buffer from two or more nonlinear media sources using MPD chaining. The method may include parsing at least one obtained media presentation segment (MPD), and obtain a live MPD based on the at least one URL, the live MPD comprising one or more live media segments. The method may include appending the one or more ad media segments to a first MSE source buffer based on a first timing model and chaining the one or more live media segments to the one or more ad media segments by appending the one or more live media segments to the first buffer based on a second timing model. The one or more ad media segments may be dispatched and the one or more live media segments based on the first timing model and the second timing model.