Abstract: A residual coding method is provided. The method comprises: when the current frame is an inter-frame prediction frame, determining whether a residual of a background region in the current frame needs to be compensated for; and when the residual of the background region in the current frame needs to be compensated for, coding first residual data, and when the residual of the background region in the current frame does not need to be compensated for, coding second residual data, wherein the first residual data is residual data of an entire image of the current frame, and the second residual data is residual data of a target region in the current frame. The present disclosure further provides a video coding method using the residual coding method, and corresponding devices and a storage medium.

Abstract: A video coding method includes the following. A bitstream is decoded to obtain a feature map of a target object in a current picture. The feature map of the target object in the current picture is input to a visual task network and a prediction result output by the visual task network is obtained.

Abstract: Disclosed are a point cloud compression method, an encoder, a decoder, and a storage medium. In the method, the current block of a video to be encoded is obtained; geometric information of point cloud data of the current block and corresponding attribute information are determined; down-sampling is performed on the geometric information and the corresponding attribute information by using a sparse convolutional network so as to obtain hidden layer features; and the hidden layer features is compressed to obtain a compressed code stream.

Abstract: In a collaborative video processing method and system, a high resolution video input is optionally downscaled to a low resolution video using a down-sampling filter, followed by an end-to-end video coding system to encode the low resolution video for streaming over the Internet. The original high resolution is obtained at the client end by upscaling the low resolution video using a deep learning based high resolution scaling model, which can be trained in a pre-defined progressive order with low resolution videos having different compression parameters and downscaling factors.

Abstract: Interactive-streaming-based applications, such as cloud gaming, giga-pixel streaming and virtual reality, have rigorous requirements on the network latency, which can be satisfied by routing users' requests over an overlay network. Existing overlay routing strategies suffer from high deployment and maintenance costs. An optimized cloud overlay routing system and method is discussed herein, which maximizes the number of user requests for the interactive-streaming-based applications to be served, lower the deployment and maintenance costs for the overlay services, reduce the overall network delay, and balance the network loads by bypassing busy underlay links.

Abstract: This invention discloses a deep reinforcement learning based adaptive bitrate selection method and system for real-time streaming, where deep reinforcement learning neural networks are utilized to receive states observations and make bitrate decisions. Simulation is constructed to provide network states including network QoS and playback status to agents and compute accumulated rewards according to the bitrate actions made by agents. ARS balances a variety of QoE goals to determine the accumulated rewards. ARS also enables multiple agents to be trained concurrently and conducts training process in a simulation environment to accelerate the training speed. In addition, ARS supports training ABR algorithm both online and offline.

Abstract: A learned image compression system increases compression efficiency by using a novel conditional context model with embedded autoregressive neighbors and hyperpriors, which can accurately estimate the entropy rate for rate distortion optimization. Generalized Divisive Normalization (GDN) in Residual Neural Network is used in the encoder and decoder networks for fast convergence rate and efficient feature representation.

Abstract: An apparatus and method for screen content encoding includes deriving a palette table and a color index map based on a coding unit (CU). The method also includes encoding the palette table and encoding the color index map. The method further includes combining the encoded palette table and the encoded color index map for transmission to a receiver, where the palette table and index map are decoded to reconstruct a pixel block.

Abstract: A method and device for coding screen content into a bitstream by selecting a color palette table for a coding unit (CU) of screen content, creating a color index map having indices for the coding unit (CU), and encoding the selected color palette table and the color index map for the CU into a bitstream.

Abstract: A method and apparatus for use of input messages in the media transport to support and improve the interactive communication between a media content server and an end user is disclosed. In one embodiment, the input message is encapsulated into any existing media transport protocol. In another embodiment, several types of the input messages are defined to deliver information and requests relating to interactions between the end user and the media content server.

Abstract: A method and apparatus for the single input multiple output based media adaptation is disclosed. In one embodiment, such adaption is performed in two steps. On step 1, content correlation between different compression schemes is used to perform the inter-format adaptation of a stream of a compression format to an intermediate output stream of another compression scheme with the same quality level. On step 2, content correlation between different quality levels is used to perform the intra-format adaptation of the intermediate output stream to multiple output streams at different quality levels with the same compression format. In one embodiment, content correlation is used to limit the search for mode candidates when performing both steps.

Abstract: An apparatus is configured to perform a method for screen content encoding. The method includes deriving a palette table and a color index map based on a coding unit (CU). The method also includes encoding the palette table and encoding the color index map. The method further includes combining the encoded palette table and the encoded color index map for transmission to a receiver, where the palette table and index map are decoded to reconstruct a pixel block.

Abstract: An encoding apparatus and coding methods. The method includes receiving a video frame including screen content, generating a block containing an index map of colors for screen content in the video frame, wherein the block includes strings of index values, encoding one or multiple consecutive index values in a first string of index values using same escape colors index values and a run value identifying how many of the same escape color index values have been consecutively encoded, where the escape colors index values represent escape colors, and where the escape colors are colors not included in a palette corresponding to the block, sequentially encoding the escape colors corresponding to the one or multiple consecutive index values after all of the strings of index values of the block have been encoded, and transmitting the strings of index values and the escape colors in a bitstream to a decoding apparatus.

Abstract: Apparatus and methods for a Motion Picture Experts Group (MPEG) media transport (MMT) device for sending or receiving media content is provided. The MMT device comprises a memory unit and a controller. The controller is configured to measure an available bandwidth, receive fragments of a first encoded stream of the media content and fragments of a second encoded stream of the same media content based on the available bandwidth and a current transmission bandwidth. A mixed encoded stream comprises the fragments received from the first encoded stream and the fragments received from the second encoded stream.

Abstract: A method includes calculating a complexity value for each segment or version of multimedia content. The multimedia content has multiple versions associated with common content and different encoding parameters, and each version is divided into segments. The method also includes adaptively streaming the multimedia content to a client device based on at least some of the calculated complexity values. The complexity value for each segment or version is calculated by summing multiple operation complexity values defining complexities of operations for decoding the segment or version. The operation complexity values could include values for a bit parsing operation, a buffer initialization operation, an intra-prediction operation, an inverse quantization and transform operation, a reference block fetch operation, a fractional interpolation operation, and in-loop deblocking operation, a sample adaptive offset correction operation, an adaptive loop filtering operation, and a de-ringing filtering operation.

Abstract: An encoding apparatus and coding methods. The method includes receiving a video frame including screen content, generating a block containing an index map of colors for screen content in the video frame, wherein the block includes strings of index values, encoding one or multiple consecutive index values in a first string of index values using same escape colors index values and a run value identifying how many of the same escape color index values have been consecutively encoded, where the escape colors index values represent escape colors, and where the escape colors are colors not included in a palette corresponding to the block, sequentially encoding the escape colors corresponding to the one or multiple consecutive index values after all of the strings of index values of the block have been encoded, and transmitting the strings of index values and the escape colors in a bitstream to a decoding apparatus.

Abstract: Presented systems and methods facilitate screen content coding. A system can comprises: a processing component configured to execute coding operations and a storage component configured to store information for the processing component, including the color table and color index map. The coding operations can include: receiving information associated with a plurality of pixels; creating a color table, the color table includes color values (e.g., of the pixels) and corresponding indices; creating a color index map wherein each index of the color map maps a pixel to an index value of the color table; and performing coding operations corresponding to the color table and color index map. In one exemplary implementation, index values of the color table are encoded/decoded during color table and index map coding rather than the actual raw color values for each pixel. Various types of compression and coding can be implemented (e.g., lossless, lossy, intra-prediction, inter-prediction, etc.).

Abstract: An encoding apparatus, decoding apparatus, and coding methods. The encoding apparatus includes a processor configured to receive a video frame including screen content, generate a block containing an index map of colors for screen content in the video frame, wherein the block includes strings of index values sharing a same escape color index value, wherein the escape color index value represents an escape color, encode each of the strings of index values in the block, and sequentially encode the escape colors after each of the strings of index values in the block has been encoded. A transmitter operably coupled to the processor is configured to transmit the strings of index values and the escape colors in a bitstream to a decoding apparatus.

Abstract: Methods and apparatus are provided for motion compensation with a smooth reference frame in bit depth scalability. An apparatus includes an encoder for encoding picture data for at least a portion of a picture by generating an inter-layer residue prediction for the portion using an inverse tone mapping operation performed in the pixel domain for bit depth scalability. The inverse tone mapping operation is shifted from a residue domain to the pixel domain.

Abstract: A video decoder performs a method of dynamic voltage/frequency scaling (DVFS) for video processing. The method includes parsing a bitstream associated with a video to determine embedded information associated with a complexity of a first portion of the video, estimating the complexity of the first portion of the video using the embedded information, determining a voltage and frequency to be used for decoding the first portion of the video based on the estimated complexity, and decoding the first portion of the video at the determined voltage and frequency.