Abstract: Methods, systems, and bitstream syntax are described for inter-frame coding using end-to-end neural networks used in image and video compression. Inter-frame coding methods include one or more of: joint luma-chroma motion compensation for YUV pictures, joint luma-chroma residual coding for YUV pictures, using attention layers, enabling temporal motion prediction networks for motion vector prediction, using a cross-domain network which combines motion vector and residue information for motion vectors decoding, using the cross-domain network for decoding residuals, using weighted motion-compensated inter prediction, and using temporal only, spatial only, or both temporal and spatial features in entropy decoding. Methods to improve training of neural networks for inter-frame coding are also described.

Abstract: In an example, a method for delivering a multimedia data stream includes determining a frequency for generating one or more repair packets and a placement for positioning the one or more repair packets in the multimedia data stream based on a configuration parameter related to the multimedia data stream. The frequency and the placement may be determined based on a priority derived from a multimedia delivery use-case. Further, the method includes generating the one or more repair packets by network coding source packets of the multimedia data stream based on the determined frequency and the placement and transmitting the network coded multimedia data stream with the repair packets to a receiving device.

Abstract: Methods, systems, and bitstream syntax are described for the entropy modeling of latent features in image and video coding using a combination of probability density functions. Using high-level syntax elements, an encoder may signal to compliant decoders the multi-distribution entropy model using: the number of one or more PDFs being used, an identifier of each PDF being used among a list of available PDFs, the number of PDF parameters in each PDF, and syntax elements indicating which PDF parameters across two or more PDFs being used are being shared.

Abstract: In an example, a method for delivering a multimedia data stream includes determining a frequency for generating one or more repair packets and a placement for positioning the one or more repair packets in the multimedia data stream based on a configuration parameter related to the multimedia data stream. The frequency and the placement may be determined based on a priority derived from a multimedia delivery use-case. Further, the method includes generating the one or more repair packets by network coding source packets of the multimedia data stream based on the determined frequency and the placement and transmitting the network coded multimedia data stream with the repair packets to a receiving device.

Abstract: Methods, systems, and bitstream syntax are described for the fusion of latent features in multi-level, end-to-end, neural networks used in image and video compression. The fused architecture may be static or dynamic based on image characteristics (e.g., natural images versus screen content images) or other coding parameters, such as bitrate constrains or rate-distortion optimization. A variety of multi-level fusion architectures are discussed.

Abstract: Methods, systems, and bitstream syntax are described for the entropy modeling of latent features in image and video coding using a combination of probability density functions. Using high-level syntax elements, an encoder may signal to compliant decoders the multi-distribution entropy model using: the number of one or more PDFs being used, an identifier of each PDF being used among a list of available PDFs, the number of PDF parameters in each PDF, and syntax elements indicating which PDF parameters across two or more PDFs being used are being shared.

Abstract: Systems and methods for processing an image to determine whether segments of the image belong to an object class are disclosed.

Abstract: Systems and methods for processing an image to determine whether segments of the image belong to an object class are disclosed.