Abstract: A system for low latency broadcast of animation frames includes a frame extractor stored in memory and executable to access frame data generated by a rendering pipeline of a frame generation engine. During runtime of the frame generation engine, the frame extractor exports the frame data for use external to the frame generation engine.

Abstract: Adaptive verifiable training enables the creation of machine learning models robust with respect to multiple robustness criteria. In general, such training exploits inherent inter-class similarities within input data and enforces multiple robustness criteria based on this information. In particular, the approach exploits pairwise class similarity and improves the performance of a robust model by relaxing robustness constraints for similar classes and increasing robustness constraints for dissimilar classes. Between similar classes, looser robustness criteria (i.e., smaller ?) are enforced so as to minimize possible overlap when estimating the robustness region during verification. Between dissimilar classes, stricter robustness regions (i.e., larger ?) are enforced. If pairwise class relationships are not available initially, preferably they are generated by receiving a pre-trained classifier and then applying a clustering algorithm (e.g., agglomerative clustering) to generate them.

Abstract: A video processing method includes performing a conversion between a video including a video unit and a coded representation of the video, where, after the video unit is encoded or decoded with an intra prediction mode, one or more frequence tables and/or one or more sorted intra prediction mode (IPM) tables are selectively updated according to a rule, where the one or more frequence tables include information about frequence of the intra prediction mode used for processing the video unit in the conversion, where the frequence indicates an occurrence of the intra prediction mode used for the conversion, and where the one or more sorted IPM tables indicate the intra prediction mode used in the processing.

Abstract: A video processing method includes performing a conversion between a video including a video unit and a coded representation of the video, where, upon processing the video unit in the conversion, one or more frequence tables are selectively updated to include information about frequence of one or more intra prediction modes of the video unit used in the processing, where the frequence indicates an occurrence of the one or more intra prediction modes used for the conversion, and where, upon processing the video unit, one or more sorted intra prediction mode (IPM) tables are selectively updated to indicate the one or more intra prediction modes used in the processing.

Abstract: A video processing method includes performing a conversion between a video comprising multiple video units and a coded representation of the video in which the multiple video units are processed in an order, where, when a video unit of the multiple video units is processed in the conversion, one or more frequence tables and/or one or more sorted intra prediction mode (IPM) tables are reset or initialized, where the one or more frequence tables include information about frequence of one or more intra prediction modes used for processing previous video units in the multiple video units, where the previous video units precede in time the video unit, where the frequence indicates an occurrence of the one or more intra prediction modes used for the conversion, and where the one or more sorted IPM tables indicate the one or more intra prediction modes used in the processing.

Abstract: Embodiments of the present disclosure provide a solution for image/video super resolution. A method for image processing is proposed. The method comprises: receiving a first image with a first resolution and at least one reference image associated with the first image, the first image and the at least one reference image being associated with a same video; determining a difference between the first image and the at least one reference image; and generating a second image with a second resolution based on the difference, the first image and the at least one reference image, the second resolution being higher than the first resolution.

Abstract: The present application provides methods, devices and computer readable media for intrinsic popularity evaluation and content compression based thereon. In an embodiment, there is provided a method of intrinsic popularity evaluation. The method comprises: receiving an image from a social network; and determining an intrinsic popularity score for the image using a deep neural network (DNN) based intrinsic popularity assessment model.

Abstract: A method for video coding with global rate-distortion optimization-based rate control (RC) is provided. By using this video coding method, an RC scheme for High dynamic range (HDR) in High Efficiency Video Coding (HEVC) is provided. Briefly, considering the characteristics of HDR image content, a rate-distortion (R-D) model based on HDR-Visual Difference Predictor (VDP)-2 for performance optimization is provided. In the optimization process, the ? is directly utilized rather than the bit rate to obtain the globally optimal solution. Finally, the model parameter estimation method is used to reduce errors. The video coding method of the present invention is verified that bit rate reduction on average can be achieved.

Abstract: A method based on CTU level rate-distortion optimization for rate control in video coding which can effectively improve the perceptual rate-distortion performance and coding efficiency is provided. Firstly, a perceptual rate-distortion model is established using a divisive normalization framework, which characterizes the relationship between local visual quality and coding bits. Subsequently, the established perceptual rate-distortion model is applied to overall distortion optimization which is transformed into a global optimization problem and solved with convex optimization algorithms to obtain optimal CTU level coding bit allocation.

Abstract: A method based on CTU level rate-distortion optimization for rate control in video coding which can effectively improve the perceptual rate-distortion performance and coding efficiency is provided. Firstly, a perceptual rate-distortion model is established using a divisive normalization framework, which characterizes the relationship between local visual quality and coding bits. Subsequently, the established perceptual rate-distortion model is applied to overall distortion optimization which is transformed into a global optimization problem and solved with convex optimization algorithms to obtain optimal CTU level coding bit allocation.

Abstract: A system for low latency broadcast of animation frames includes a frame extractor stored in memory and executable to access frame data generated by a rendering pipeline of a frame generation engine. During runtime of the frame generation engine, the frame extractor exports the frame data for use external to the frame generation engine.

Abstract: A computing device is described herein that is configured to encode natural video content in accordance with a first encoding scheme and screen content in accordance with a second encoding scheme. The computing device is configured to distinguish between the natural video content of a video frame and the screen content of the video frame based at least in part on temporal correlations between the video frame and one or more neighboring video frames and on content analysis of the video frame.