Abstract: A cloud-based extended reality (XR) system includes a server configured to encode a set of frames each associated with an XR scene to be displayed. To encode the set of frames, the server estimates a total number of encoded output bits for the set of frames based on a set of quantization parameters (QPs). The set of QPs includes a corresponding QP for each frame of the set of frames and one or more predetermined relationships between the corresponding QPs. The server then compares the estimated total number of encoded output bits to a target frame size threshold. Based on the estimated total number of encoded bits being outside the target frame size threshold, the server updates the set of QPs so as to maintain the predetermined relationships between the QPs.

Abstract: A multi-try encoding operation is implemented to encode one or more game frames into a game stream. The multi-try encoding operation includes determining an initial quantization parameter for a current frame. From the determined initial quantization parameter, one or more alternative quantization parameters are derived. Multiple encoders then perform multiple encodings on the current frame based on the initial quantization parameter and the alternative quantization parameters, respectively, to produce a plurality of encoded frames. An applicable encoded frame is then selected from the plurality of encoded frames according to a streaming application. The applicable encoded frame is then transmitted as part of a game stream to a client system.

Abstract: A cloud-based extended reality (XR) system includes a server configured to encode a set of frames each associated with an XR scene to be displayed. To encode the set of frames, the server estimates a total number of encoded output bits for the set of frames based on a set of quantization parameters (QPs). The set of QPs includes a corresponding QP for each frame of the set of frames and one or more predetermined relationships between the corresponding QPs. The server then compares the estimated total number of encoded output bits to a target frame size threshold. Based on the estimated total number of encoded bits being outside the target frame size threshold, the server updates the set of QPs so as to maintain the predetermined relationships between the QPs.

Abstract: An encoding operation is implemented to encode one or more frames, for example, gaming frames into a gaming stream. The encoding operation includes decomposing a current frame into a base layer and an enhancement layer. The resulting base layer and enhancement layer are then each encoded to produce an encoded base layer and an encoded enhancement layer. The encoded enhancement layer is truncated, for example, according to a comparison of the sum of the size of the encoded base layer and encoded enhancement layer to a threshold value. In an example embodiment, a multiplexer combines the encoded base layer and truncated enhancement layer to produce the encoded frame. The encoded frame may then be transmitted as part of a stream to a client device.

Abstract: A multi-pass encoding operation using a shared reference frame is implemented to encode one or more gaming frames into a game stream. The multi-pass encoding operation includes producing a shared reference frame based upon a second-pass reference frame used by a second pass encoding of the multi-pass encoding operation. The encoding operation also includes performing a first encoding pass on a current frame using the shared reference frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. A second pass encoding is then performed on the current frame according to the second-pass reference frame and the estimated complexity, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.

Abstract: Real-time pre-encoding dithering techniques mitigate or eliminate banding and other graphical artifacts in video frames prior to such video frames being encoded for transmission to and display by one or more client devices. For each of one or more input video frames, one or more random seeds and a frame identifier are received, and a dithering process is initiated for each of one or more pixels of the input video frame. The dithering process includes generating a YUV noise vector based on the random seeds and on the frame identifier, computing a YUV representation of the input pixel based on RGB color information for the input pixel, and generating a dithered output pixel by adding the generated YUV noise vector to the YUV representation of the input pixel.

Abstract: Pre-encoding noise parameterization techniques mitigate or eliminate banding and other graphical artifacts in video frames for decoding and presentation by a client device. For one or more input video frames, a quantization parameter associated with the input video frames is identified. Noise synthesis parameters are determined based on the identified quantization parameter, and the input video frames are encoded for transmission. The encoded video frames are transmitted to the client device along with the determined noise synthesis parameters, for use by the client device in generating synthetic noise to add to resulting video frames decoded by the client device.

Abstract: A two-pass encoding operation is implemented to encode one or more gaming frames into a game stream. The two-pass encoding operation includes a first encoding pass performed on a current frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. The resulting estimated complexity is then modulated according to a quality difference between reference frames used during the first pass encoding and a subsequent second pass encoding. Based on the modulated complexity, a quantization parameter is determined for the current frame that is then used to perform a second pass encoding on the current frame, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.

Abstract: A cloud-based gaming server renders a set of game frames at a first frame rate for a current client gaming session. An encoder of the server then determines whether the first frame rate is lower than a second frame rate associated with the encoder. In response to the first frame rate being lower, the encoder is configured to generate skip frames, with each skip frame indicating that a game frame of the set of game frames is to be repeated. The encoder also encodes the set of game frames to produce a set of encoded game frames and inserts one or more skip frames between two or more encoded game frames of the set of encoded game frames to produce a game stream. The server then packetizes the game stream and transmits the packetized game stream to a client system associated with the current client system.

Abstract: Techniques for encoding game content for real-time cloud-gaming, and more specifically to using an adaptive statistical model in a moving window of previous frames up to a current frame to adaptively compute a lower-bound of a quantization parameter (QP) that corresponds to a chosen peak signal to noise ratio (PSNR) target. The result of this PSNR-guided encoding is significantly reducing the size of encoded frames (i.e., undershooting a target bit rate when there are no subjective quality losses on those frames using their PSNR as the guidance). These reductions mitigate bandwidth issues and improve the overall user experience because less bits transferred results in faster network transmission and decoding, as well as less platform overhead.

Abstract: A two-pass encoding operation is implemented to encode one or more gaming frames into a game stream. The two-pass encoding operation includes a first encoding pass performed on a current frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. The resulting estimated complexity is then modulated according to a quality difference between reference frames used during the first pass encoding and a subsequent second pass encoding. Based on the modulated complexity, a quantization parameter is determined for the current frame that is then used to perform a second pass encoding on the current frame, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.

Abstract: Disclosed are techniques for temporal scalable video coding. By including a temporal_switching_point_flag and/or a temporal_nesting_flag into a normative part of the scalable bitstream, reference picture management in decoder can be simplified, and media-aware network elements and decoder can easily identify those pictures from which onward a higher temporal layer can be added.

Abstract: Disclosed are techniques for temporal scalable video coding. By including a temporal_switching_point_flag and/or a temporal_nesting_flag into a normative part of the scalable bitstream, reference picture management in decoder can be simplified, and media-aware network elements and decoder can easily identify those pictures from which onward a higher temporal layer can be added.

Abstract: Disclosed are techniques for temporal scalable video coding. By including a temporal_switching_point_flag and/or a temporal_nesting_flag into a normative part of the scalable bitstream, reference picture management in decoder can be simplified, and media-aware network elements and decoder can easily identify those pictures from which onward a higher temporal layer can be added.

Abstract: Disclosed are techniques for creating, coding, decoding, and using, rotation information related to one or more coded pictures in non-normative parts of a coded video bitstream.

Abstract: Disclosed are techniques for creating, coding, decoding, and using, rotation information related to one or more coded pictures in non-normative parts of a coded video bitstream.

Abstract: Techniques to determine a level id in a layered bitstream are disclosed, such that the same level id can be used for all layers of a scalable bitstream. Also disclosed are techniques to signal level ids for sub bitstreams that can be indicative of lower computational requirements than the level id used for the layered bitstream.

Abstract: Disclosed are techniques for creating, coding, decoding, and using, rotation information related to one or more coded pictures in non-normative parts of a coded video bitstream.

Abstract: Scalable video codecs are provided for use in videoconferencing systems and applications hosted on heterogeneous endpoints/receivers and network environments. The scalable video codecs provide a coded representation of a source video signal at multiple temporal, quality, and spatial resolutions.

Abstract: Scalable video codecs are provided for use in videoconferencing systems and applications hosted on heterogeneous endpoints/receivers and network environments. The scalable video codecs provide a coded representation of a source video signal at multiple temporal, quality, and spatial resolutions.