Abstract: A computer system performs operations to prepare input to a generative artificial intelligence (“AI”) model. The system receives compressed data for media, which has been compressed according to a media compression format to produce the compressed data. The system partially decompresses the compressed data (e.g., performing parsing and entropy decoding operations). This produces syntax elements of the compressed data according to the media compression format. The system converts the syntax elements into tokens that represent the syntax elements, respectively. Unlike the syntax elements (in the media compression format), the tokens are encoded in an input format for the generative AI model. The system stores the tokens in memory or storage, from which the system can provide the tokens to the generative AI model for use in a training process or inference process for media synthesis, media compression, media decompression, or another purpose.

Abstract: A computer system performs operations to compress or decompress media using a generative artificial intelligence (“AI”) model. For compression, a compression tool receives a first version of input media, which has a first resolution, converts the first version to a second version, which has a second resolution lower than the first resolution, compresses the second version, and outputs compressed data for the second version. For decompression, a decompression tool receives input tokens that represent input syntax elements, respectively, of the compressed data for the second version. The decompression tool provides the input tokens to the generative AI model and receives predicted tokens from the generative AI model. The predicted tokens represent output syntax elements, respectively, of compressed data for output media. The decompression tool reconstructs the output media from the predicted tokens. The generative AI model is trained for media compression and decompression using a set of training data.

Abstract: A computer system performs operations to synthesize media using a generative artificial intelligence (“AI”) model. The system receives input tokens that represent input syntax elements, respectively, of compressed data for input media, which has been compressed according to a media compression format. The system provides the input tokens to the generative AI model and receives predicted tokens from the generative AI model. The predicted tokens represent output syntax elements, respectively, of compressed data for output media. Finally, the system reconstructs the output media (e.g., converting the predicted tokens to the output syntax elements, and then decompressing the output syntax elements using a media decoder). The generative AI model is trained for media synthesis using a set of training data. In training, the system can measure loss in terms of conformity of the predicted tokens to syntax of the media compression format and/or based on ratings of the output media.

Abstract: A gaming console composites a camera video overlay on gameplay video for broadcasting such that the gameplay area that is rendered by the gaming console is not obscured, even when the camera video overlay is composited on the gameplay video for broadcasting. The gaming console or a companion device of the gaming console can also allow a user to specify placement of the camera video overlay on the gameplay video for broadcasting, permitting the user to choose the portion of the gameplay video for broadcasting that is obscured by the camera video overlay.

Abstract: A video game application is executed on a computer gaming device. While the video game application is providing active gameplay, the computer gaming device receives a command to broadcast the active gameplay. Responsive to the command, the computer gaming device broadcasts the active gameplay without interrupting the active gameplay.

Abstract: Disclosed herein are innovations in decoding compressed video media data. The disclosed innovations facilitate decoding operations with improved computational efficiency, faster speeds, reduced power, reduced memory usage, and/or reduced latency. In one embodiment, for example, an encoded bitstream of video media data is input from an external video content provider, the encoded bitstream being encoded according to a video codec standard. A decoder is then configured to decode the encoded bitstream based at least in part on supplemental information that identifies a property of the encoded bitstream but that is supplemental to the encoded bitstream (e.g., supplemental information that is not part of the encoded bitstream or its associated media container and that is specific (or related) to the application for which the bitstream is used and/or the standard by which the bitstream is encoded and/or encrypted).

Abstract: Disclosed herein are innovations in decoding compressed video media data. The disclosed innovations facilitate decoding operations with improved computational efficiency, faster speeds, reduced power, reduced memory usage, and/or reduced latency. In one embodiment, for example, an encoded bitstream of video media data is input from an external video content provider, the encoded bitstream being encoded according to a video codec standard. A decoder is then configured to decode the encoded bitstream based at least in part on supplemental information that identifies a property of the encoded bitstream but that is supplemental to the encoded bitstream (e.g., supplemental information that is not part of the encoded bitstream or its associated media container and that is specific (or related) to the application for which the bitstream is used and/or the standard by which the bitstream is encoded and/or encrypted).

Abstract: Techniques are described for split processing of streaming segments in which processing operations are split between a source component and a decoder component. For example, the source component can perform operations for receiving a streaming segment, demultiplexing the streaming segment to separate a video content bit stream, scanning the video content bit stream to find a location at which decoding can begin (e.g., scanning up to a first decodable I-picture, for which header parameter sets are available for decoding), and send the video content bit stream to the decoder component beginning at the location (e.g., the first decodable I-picture). The decoder component can begin decoding at the identified location (e.g., the first decodable I-picture). The decoder component can also discard subsequent pictures that reference a reference picture not present in the video content bit stream (e.g., when decoding starts with a new streaming segment).

Abstract: A gaming console composites a camera video overlay on gameplay video for broadcasting such that the gameplay area that is rendered by the gaming console is not obscured, even when the camera video overlay is composited on the gameplay video for broadcasting. The gaming console or a companion device of the gaming console can also allow a user to specify placement of the camera video overlay on the gameplay video for broadcasting, permitting the user to choose the portion of the gameplay video for broadcasting that is obscured by the camera video overlay.

Abstract: A gaming console composites a camera video overlay on gameplay video for broadcasting such that the gameplay area that is rendered by the gaming console is not obscured, even when the camera video overlay is composited on the gameplay video for broadcasting. The gaming console or a companion device of the gaming console can also allow a user to specify placement of the camera video overlay on the gameplay video for broadcasting, permitting the user to choose the portion of the gameplay video for broadcasting that is obscured by the camera video overlay.

Abstract: Techniques are described for split processing of streaming segments in which processing operations are split between a source component and a decoder component. For example, the source component can perform operations for receiving a streaming segment, demultiplexing the streaming segment to separate a video content bit stream, scanning the video content bit stream to find a location at which decoding can begin (e.g., scanning up to a first decodable I-picture, for which header parameter sets are available for decoding), and send the video content bit stream to the decoder component beginning at the location (e.g., the first decodable I-picture). The decoder component can begin decoding at the identified location (e.g., the first decodable I-picture). The decoder component can also discard subsequent pictures that reference a reference picture not present in the video content bit stream (e.g., when decoding starts with a new streaming segment).

Abstract: Disclosed herein are innovations in decoding compressed video media data. The disclosed innovations facilitate decoding operations with improved computational efficiency, faster speeds, reduced power, reduced memory usage, and/or reduced latency. In one embodiment, for example, an encoded bitstream of video media data is input from an external video content provider, the encoded bitstream being encoded according to a video codec standard. A decoder is then configured to decode the encoded bitstream based at least in part on supplemental information that identifies a property of the encoded bitstream but that is supplemental to the encoded bitstream (e.g., supplemental information that is not part of the encoded bitstream or its associated media container and that is specific (or related) to the application for which the bitstream is used and/or the standard by which the bitstream is encoded and/or encrypted).

Abstract: Disclosed herein are innovations in decoding compressed video media data. The disclosed innovations facilitate decoding operations with improved computational efficiency, faster speeds, reduced power, reduced memory usage, and/or reduced latency. In one embodiment, for example, an encoded bitstream of video media data is input from an external video content provider, the encoded bitstream being encoded according to a video codec standard. A decoder is then configured to decode the encoded bitstream based at least in part on supplemental information that identifies a property of the encoded bitstream but that is supplemental to the encoded bitstream (e.g., supplemental information that is not part of the encoded bitstream or its associated media container and that is specific (or related) to the application for which the bitstream is used and/or the standard by which the bitstream is encoded and/or encrypted).

Abstract: A video game application is executed on a computer gaming device. While the video game application is providing active gameplay, the computer gaming device receives a command to broadcast the active gameplay. Responsive to the command, the computer gaming device broadcasts the active gameplay without interrupting the active gameplay.

Abstract: While broadcasting active gameplay of the video game application with a first broadcast configuration, a computer gaming device receives a command to change the broadcast configuration to a second broadcast configuration. Responsive to the command, the computer gaming device begins broadcasting the active gameplay with the second broadcast configuration without interrupting active gameplay or broadcasting of active gameplay.

Abstract: An electronic marketplace includes a plurality of video game applications available for purchase. For each of the plurality of video game applications, the electronic marketplace may display a tile identifying the video game application, a payment object for initiating a purchase of the video game application, and a preview object to initiate viewing of a live broadcast of active gameplay of the video game application.

Abstract: A gaming console composites a camera video overlay on gameplay video for broadcasting such that the gameplay area that is rendered by the gaming console is not obscured, even when the camera video overlay is composited on the gameplay video for broadcasting. The gaming console or a companion device of the gaming console can also allow a user to specify placement of the camera video overlay on the gameplay video for broadcasting, permitting the user to choose the portion of the gameplay video for broadcasting that is obscured by the camera video overlay.

Abstract: According to a first aspect of the innovations described herein video encoding, such as game video encoding, is improved with a goal to generate substantially constant video quality and the average target bitrate within a desired tolerance, which improves an overall user experience on video playback. An adaptive solution uses intelligent bias on bit allocation and quantization decisions, locally within a frame and globally across different frames, based on a current quality level and within an allowed bitrate variable tolerance. Bit allocation is increased on high complexity frames and redundant bits are avoided, which might have been wasted for static scenes and low complexity aspects. Statistics can be used from the encoding process. The solution can address similar video coding quality problems for video game recording on a variety of gaming platforms.

Abstract: The scaling of a user interface according to network or device limitations is disclosed. One embodiment provides a method of scaling a user interface, comprising sending a user interface over a network to a networked device, detecting a performance limitation of the user interface in at least one of the network or the networked device, and scaling a parameter of the user interface in response to the detected limitation to improve the performance of the user interface. In this manner, a user interface may be scaled in response to limitations on performance and end-user experience can be improved.

Abstract: The multi-location buffering of streaming media data is disclosed. One embodiment comprises buffering a first segment of media data associated with a current playback location, and buffering a second segment of media data associated with a seek point separated from the first segment of media data by a segment of unbuffered data. In this manner, data at seek points in the media stream may be buffered before a user requests a seek operation. Playback at a seek point may therefore begin with lessened or no perceived lag when a user inputs a seek command.