Abstract: The server system hosts one or more virtual client devices executing one or more virtual applications, each virtual client device corresponding to a remote physical client device. The server system receives, from a first remote physical client device, a signal of a characteristic of media detected by a physical component of the first remote physical client device. The server system, in response to receiving the signal of the characteristic of the media, determines, based on the characteristic of the media, an instruction for adjusting the media detected by the physical component of the first remote physical client device and transmits, to the client device, the instruction for adjusting the media at the first remote physical client device.

Abstract: The server system receives, from a respective remote physical client device, a digest of a segment of video content received by the respective remote physical client device, the segment of video content including a plurality of frames of video content. In response to receiving the digest, the server system sends a playback command to the respective remote physical device to playback one or more of the plurality of frames of video content in the segment. The plurality of frames of video content in the segment have a frame rate. The server system determines a graphical processing unit (GPU) overlay instruction for overlaying content of a frame buffer with a respective portion of the segment of video content and sends, asynchronously from the frame rate of the plurality of frames of video content, the GPU overlay instruction to the respective remote physical client device.

Abstract: A server system hosts one or more virtual machines. The server system receives a first media stream that includes first content corresponding to a plurality of frames of video data and generates a first digest segment that corresponds to the first media stream, wherein the first digest segment includes a representation of the plurality of frames but does not include the video data. The server system stores the first digest segment in a cache at the server system; and receives a playback position of the first media stream at a first client device. The server system uses the playback position from the first client device and the first digest segment stored in the cache to perform processing to recreate a representation of the playback of the first media stream on the first client device.

Abstract: A computing device receives a modified first image frame from a client device, wherein the client device stores the first image frame. The computing device generates a second image frame that corresponds to the modified first image frame with a watermark. The computing device transmits, to a third-party application executing at the computing device, the second image frame and generates an instruction for modifying the first image frame, the instruction based on an altered version of the second image frame that is identified by the watermark, the second image frame altered by the third-party application. The computing device transmits, to the client device, the instruction for modifying the first image frame.

Abstract: Example monitored online experience systems and methods are described. In one implementation, techniques initiate an online gaming experience with a first user and associate a second user with the online gaming experience. The techniques receive audio data from a game server and receive a voice overlay from the second user. During the online gaming experience, the techniques play the audio data in a speaker proximate the first person and play the voice overlay in the speaker proximate the first person. Media data for a game session, such as video and chat data may be input to an LLM along with a prompt relating to a behavioral focus to identify fragments of the media data, which is then combined to generate a highlight reel.

Abstract: A server computing device hosts one or more virtual machines. A first virtual machine corresponding to a first client device receives a first media stream that includes first content corresponding to a plurality of frames of video data and generates a first digest segment that corresponds to the first media stream. The first digest segment includes a representation of the plurality of frames but does not include the video data. The first virtual machine stores the first digest segment in a cache at the server system. A second virtual machine corresponding to a second client device receives a playback position of the first media stream playing at the second client device and uses the playback position from the second client device and the first digest segment stored in the cache to perform processing to recreate a representation of the playback of the first media stream on the second client device.

Abstract: A computing device receives a modified first image frame from a client device, wherein the client device stores the first image frame. The computing device generates a second image frame that corresponds to the modified first image frame with a watermark. The computing device transmits, to a third-party application executing at the computing device, the second image frame and generates an instruction for modifying the first image frame, the instruction based on an altered version of the second image frame that is identified by the watermark, the second image frame altered by the third-party application. The computing device transmits, to the client device, the instruction for modifying the first image frame.

Abstract: The server system hosts one or more virtual client devices executing one or more virtual applications, each virtual client device corresponding to a remote physical client device. The server system receives, from a first remote physical client device, a signal of a characteristic of media detected by a physical component of the first remote physical client device. The server system, in response to receiving the signal of the characteristic of the media, determines, based on the characteristic of the media, an instruction for adjusting the media detected by the physical component of the first remote physical client device and transmits, to the client device, the instruction for adjusting the media at the first remote physical client device.

Abstract: A client device receives, from a server, first content directed to a first buffer in the client device and second content directed to a second buffer in the client device. The client device buffers the first content in the first buffer and buffers the second content in the second buffer. At least a portion of the second content is buffered in the second buffer substantially simultaneously with buffering the first content in the first buffer. The client device receives a command from a virtual set-top application, running on the server, that corresponds to the client device. The client device runs a virtual set-top local client that receives the command from the virtual set-top application and selects the first buffer as a content source. The selecting is performed in accordance with the command. The client device provides the selected content for display.

Abstract: A client device receives a first image frame from a server, stores the first image frame and generates a first modified image that corresponds to the first image frame. The client transmits, to a remote device, the generated first modified image. The remote device uses the first modified image to determine the instruction for displaying the second image frame. The client receives, from the remote device, an instruction for displaying a second image frame. In response to receiving the instruction, the client device displays, on a display communicatively coupled to the client device, the second image frame.

Abstract: A server computing device hosts one or more virtual machines. A first virtual machine corresponding to a first client device receives a first media stream that includes first content corresponding to a plurality of frames of video data and generates a first digest segment that corresponds to the first media stream. The first digest segment includes a representation of the plurality of frames but does not include the video data. The first virtual machine stores the first digest segment in a cache at the server system. A second virtual machine corresponding to a second client device receives a playback position of the first media stream playing at the second client device and uses the playback position from the second client device and the first digest segment stored in the cache to perform processing to recreate a representation of the playback of the first media stream on the second client device.

Abstract: A server system generates a model of a first memory architecture of a client device, the model of the first memory architecture including a GPU memory portion and a CPU memory portion. The server system receives a representation of a first image asset, and stores a first texture image corresponding to the first image asset in the GPU memory portion of the model at the server system. The first texture image is stored in the GPU memory portion of the client device. The server system determines, using the model, that the GPU memory portion at the client device needs to be reallocated. The server system identifies, using the model, one or more texture images that are stored in the GPU memory portion at the client device to evict and transmits an instruction, to the client device, to evict the one or more texture images from the GPU memory portion.

Abstract: The server system transmits, from a virtualized third-party application to a client device, an instruction to open a media resource from a content distribution network, the media resource comprising a plurality of video segments, each video segment of the plurality of video segments having video segment data and metadata. The server system receives, from the client device, first metadata for a first video segment of the plurality of video segments, without receiving first video segment data for the first video segment. The server system generates a recreated representation of the first video segment using the first metadata. The virtualized third-party application generates a transformed version of the recreated representation of the first video segment. The server system transmits, to the client device, an instruction to play the first video segment, wherein the instruction is based on the transformed version of the recreated representation of the first video segment.

Abstract: A server computing device receives, from a client device, a digest segment generated by the client device. The digest segment corresponds to a first media stream segment received by the client device, and the digest segment includes a representation of the first media stream segment. The server computing devices determines, using the digest segment, a playback command that corresponds to the first media stream segment and transmits, to the client device, the playback command.

Abstract: A server system determines, for a group of user sessions assigned to a single modulator, that an aggregate bandwidth for a first frame time exceeds a specified budget for the modulator. The user sessions comprise data in a plurality of classes, each class having a respective priority. In response to a determination that the aggregate bandwidth exceeds a specified budget, the server system allocates a portion of the aggregate bandwidth, including allocating a first portion of the data for a first user session in the group of user sessions and allocating a second portion of the data for a second user session in the group of user sessions, where both the first portion and the second portion are allocated in accordance with the class priorities. The server system transmits the allocated portions of the data for the group of user sessions through the modulator during the first frame time.

Abstract: A client device receives a first image frame from a server, stores the first image frame and generates a first modified image that corresponds to the first image frame. The client transmits, to a remote device, the generated first modified image. The remote device uses the first modified image to determine the instruction for displaying the second image frame. The client receives, from the remote device, an instruction for displaying a second image frame. In response to receiving the instruction, the client device displays, on a display communicatively coupled to the client device, the second image frame.

Abstract: A server remote from a client device executes an HTML-based virtual client application. The server uses the HTML-based virtual client application to traverse a Document Object Model (DOM) tree to identify differences between a set of sequential images in sequential video frames of a sequence of video frames to render a rendered image corresponding to a video frame, the rendered image associated with HTML commands. The server uses the HTML-based virtual client application to generate an HTML wrapper for the rendered image that includes data encoded in accordance with the differences identified by traversing the DOM tree. The server sends the HTML wrapper to the client device to be processed by an HTML-based application on the client device to enable the image to be displayed at a display coupled to the client device.

Abstract: An electronic device sends a content stream, via an unmanaged network, toward a client device and monitors the capacity of the unmanaged network. The device determines whether an aggregate bandwidth of an upcoming portion of the content stream fits the capacity. The upcoming portion of the content stream includes video content and user-interface data. In response to a determination that the aggregate bandwidth of the upcoming portion of the content stream does not fit the capacity, when the user-interface data is not the result of a user interaction: the device prioritizes a frame rate of the video content over latency for the user-interface data, and in accordance with a determination that the aggregate bandwidth of the upcoming portion of the content stream does not fit the capacity, sends ahead one or more frames of the video content in the upcoming portion, and delays the user-interface data in the upcoming portion.

Abstract: A method of displaying video embedded in a user interface is performed at an electronic device such as a server system or client device. The method includes obtaining user-interface frames having a first placeholder for a first video window and obtaining source video frames having a first video stream in the first video window. The source video frames and the user-interface frames are interleaved to form an output video stream, which is provided for decoding and display.

Abstract: A server system determines, for a group of user sessions assigned to a single modulator, that an aggregate bandwidth for a first frame time exceeds a specified budget for the modulator. The user sessions comprise data in a plurality of classes, each class having a respective priority. In response to a determination that the aggregate bandwidth exceeds a specified budget, the server system allocates a portion of the aggregate bandwidth, including allocating a first portion of the data for a first user session in the group of user sessions and allocating a second portion of the data for a second user session in the group of user sessions, where both the first portion and the second portion are allocated in accordance with the class priorities. The server system transmits the allocated portions of the data for the group of user sessions through the modulator during the first frame time.