Abstract: A voice query is received via an input to a virtual assistant from a user. The virtual assistant determines a media context from first media content, the media context being colocated and contemporaneous with the voice query. The voice query is processed to generate a textual query and to identify a keyword from the voice query, and a response content provider is selected based on the keyword and the media context. The textual query and the media context are communicated to the response content provider via a network interface. Query response data is received from the response content provider via the network interface, the query response data comprising voice data. The virtual assistant then generates, at an output, a query response based on the query response data.

Abstract: A method and system for remote play via a game console that operates as a server and forms peer-to-peer connections with remote client devices. A network congestion control receives RTCP packets and SRC IP connection updates, and stores RTCP responses in per-source datastores. Congestion window and round-trip time values are determined for each source based on the RTCP responses. A worst-case client device is identified based on a last or delayed RTCP response, and corresponding congestion information is provided to a transmission scheduler. A rate and video encoding properties controller determines target encoding parameters using a bitrate-to-encoding mapping, queue length of RTP packets, and encoder and multiplexer bitrates. Encoded audiovisual data is packetized, scheduled, and transmitted to multiple client devices. Low-bandwidth client devices may be disconnected and serviced via adaptive bitrate streaming.

Abstract: Systems and methods are disclosed herein for protecting and managing usage of user data for artificial intelligence (AI) model training. More particularly, systems and related methods are disclosed for collecting user data by tracking interactions with a user interface of a user device in accordance with user defined consent parameters. Further, the collected data may be stored in a training database and leveraged to train an AI model for the user. However, upon receiving an input to delete data from the training database, either explicitly or from deleting an application installed on (or otherwise accessed via) a user device, the data may be removed from the training database and new AI model weights are calculated and provided to the AI model to fine tune the AI model.

Abstract: Systems and methods are provided herein for managing contact information in a manner personalized to the preferences of a user. Particularly, systems and related methods are disclosed for enabling continuity of communication between users when there is a change in the contact details of a user. Upon detecting a change in the contact details of a user, the system determines a recommendation of contacts to be notified of the change based on a communication history of the user, provides the user with options for updating contacts of the change, and updates the contact details of the user in cloud-based accounts. Following the updating process, messages specifying the original, outdated contact detail of the user are identified and subsequently rerouted or otherwise managed accordingly.

Abstract: Systems and methods are provided for enabling audio sharing. Inertial data is monitored at a first headset, and a tap input is detected, based on the inertial data, by detecting a movement of the headset in a first direction and a subsequent deceleration above a threshold. It is detected, at the first headset, that it is within a threshold proximity to a second headset, or a computing device associated with the second headset. It is determined, based on a predetermined factor, that the first headset is to receive audio associated with the second headset, and pairing information is transmitted to the first headset. Authorization to pair the first headset to the computing device is requested and received at the second headset. The first headset is paired to the computing device using the pairing information, and the first headset and the second headset receive the same audio from the computing device.

Abstract: Methods and systems are disclosed herein for enabling an improved management of power resource of a device during content presentation. A device profile comprising, for a codec supported by the device, a plurality of format tuples, each format tuple having an associated power usage, is determined. A selection of a content item for the presentation on the device is received. A manifest file comprising, for the codec supported by the device, a set of representations for generating the content item for presentation on the device, wherein each representation in the set comprises a format tuple different from the other representations in the set. A first subset of representations from the set of representations is selected, based on the device profile, resulting in a quality level and a power usage associated with the presentation of the content item over the duration of the presentation of the content item on the device.

Abstract: Systems and methods provide for mitigating the likelihood of ocular discomfort caused by presentation of media content. A game server initiates a gameplay session for a user device with a plurality of respective video feeds for each of a plurality of respective virtual cameras. The game server may execute the game logic and forward video streams to the user device which is dynamically altered by user device inputs controlling the game. The game server may then calculate respective virtual inertial measurement unit (IMU) parameters for each of the plurality of respective video feeds. The game server may generate a first stream of the gameplay session by multiplexing: (a) a bitstream of a video feed of a first virtual camera and (b) the calculated respective IMU parameters of the plurality of video feeds and then transmit this multiplexed first stream to the gaming user device.

Abstract: Systems and methods provide for mitigating the likelihood of ocular discomfort caused by presentation of media content. A game server initiates a gameplay session for a user device with a plurality of respective video feeds for each of a plurality of respective virtual cameras. The game server may execute the game logic and forward video streams to the user device which is dynamically altered by user device inputs controlling the game. The game server may then calculate respective virtual inertial measurement unit (IMU) parameters for each of the plurality of respective video feeds. The game server may generate a first stream of the gameplay session by multiplexing: (a) a bitstream of a video feed of a first virtual camera and (b) the calculated respective IMU parameters of the plurality of video feeds and then transmit this multiplexed first stream to the gaming user device.

Abstract: Systems and methods are provided for enabling extended reality content delivery. A plurality of virtual objects are identified at a first computing device. For each object of the plurality of virtual objects, a plurality of detail levels and a single-use or a multi-use classification are identified. A metadata file is generated for the plurality of virtual objects, where the metadata file indicates, for each object, the plurality of detail levels, a location of the object for each detail level and the single-use or the multi-use classification. The metadata file is stored, and a second computing device is caused to retrieve the metadata file. The second computing device is caused to retrieve at least a subset of the plurality of virtual objects at a detail level of the plurality of detail levels, and the subset of the plurality of virtual objects is caused to be generated for output.

Abstract: Systems and methods are provided for enabling extended reality content delivery. An input associated with initiating an extended reality scene is received at a computing device, and output of the extended reality scene is initiated. A metadata file indicating a plurality of objects in the extended reality scene is received. The metadata file indicates for each object a plurality of detail levels and a single-use or a multi-use classification. For a single-use object, a first detail level is identified, the single-use object is received at the first detail level and the single-use object is generated for output at the first detail level. For a multi-use object, a second detail level is identified, the multi-use object is received at the second detail level, the multi-use object is stored in a cache at the second detail level and the multi-use object is generated for output at the second detail level.

Abstract: Systems and methods are provided for applying an extended reality (XR) effect to a portion of a video comprising a user. A video of a user in an environment is obtained via a camera of a user device. Infrared (IR) light is projected onto the user. IR light reflection data corresponding to the projected light reflected by an object being held by the user is detected. The IR light reflection data is compared to baseline profile data of the user. Based on the comparing, a position of the object is determined to be within a threshold proximity of the user and an XR visual effect is applied to a portion of the video comprising the user.

Abstract: The present disclosure is related to systems and methods for synchronizing content items with future events, for example, by dynamically modifying content item playlists. The systems and methods may identify a playlist and a future time at which a time-sensitive content item is to be played. The systems and methods may determine an estimated time of playback of the time-sensitive content item in the playlist and may modify, based on detecting a difference between the estimated time of playback and the identified future time, the playlist to achieve playback of the time-sensitive content item at the identified future time. The systems and methods may modify the playlist by modifying one or more durations of the content items in the playlist based on a plurality of modifiability scores.

Abstract: Systems and methods are described herein for providing in-game video assistance. The system may, while a video game is being played by a first user during a gaming session, determine to provide gameplay assistance to the first user for a portion of the video game. A gameplay model may be selected for importation into the gaming session. The gameplay model may be generated based at least in part on gameplay of a second user determined to have a skill level above a threshold with respect to the video game. The gameplay model may be imported into the gaming session, and the imported gameplay model may be used to predict one or more gameplay actions. While the video game is being played by the first user, gameplay assistance may be output based at least in part on the predicted one or more gameplay actions.

Abstract: Systems and methods are provided for providing feedback to a user during a virtual tutorial associated with providing an extended reality (XR) visual effect. A video of a user holding an object proximate to their face is obtained via a camera of a user device. A virtual tutorial for performing an action to a region of the user is provided to the user device. A position of the object relative to the user is monitored. While the object is within a threshold proximity of the region, first feedback indicative of correct positioning based on the virtual tutorial is provided to the user. While the object is outside the threshold proximity, second feedback indicative of incorrect positioning based on the virtual tutorial is provided to the user. An XR visual effect is applied to a portion of the video comprising the user based on the position of the object.

Abstract: Methods and systems are disclosed herein for enabling an improved management of power resource of a device during content presentation. A device profile comprising, for a codec supported by the device, a plurality of format tuples, each format tuple having an associated power usage, is determined. A selection of a content item for the presentation on the device is received. A manifest file comprising, for the codec supported by the device, a set of representations for generating the content item for presentation on the device, wherein each representation in the set comprises a format tuple different from the other representations in the set. A first subset of representations from the set of representations is selected, based on the device profile, resulting in a quality level and a power usage associated with the presentation of the content item over the duration of the presentation of the content item on the device.

Abstract: An extended reality (XR) device, for example, a head mounted device (HMD), may provide a visual element when the system determines that a wearer of the XR device is likely to engage with an application on a physical device, such as a television or other display device. The XR device may render a visual element based on the predicted application. The XR device may be caused to prevent displaying visual elements generated by applications other than the selected application. The visual element may be rendered by the XR device at a fixed location anchored relative to the physical device.

Abstract: Systems and methods are presented herein for creating and rendering supplemental content of a selectable product icon of an e-commerce interface in response to user interaction with the selectable product icon. A list of products with a plurality of selectable icons is retrieved from a server based on at least one parameter of a query from an identified first device. The first device is determined to be communicatively coupled to at least one secondary device. Using an artificial intelligence generative engine, supplemental content corresponding to one or more products is generated based on device information of the at least one secondary device. In response to determining that a position of the at least one selectable icon is within a threshold distance of the subset of the list of products displayed or is being displayed, instructions are transmitted to the at least one secondary device to render the supplemental content.

Abstract: Systems and methods are described herein for enabling a search engine to group similar content into clusters. The disclosed methods maintain a database of indexed media content associated with a keyword, and compute representative values for feature embeddings that are extracted based on features (e.g., visual features) in the indexed content included in a cluster of indexed content. When new content associated with the keyword becomes available to the search engine, the feature embeddings of the new content are computed and compared to representative values for feature embeddings of the cluster, to determine if the new content should be placed into the existing cluster of content, or if a new cluster should be generated for the new content. The search engine may receive a search query comprising the keyword, and present content associated with each cluster. Thus, artificially generated search results may be distinguished from genuine search results.

Abstract: A personal safe area is determined for extended reality (XR) devices, such as head mounted devices in virtual reality (VR) sessions, sharing a common larger play area. The personal safe areas may be sized based on user size, may have radii centered on the XR device and parallel to a floor, and may move with the XR device as the XR device moves in an immersive reality session. A notification indicating proximity to another XR device may be generated, and the notification may indicate the direction from which the other XR device is approaching. Also contemplated is real time adjusting an XR gameplay, game display or game flow of one or more XR devices to avoid overlap of safe spaces by shifting virtual game objects in a safer direction.

Abstract: Systems and methods for dynamically sharing a media item based on satisfying a condition are disclosed. The methods provide the media item for selection based on selection of a contact or vice versa. The media item may be photo, video, audio, or another type of item in which the contact is included, e.g., the contact is in the photo selected. The methods determine the media item is relevant to the contact based on a facial recognition match. The shared media item, which may be a photo, automatically replaces, for example, a wallpaper or lock screen of the contact. The methods also disclose a shared camera that allows users in a proximity of a first user to opt into a shared group. Once they join/opt in, any photo taken or viewed by the first user is simultaneously displayed on the display of all members of the shared group.