Abstract: Systems and methods for overlaying virtual objects in a virtual environment based on user interest and user interactions are disclosed. The methods analyze a live view of a surface viewed through camera or a transparent lens and determine if the policies of the surface allow overlaying of virtual objects. The method fetches a virtual object and calculates a score based on user interest, user gaze, and user engagement. Virtual objects that meet the policies of the surface and a scoring criterion are overlayed on the surface in the virtual environment and enhanced based on a plurality of enhancement factors. Virtual objects are also overlayed in frames of a live broadcast based on their scores. Virtual objects displayed on a conference call interface, which may be meeting tools or icons associated with other conferencing functionality, are enhanced, or removed from the user interface based on their utilization.

Abstract: Systems and methods are described for generating a media asset for presentation during a consumption session associated with a user profile, and while generating for presentation the media asset, generating for presentation an option to enable a social network profile, associated with a social network and associated with the user profile, to interact with a social network profile of a performer included in a cast of the media asset. In response to receiving selection of the option, an image of a frame of a current scene of the media asset may be extracted, and input associated with the image of the frame may be received. A request to post a message on the social network may be transmitted, toe enable a plurality of devices to access the message via the social network, and the message may comprise the extracted image of the frame and the received input.

Abstract: Systems and methods for generating a CAPTCHA challenge in a virtual environment are disclosed. The methods display a spatially anchored virtual 3D object in a virtual environment where certain features of the 3D object are hidden or occluded. The methods provide general, specific, or no instructions to a user for manipulating the displayed 3D virtual object. Upon determining that the manipulations performed follow the instructions, the occluded feature is revealed. Varying degrees of CAPTCHA challenges are provided that include moving real life objects, leveraging user background in generating customized CAPTCHA challenges, and camouflaging the virtual objects to make solving the CAPTCHA more challenging. The methods query the user to provide an input that reflects the revealed occluded feature, and, if the response to the query meets the predetermined response, access to the secured data requested in granted.

Abstract: Data describing broadband internet usage is collected from a user equipment device associated with each respective user account. The data are then input into a machine learning model that is trained on broadband internet usage data of a plurality of user accounts in a single geographic area. An n-dimensional metric for each user account is then obtained as output from the machine learning model. Using the n-dimensional metric, at least one candidate user account suspected of being engaged in broadband internet access sharing is identified, and a list of candidate user accounts is generated.

Abstract: Systems and methods for obscuring images and/or text during a screen sharing operation in a video conferencing session are described herein. In some embodiments, a client device detects a screen sharing operation. As part of the screen sharing operation, the client device captures an image of a display. The client device recognizes images and/or text in the image of the display and determines whether any of the images and/or text are restricted. If the images and/or text are determined to be restricted, the client device obscures the images and/or text prior to encoding of the image of the display for transmission.

Abstract: Systems and methods for obscuring images and/or text during a screen sharing operation in a video conferencing session are described herein. In some embodiments, a client device detects a screen sharing operation. As part of the screen sharing operation, the client device captures an image of a display. The client device recognizes images and/or text in the image of the display and determines whether any of the images and/or text are restricted. If the images and/or text are determined to be restricted, the client device obscures the images and/or text prior to encoding of the image of the display for transmission.

Abstract: Systems and methods are provided herein for conforming audio to a video to avoid discordance. This may be accomplished by a system receiving a video and selection of an audio asset. The system may identify a plurality of break points in the audio asset based on one or more characteristics of the audio asset. A first portion of the audio asset may be generated based on one or more characteristics of the received video (e.g., length of the video), wherein the first portion of the audio asset begins and/or ends at a break point of the plurality of break points. The system may then generate a media item comprising the video and the first portion of the audio asset.

Abstract: Systems and methods for improving displays of media assets are disclosed herein. In an embodiment, a system receives a plurality of text comments from a plurality of devices to which a media asset was transmitted. The system analyzes the comments to identify text strings within the text comments. The system generates interactable elements from the text strings in the text comments, such that an interaction with the text string causes display of identifiers of media assets corresponding to the text string.

Abstract: Systems and methods are described for determining that a conferencing device participating in a video conference via a conferencing server is a mobile device. The mobile device may be performing virtual background processing to generate for display a virtual background during the video conference. Based on a monitored parameter of the mobile device, a determination may be made whether the virtual background processing being performed by the mobile device should be offloaded to an edge computing device. In response to determining the virtual background processing should be offloaded, at least a portion of the virtual background processing being performed by the mobile device may be offloaded to the edge computing device, and the edge computing device may be configured to receive a video feed from the conferencing device, modify the video feed by performing the virtual background processing, and transmit the modified video feed to the conferencing server.

Abstract: Systems, methods and apparatuses are described herein for controlling access to 3D media assets. An attribute of an entity represented in a 3D media asset may be identified, and a modified version of the 3D media asset may be generated by modifying such attribute. A request to access at least a portion of the 3D media asset may be received from a client device. A determination may be made, based on a policy associated with the 3D media asset, to enable access to the at least a portion of such asset. In response to such determination, an indication of how to process the modified version of the 3D media asset to reconstruct such asset comprising the attribute as identified prior to the modifying may be transmitted to the client device. Such client device may be caused to generate for display such 3D media asset based on the processing.

Abstract: Systems and methods for improving displays of media assets are disclosed herein. In an embodiment, a system receives a plurality of text comments from a plurality of devices to which a media asset was transmitted. The system analyzes the comments to identify text strings within the text comments. The system generates interactable elements from the text strings in the text comments, such that an interaction with the text string causes display of identifiers of media assets corresponding to the text string.

Abstract: Systems and methods for generating audible pronunciation of a closed captioning word in a content item. For example, a system generates for output on a first device a content item comprising dialogue. The system generates for display on the first device a closed captioning word corresponding to the dialogue where the closed captioning word is selectable via a user interface of the first device. The system receives a selection of the closed captioning word via the user interface of the first device. In response to receiving the selection of the closed captioning word, the system generates for playback on the first device at least a portion of the dialogue corresponding to the selected closed captioning word.

Abstract: Systems and methods are described for controlling media content based on user presence information. A user interaction with playing of a first media asset generated for presentation at a consumption device may be identified, and in response, historical wireless signal characteristics of a wireless network, over which wireless signals are used to generate for display the first media asset, may be determined. While a second media asset is generated for display, the second media asset at the consumption device may be modified based on user presence information determined by comparing current wireless signal characteristics of the wireless network to the historical wireless signal characteristics of the wireless network.

Abstract: Systems and methods are described for enabling user-controlled extended reality (XR). The provided systems and methods may determine an XR portion should be included in a video feed that comprises a depiction of a first user, and the XR portion may be configured to occlude the entity in the video feed. An entity may be detected in the video feed, and user input may be received specifying that a detected entity in the video feed should not be occluded by the XR portion. Based on the user input, the video feed may be modified to exclude the XR portion from a portion of the video feed depicting the detected entity, wherein the portion is included at a different portion of the video feed, and the depiction of the first user is included in the video feed, and transmit the modified video feed to a second user device.

Abstract: Systems and methods are described for enabling user-controlled extended reality (XR). The systems and methods may access one or more frames, depicting an environment surrounding a first user, of a video feed captured by a first user's device, and classify each portion of the frames as a physical background of the environment, as depicting the first user, or as depicting an additional entity. First and second masks may be generated for the depictions of the first and second users, respectively, and such masks may respectively define boundaries of the first user's depiction and the second user's depiction at which the XR portion should not be inserted. The frames may be modified by combining portions of the frames belonging to the physical background with the first mask and the second mask, and the video feed comprising the modified frames may be encoded and transmitted to the second user device.

Abstract: Systems and methods for controlling a head-up display are disclosed. A head-up display including a plurality of graphical elements, each graphical element being generated at one of a range of depths on the head-up display is generated on a head-up display device. An indication that one of the graphical elements is currently selected is displayed. A user interface navigation signal to rotate the selection through the graphical elements in order of depth in response to user actuation of a navigation control is received from a user input device and an action associated with the currently selected graphical element in response to user actuation of the user input device is performed.

Abstract: Systems and methods for analyzing predictive movements are disclosed herein. In an embodiment, a system identifies an entity in a video feed of an event and generates for display a prompt for a user to perform a predictive movement to predict an action of the entity in the video feed. The system uses computer vision techniques to analyze the action taken by the entity in the video feed and the predictive movement performed by the user prior to display of the action on the user's display device. If the system determines that the predictive movement matches the action taken by the entity, the system identifies the predictive movement as a correct prediction.

Abstract: Systems and methods for improving displays of media assets are disclosed herein. In an embodiment, a system receives a plurality of text comments from a plurality of devices to which a media asset was transmitted. The system analyzes the comments to identify text strings within the text comments. The system generates interactable elements from the text strings in the text comments, such that an interaction with the text string causes display of identifiers of media assets corresponding to the text string.

Abstract: Systems and methods for detecting and analyzing audio in a media presentation environment to determine whether to replay missed portions of media content are disclosed herein. In an embodiment, one or more computing devices detect audio in a media presentation environment. The one or more computing devices determine whether the audio relates to the media being presented. If the audio does not relate to the media being presented, the one or more computing devices cause replaying a portion of the media presentation corresponding to when the audio was being detected.

Abstract: Systems and methods for generating audible pronunciation of a closed captioning word in a content item. For example, a system generates for output on a first device a content item comprising dialogue. The system generates for display on the first device a closed captioning word corresponding to the dialogue where the closed captioning word is selectable via a user interface of the first device. The system receives a selection of the closed captioning word via the user interface of the first device. In response to receiving the selection of the closed captioning word, the system generates for playback on the first device at least a portion of the dialogue corresponding to the selected closed captioning word.