Abstract: Systems and methods are described for placing digital content items on trigger objects in an extended reality (XR) environment based on their relative prominence. The system receives an input of a live real-world view that is visible via the XR device, which includes a plurality of trigger objects at varying distances and angles, and obtains attributes related to the trigger objects in the live real-world view. Trigger objects' prominence, vantage, and adjusted prominence values, along with any handicaps and restrictions on content item placements, are collectively considered. Comparing the values between two or more trigger objects, a selection of at least one trigger object is made. Barring any safety concerns or placement restrictions, the content item that is designated for the selected trigger object is placed, such as overlayed, on the selected trigger object.

Abstract: Systems and methods for creating an optimized virtual reality store based on a user's product selections are disclosed. A user selects a product of interest from a virtual store. Based on metadata of the product of interest, a product use for the product of interest is identified. Associated products which supplement the product of interest in accomplishing the product use are identified. A level of importance for each associated product is determined based on the product of interest, product use, user data, and the difficulty in finding it in the virtual store. A set of associated products is recommended to the user based on their levels of importance. An optimized layout is generated based on the recommended products. Sections of the optimized layout are assigned a level of importance. The recommended products are displayed in the sections based on a corresponding level of importance of the recommended product.

Abstract: Systems and methods described herein in accordance with some embodiments may display augmented reality (AR) information related to an object based on a predicted persistence of the object within view of the user. In some embodiments, display of AR information is prioritized based upon a prediction of how soon an object will disappear from view, perhaps if the predicted disappearance will occur sooner than some threshold time. Systems and methods described herein in accordance with some embodiments extend to mixed reality (MR) systems, and provide for displaying an image of an object that has become obstructed or has disappeared from view and/or for displaying AR information related to an object that has become obstructed or has disappeared from view.

Abstract: Systems and methods for generating secondary content item that includes a first portion that is a reminder of the original interest and a second portion that is content relevant to the original interest are disclosed. The methods provide primary content for the user's consumption. User interest based on a plurality of factors, such as user's gaze, heartbeat, or facial expression, is determined during the user's consumption of the primary content. One or more objects or frames are identified as primary objects or frames of interest. The methods also scan in real-time, real-life objects that are in the field of view of an augmented reality device. A determination that the real-time object is related to the primary object of interest is made. A determination is also made if any environmental or local adjustments need to be made. A secondary content item with any environmental or local adjustments is generated.

Abstract: Systems and methods for determining emotional responses to videos, generating emotional arc based on the responses and reactions, and determining the type and/or point of insertion of secondary content based on the determined emotional responses are disclosed. The methods display primary content to a plurality of users and determine their emotional response as they consume the primary content. An average emotional arc is generated based on the determined emotional response and it is compared to a current emotional arc generated based on emotional response from a current user. When values of the current emotional are within a predefined range of the average emotional arc at a particular play position in the timeline of the primary content, a secondary content that is designated for the value of the current emotional arc is inserted in the primary content at the particular play position.

Abstract: Systems and methods are described for monitoring and analyzing user interactions within an extended reality (XR) environment. Objects and their attributes are determined and compared to a model of attributes of interest of a user. A second object exhibiting a stronger correlation with the current attribute of interest of the user is displayed through virtual overlays in an XR environment.

Abstract: Systems and methods are described for determining whether each of a first user and a second user has consumed a first media content item. In response to determining that each of the first and second users has consumed the first media content item, a predicted future interaction between the first user and the second user is determined. A second media content item is presented to each of the first and second users prior to the predicted future interaction. The second media content item comprises content relating to the first media content item.

Abstract: Systems and methods are described for improved sharing of an experience between users. A first image captured using a first user device is received by control circuitry. A second image captured using a second user device is received by the control circuitry. Control circuitry determines a first set of elements of the first image. Control circuitry determines a second set of elements of the second image. Control circuitry determines whether at least one element of the first set of elements corresponds to at least one element of the second set of elements. Control circuitry determines that a transient element is present in the first set of elements and is not present in the second set of elements. Control circuitry generates for display the transient element on the second user device.

Abstract: Systems and methods for generating secondary content item that includes a first portion that is a reminder of the original interest and a second portion that is content relevant to the original interest are disclosed. The methods provide primary content for the user's consumption. User interest based on a plurality of factors, such as user's gaze, heartbeat, or facial expression, is determined during the user's consumption of the primary content. One or more objects or frames are identified as primary objects or frames of interest. The methods also scan in real-time, real-life objects that are in the field of view of an augmented reality device. A determination that the real-time object is related to the primary object of interest is made. A determination is also made if any environmental or local adjustments need to be made. A secondary content item with any environmental or local adjustments is generated.

Abstract: Systems and methods are described for identifying a plurality of candidate interactive sessions for a user with a user profile to join, each candidate interactive session being associated with a plurality of user profiles. A digital representation of the user may be generated, and the digital representation of the user may be caused to join each of the plurality of candidate interactive sessions. The systems and methods may monitor, in each candidate interactive session, behavior of digital representations of each of the plurality of user profiles associated with the candidate interactive session in relation to the digital representation of the user. The systems and methods may generate, based on the monitoring, a social inclusivity score for each of the plurality of candidate interactive sessions. A recommended interactive session may be selected and provided based on the corresponding social inclusivity score for each candidate interactive session.

Abstract: Some embodiments of the present disclosure relate to methods and systems for providing an advertisement to a user based on a collective experience of the user. One method includes accessing a plurality of ambience specifications having corresponding advertisements. Each ambience specification may comprise a first view specification and a second view specification, and each view specification may comprise a list of ambience attributes. The method may include capturing first data at a first time and determining, for each of the first view specifications, a first match quality value. The method may include capturing second data at a second time and determining, for each of the second view specifications, a second match quality value. The method may include determining a best fit ambience specification based on the first match quality values and the second match quality values, and presenting to the user, the advertisement corresponding to the best fit ambience specification.

Abstract: Systems and methods are described for identifying a plurality of candidate interactive sessions for a user with a user profile to join, each candidate interactive session being associated with a plurality of user profiles. A digital representation of the user may be generated, and the digital representation of the user may be caused to join each of the plurality of candidate interactive sessions. The systems and methods may monitor, in each candidate interactive session, behavior of digital representations of each of the plurality of user profiles associated with the candidate interactive session in relation to the digital representation of the user. The systems and methods may generate, based on the monitoring, a social inclusivity score for each of the plurality of candidate interactive sessions. A recommended interactive session may be selected and provided based on the corresponding social inclusivity score for each candidate interactive session.

Abstract: Systems and methods are described for improved sharing of an experience between users. A first image captured using a first user device is received by control circuitry. A second image captured using a second user device is received by the control circuitry. Control circuitry determines a first set of elements of the first image. Control circuitry determines a second set of elements of the second image. Control circuitry determines whether at least one element of the first set of elements corresponds to at least one element of the second set of elements. Control circuitry determines that a transient element is present in the first set of elements and is not present in the second set of elements. Control circuitry generates for display the transient element on the second user device.

Abstract: Systems and methods are described for identifying a plurality of candidate interactive sessions for a user with a user profile to join, each candidate interactive session being associated with a plurality of user profiles. A digital representation of the user may be generated, and the digital representation of the user may be caused to join each of the plurality of candidate interactive sessions. The systems and methods may monitor, in each candidate interactive session, behavior of digital representations of each of the plurality of user profiles associated with the candidate interactive session in relation to the digital representation of the user. The systems and methods may generate, based on the monitoring, a social inclusivity score for each of the plurality of candidate interactive sessions. A recommended interactive session may be selected and provided based on the corresponding social inclusivity score for each candidate interactive session.

Abstract: Systems and methods for conceptualizing an initial object by using a reference object are described. The methods identify an initial object such as a virtual object or a live object. Characteristic(s) of the initial object may be obtained and used in a search query to search for a reference object with which a user has interacted. In some instances, the characteristic(s) may be obtained upon determining an interest in the initial object. Reference objects that include the characteristic(s) and have a user interaction may be identified and scored. The reference objects, if more than one identified, may be ranked based on the score and a reference object may be selected for display. The display may include both the selected reference object and the initial object and provide context to the initial object by such that the user may be able to relate to it based on their interactions with the reference object.

Abstract: Methods, apparatus, systems, devices, and computer program products directed to augmenting reality with respect to real-world places, and/or real-world scenes that may include real-world places may be provided. Among the methods, apparatus, systems, devices, and computer program products is a method directed to augmenting reality via a device. The method may include capturing a real-world view that includes a real-world place, identifying the real-world place, determining an image associated with the real-world place familiar to a user of the device viewing the real-world view, and/or augmenting the real-world view that includes the real-world place with the image of the real-world place familiar to a user viewing the real-world view.

Abstract: A plurality of snapshots from XR sessions are retrieved. A plurality of entities within the plurality of snapshots are identified. Based on the identified plurality of entities, a plurality of salient snapshots is identified. The plurality of snapshots is partitioned into contiguous clusters, with each cluster containing a salient snapshot. The salient snapshots are generated for presentation to the user and, in response to selection of a salient snapshot, a subset of the plurality of entities from within a cluster containing the selected salient snapshot is generated for presentation to the user. In response to selection of a presented entity of the presented subset of the plurality of entities, snapshots including the selected entity are generated for presentation. In response to selection of a snapshot, an XR scene corresponding to the selected snapshot is generated for presentation.

Abstract: Systems and methods for determining emotional responses to videos, generating emotional arc based on the responses and reactions, and determining the type and/or point of insertion of secondary content based on the determined emotional responses are disclosed. The methods display primary content to a plurality of users and determine their emotional response as they consume the primary content. An average emotional arc is generated based on the determined emotional response and it is compared to a current emotional arc generated based on emotional response from a current user. When values of the current emotional are within a predefined range of the average emotional arc at a particular play position in the timeline of the primary content, a secondary content that is designated for the value of the current emotional arc is inserted in the primary content at the particular play position.

Abstract: Systems and methods for determining emotional responses to videos, generating emotional arc based on the responses and reactions, and determining the type and/or point of insertion of secondary content based on the determined emotional responses are disclosed. The methods display primary content to a plurality of users and determine their emotional response as they consume the primary content. An average emotional arc is generated based on the determined emotional response and it is compared to a current emotional arc generated based on emotional response from a current user. When values of the current emotional are within a predefined range of the average emotional arc at a particular play position in the timeline of the primary content, a secondary content that is designated for the value of the current emotional arc is inserted in the primary content at the particular play position.

Abstract: Systems and methods for selecting supplemental content based on a conversation between a user and a helper are disclosed. The methods analyze a conversation, or other interactions, to determine the context and determine whether content discussed is associated with a product or service in the marketplace and of interest to the user. A factor-based determination is made whether to track helper's behavior and interactions after the conversation. When the helper is tracked, based on their tracing preferences, the helper's biometrics, such as gaze and/or heartbeat, are used to determine their interest in a product or service consumed, such as via media consumption, virtual reality experiences, or other online and offline interactions. Supplemental content related to helper's interested products are filtered based on user preferences and transmitted to the user.