Abstract: An electronic device places an augmented reality object in an image of a real environment based on a pose of the electronic device and based on image segmentation. The electronic device includes a camera that captures images of the real environment and sensors, such as an inertial measurement unit (IMU), that capture a pose of the electronic device. The electronic device selects an augmented reality (AR) object from a memory, segments a captured image of the real environment into foreground pixels and background pixels, and composites an image for display wherein the AR object is placed between the foreground pixels and the background pixels. As the pose of the electronic device changes, the electronic device maintains the relative position of the AR object with respect to the real environment in images for display.

Abstract: Disclosed are various embodiments for selecting augmenting reality (AR) objects based on contextual cues associated with an image captured by a camera associated with electronic device. Contextual cues are obtained at an electronic device and AR objects are identified from a memory associated with the electronic device. The electronic device implements a processor employing image segmentation techniques to combine the identified AR objects with the captured image and render the combined image for display at a display associated with the electronic device.

Abstract: An electronic device places an augmented reality object in an image of a real environment based on a pose of the electronic device and based on image segmentation. The electronic device includes a camera that captures images of the real environment and sensors, such as an inertial measurement unit (IMU), that capture a pose of the electronic device. The electronic device selects an augmented reality (AR) object from a memory, segments a captured image of the real environment into foreground pixels and background pixels, and composites an image for display wherein the AR object is placed between the foreground pixels and the background pixels. As the pose of the electronic device changes, the electronic device maintains the relative position of the AR object with respect to the real environment in images for display.

Abstract: Disclosed are various embodiments for selecting augmenting reality (AR) objects based on contextual cues associated with an image captured by a camera associated with electronic device. Contextual cues are obtained at an electronic device and AR objects are identified from a memory associated with the electronic device. The electronic device implements a processor employing image segmentation techniques to combine the identified AR objects with the captured image and render the combined image for display at a display associated with the electronic device.

Abstract: Systems and methods for generating illumination effects for inserted luminous content, which may include augmented reality content that appears to emit light and is inserted into an image of a physical space. The content may include a polygonal mesh, which may be defined in part by a skeleton that has multiple joints. Examples may include generating a bounding box on a surface plane for the inserted content, determining an illumination center point location on the surface plane based on the content, generating an illumination entity based on the bounding box and the illumination center point location, and rendering the illumination entity using illumination values determined based on the illumination center point location. Examples may also include determining illumination contributions values for some of the joints, combining the illumination contribution values to generate illumination values for pixels, and rendering another illumination entity using the illumination values.

Abstract: Systems and methods for generating illumination effects for inserted luminous content, which may include augmented reality content that appears to emit light and is inserted into an image of a physical space. The content may include a polygonal mesh, which may be defined in part by a skeleton that has multiple joints. Examples may include generating a bounding box on a surface plane for the inserted content, determining an illumination center point location on the surface plane based on the content, generating an illumination entity based on the bounding box and the illumination center point location, and rendering the illumination entity using illumination values determined based on the illumination center point location. Examples may also include determining illumination contributions values for some of the joints, combining the illumination contribution values to generate illumination values for pixels, and rendering another illumination entity using the illumination values.

Abstract: In a system and method providing for interaction with virtual objects, and interaction between virtual objects, in an augmented reality, or mixed reality, or virtual reality, environment, detected conditions may trigger animated responses from virtual objects placed in a view of a physical environment. The detected conditions may include the detection of a user within a set threshold distance or proximity, the detection of another virtual object within a set threshold placement distance or proximity, the detection of particular environmental conditions in the view of the physical environment, and other such factors. Specific behavioral animations of the virtual objects may be triggered in response to detection of specific virtual objects and/or other conditions.

Abstract: In a system and method providing for interaction with virtual objects, and interaction between virtual objects, in an augmented reality, or mixed reality, or virtual reality, environment, detected conditions may trigger animated responses from virtual objects placed in a view of a physical environment. The detected conditions may include the detection of a user within a set threshold distance or proximity, the detection of another virtual object within a set threshold placement distance or proximity, the detection of particular environmental conditions in the view of the physical environment, and other such factors. Specific behavioral animations of the virtual objects may be triggered in response to detection of specific virtual objects and/or other conditions.

Abstract: In a system and method providing for interaction with virtual objects, and interaction between virtual objects, in an augmented reality, or mixed reality, or virtual reality, environment, detected conditions may trigger animated responses from virtual objects placed in a view of a physical environment. The detected conditions may include the detection of a user within a set threshold distance or proximity, the detection of another virtual object within a set threshold placement distance or proximity, the detection of particular environmental conditions in the view of the physical environment, and other such factors. Specific behavioral animations of the virtual objects may be triggered in response to detection of specific virtual objects and/or other conditions.

Abstract: Systems and methods are described for generating a virtual reality experience including generating a user interface with a plurality of regions on a display in a head-mounted display device. The head-mounted display device housing may include at least one pass-through camera device. The systems and methods can include obtaining image content from the at least one pass-through camera device and displaying a plurality of virtual objects in a first region of the plurality of regions in the user interface, the first region substantially filling a field of view of the display in the head-mounted display device. In response to detecting a change in a head position of a user operating the head-mounted display device, the methods and systems can initiate display of updated image content in a second region of the user interface.