Abstract: An apparatus such as a head-mounted display (HMD) may have a camera for capturing a visual scene for presentation via the HMD. A user of the apparatus may be operating a second, physical camera for capturing video or still images within the visual scene. The HMD may generate an augmented reality (AR) experience by presenting an AR view frustum representative of the actual view frustum of the physical camera. The field of view of the user viewing the captured visual scene via the AR experience is generally larger that the AR view frustum, allowing the user to avoid unnatural tracking movements and/or hunting for subjects.

Abstract: Techniques are disclosed for generating a three-dimensional (3D) visualization of data in an extended reality (XR) environment. One embodiment provides a computer-implemented method that includes receiving, via an input device, a repositioning of a first panel displayed within an XR environment and determining that, subsequent to the repositioning, at least one portion of the first panel overlaps with a second panel displayed within the XR environment. The method further includes, subsequent to the determination, generating a first 3D visualization of first data associated with the first panel and second data associated with the second panel. In addition, the method includes causing the first 3D visualization to be displayed within the XR environment.

Abstract: This disclosure is enables various technologies involving various actions based on an object detecting a defined area and the defined area detecting the object.

Abstract: A method for reconstructing a three-dimensional space scene based on photographing is disclosed, comprising the following steps: S1, importing photos of all spaces, and making the photos correspond to a three-dimensional space according to directions and viewing angles during capture, so that a viewing direction of each pixel, when viewed from the camera position of the three-dimensional space, is in line with that during capture; S2, regarding a room as a set of multiple planes, determining a first plane, and then determining all the planes one by one according to relationships and intersections between the planes; S3, marking a spatial structure of the room by a marking system and obtaining dimension information; and S4, establishing a three-dimensional space model of the room by point coordinate information collected in the step S3.

Abstract: Examples provide customized augmented reality item filtering. An item filter analyzes item data using selection criteria and user preferences to identify high-interest item(s) and/or low-interest item(s) within a field of view (FOV) of a user device associated with a user. A high-interest item can include an item physically present within a portion of an item selection area or an un-stocked item not physically present within the portion of the item selection area. An augmented reality (AR) generator creates an AR image including a real-world image of the portion of the item selection area overlaid with graphical elements, including positive item indicators associated with high-interest items, negative item indicators associated with low-interest items, and/or un-stocked virtual items. The AR image is updated in real-time in response to user input, promotional data associated with one or more filtered item(s), and/or changes associated with the items within the FOV of the user device.

Abstract: A display assembly displays a virtual object in a select location wherein an eye viewing the virtual object has an expected gaze direction. Deformation of the display assembly is detected. The deformation causes the virtual object to be viewable in an altered location wherein the eye has altered gaze direction. The virtual object may be displayed in a corrected location wherein the eye viewing the virtual object in the correct location has a corrected gaze direction that is moved closer to the expected gaze direction than the altered gaze direction.

Abstract: An exemplary augmentation system accesses imagery captured by a sensor of a first device, identifies a user depicted in the imagery, determines that the user is associated with a second device, determines that the second device is located within a predefined proximity range of the first device, accesses, based on the user being depicted in the imagery and the second device being located within the predefined proximity range of the first device, shared content associated with the identified user, and provides the shared content for display as an augmentation for the imagery captured by the sensor of the first device. Corresponding methods and systems are also disclosed.

Abstract: The disclosure describes a distributed, pluggable architecture for an artificial reality (AR) system that enables concurrent execution and collaborative scene rendering for multiple artificial reality applications. For example, an AR system includes an image capture device configured to capture image data representative of a physical environment. The AR system also includes a head-mounted display (HMD) configured to output artificial reality content. The AR system further includes a plurality of concurrently executing artificial reality client applications. The AR system also includes a concurrent application engine configured to control rendering the artificial reality content as a common scene that include one or more objects from each of the plurality of artificial reality applications.

Abstract: A method and a device for controlling at least one device in a wireless communication system are provided. The method includes rendering a digital representation of a real world environment on a display unit, wherein the digital representation includes a graphical representation of the at least one device based on a status information of the at least one device; receiving a user-input indicating control information of the at least one device; and controlling one or more operations of the at least one device in the real world environment based on the control information.

Abstract: In some implementations, a first electronic device including a first image sensor uses a processor to perform a method. The method involves obtaining a first set of keyframes based on images of a physical environment captured by the first image sensor. The method generates a mapping defining relative locations of keyframes of the first set of keyframes. The method receives a keyframe corresponding to an image of the physical environment captured at a second, different electronic device and localizes the received keyframe to the mapping. The method then receives an anchor from the second electronic device that defines a position of a virtual object relative to the keyframe. The method displays a CGR environment including the virtual object at a location based on the anchor and the mapping.

Abstract: Dual-mode augmented reality interfaces for mobile devices are disclosed herein. A dual-mode augmented reality interface of a mobile device includes a first mode to be presented via a user interface of the mobile device in response to detecting an occurrence of a first motion of the mobile device. The dual-mode augmented reality interface further includes a second mode to be presented via the user interface in response to detecting an absence of the first motion. The second mode is different from the first mode. The first mode may be a browsing mode, and the second mode may be a learning mode. The first motion may be a panning motion.

Abstract: A method, system, and computer program product for detecting, by measuring a signal indicative of a movement of a facial muscle, a motion pattern; deriving, from the motion pattern, a derived motion pattern, wherein the motion pattern and the derived motion pattern each corresponds to different emotional responses of a class of emotional responses; creating an emotional model for the class of emotional responses based on the motion pattern and the derived motion pattern; and reconfiguring the derived motion pattern to a new motion pattern by (i) comparing the new motion pattern and the derived motion pattern and (ii) associating, based on the comparison, the new motion pattern with the class of emotional responses, wherein the derived motion pattern and the new motion pattern fail to be detected via muscle movement prior to the motion pattern.

Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.

Abstract: One or more computing devices, systems, and/or methods for monitoring a video are provided. For example, the video may be rendered within a canvas overlaying a webpage within a web browser. The video may comprise an opaque portion (e.g., a bike) and a transparent portion (e.g., a transparent background such that the bike appears to be driving across the webpage as the video plays). User input associated with the canvas may be evaluated to determine whether the user input occurs over the opaque portion or the transparent portion. Responsive to the user input occurring over the opaque portion, the web browser may be transitioned from the webpage to a biking website linked to by the video. Responsive to the user input occurring over the transparent portion, the canvas may be closed to terminate the video.

Abstract: A method for generating a first person view (FPV) of an environment includes, with aid of one or more processors individually or collectively, analyzing stereoscopic video data of the environment to determine environmental information and generating augmented stereoscopic video data of the environment by fusing the stereoscopic video data and the environmental information.

Abstract: An apparatus configured to render an object including a path includes a storage circuit, an arithmetic circuit configured to determine a direction of a plurality of primitives included in the path based on path data, generate primitive direction information, store the primitive direction information in the storage circuit, and generate a winding number of each of a plurality of pixels using the stored primitive direction information, and a determination circuit configured to determine whether a shading operation is to be performed based on the generated winding number.

Abstract: An acquisition unit acquires design data which is three-dimensional data indicating a terrain. A gradient identification unit identifies a gradient of each of the plurality of polygons configuring the design data. An attribute setting unit sets an attribute for each of the plurality of polygons based on the gradient.

Abstract: A display apparatus and method. A display apparatus including a display control unit configured to display a moving image on a first region of a display screen; and a thumbnail generation unit configured to generate a plurality of thumbnail images based on a plurality of still images related to the moving image, wherein the display control unit is configured to display the plurality of thumbnail images on a second region of the display screen.

Abstract: A display driver circuit includes a receiver that receives a still image or a moving image, a frame buffer that stores the still image received by the receiver in a still image mode, an image processor that performs an image enhancement operation on the moving image transferred from the receiver or the still image transferred from the frame buffer, and a motion processor that performs a motion compensation operation using a current frame output from the image processor and a previous frame stored in the frame buffer in a moving image mode. The previous frame is data which, in the moving image mode, are processed by the image processor before the current frame and are then stored in the frame buffer. The previous frame is output from the frame buffer to the motion processor in synchronization with the current frame.

Abstract: The techniques disclosed herein improve the efficiency of a system by providing intelligent management of content that is associated with objects displayed within communication sessions. The participants can generate a content object associated with a 3D object. The content object may be in the form of 3D virtual object such as an arrow pointing to the table, a text box of an annotation, etc. The content object may also include functional features that collect and display information voting agent. The system can generate a data structure that associates the object with the content object. The data structure enables a system to maintain an association between the object and the content object when various operations are applied to either object. Thus, if a remote computer sends a request for the content object, the associated object is delivered with the content object.