Abstract: A data stream having volumetric video data encoded therein in a scene description language, the data stream representing a scene comprising one or more objects is disclosed, wherein the data stream comprises for at least one object first mesh data, second mesh data and correspondence information, wherein the first mesh data describes the at least one object with a first mesh, the second mesh data describes the at least one object with a second mesh, and wherein the correspondence information indicates a mapping between the first and second mesh. Devices, Methods and a computer program product are also described.

Abstract: The embodiments herein provide a method and system for an augmented reality based indoor navigation. The system creates an augmented reality (AR) based fingerprinting to perform the dynamic routing. A floor wise plan of the building is uploaded. The floor plan is converted to a floor plan graph. Then cloud anchors are created and placed across the floor. An anchor is a fixed position and orientation in the real world as recognized by any Augmented Reality (AR) device. Each time an anchor is placed, its position information is fingerprinted on the floorplan graph and that fingerprinting is saved in the database. When user scans for nearest QR code to identify their current position, the user location is identified and the planogram details, fingerprinting and pre-processed floorplan matrix are obtained from database. When user selects his destination, dynamic routing is performed to obtain shortest/optimized path viewed through augmented reality fingerprinting.

Abstract: Methods, apparatus, systems are disclosed for altering displayed content on a display device responsive to a user's proximity. In accord with an example, a computing system includes a display, a sensor to output a signal, machine readable instructions, and programmable circuitry to be programmed in accordance with the instructions to determine a distance between the compute system and a person based on the signal, and cause a size of at least one object to be presented on the display to be adjusted based on the distance.

Abstract: Embodiments of the disclosure provide an effect image processing method and apparatus, an electronic device, and a storage medium. The method includes: in response to an effect trigger operation, determining at least one to-be-presented effect image, and presenting the at least one to-be-presented effect image according to a preset image present mode; in response to detecting that a page turning condition is satisfied in a present process, performing a target page turning effect on a current displayed to-be-presented effect image, and presenting the remaining to-be-presented effect image from the at least one to-be-presented effect image according to the image present mode until an effect present stop operation is received.

Abstract: An apparatus and method for an apparatus for generating a display data structure from an input signal. The apparatus includes at least a processor and a memory communicatively connected to the at least a processor, wherein the memory contains instructions configuring the at least a processor to receive an input signal, apply a momentum processing module to the input signal, receive at least one directional momentum signal for the at least a time series from the momentum processing module, apply an autoregressive signal processing module to the at least one directional momentum signal to determine at least one filtered momentum, generate a display data structure using the at least one filtered momentum signal and a plurality of threshold values, and transmit the display data structure to a remote device, wherein the display data structure is configured to cause the remote device to display the dynamic vector.

Abstract: An information processing apparatus including circuitry that acquires information indicating a spatial relationship between a real object and a virtual object, and initiate generation of a user feedback based on the acquired information, the user feedback being displayed to be augmented to a generated image obtained based on capturing by an imaging device, or augmented to a perceived view of the real world, and wherein a characteristic of the user feedback is changed when the spatial relationship between the real object and the virtual object changes.

Abstract: Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.

Abstract: Disclosed is a method including receiving data associated with at least one drone, where the data at least indicates one or more areas covered by at least one camera of the at least one drone in a real-world environment; and superimposing, on a head-mounted display, a visualization indicating the one or more areas covered by the at least one camera of the at least one drone, where the visualization is superimposed on at least one of: the one or more areas in the real-world environment, or a virtual map of the real-world environment.

Abstract: A data processing apparatus that includes an input interface to which three-dimensional data including position information of each point of a point group indicating a surface of at least one object is input; and processing circuitry that is configured to process the three-dimensional data that is input from the input interface. The processing circuitry is configured to process two-dimensional data from the three-dimensional data, identify a predetermined object among the at least one object based on the two-dimensional data, and extract predetermined three-dimensional data including the position information of each point of a point group indicating a surface of the predetermined object that is identified.

Abstract: An electronic device and a non-transitory computer-readable storage medium are provided. The electronic device includes a storage module and a processing module. The storage module is configured to store at least one program instruction. The processing module is coupled to the storage module, and is configured to load the at least one program instruction to perform the following steps: parsing a plurality of cells in an analysis area in a data sheet to identify each of the cells as a formula cell or a non-formula cell; classifying the formula cells so that the formula cells having similar formula expressions fall into the same formula group; analyzing a formula structure of the formula expressions of each formula group to output at least one recommended chart option.

Abstract: Aspects of the disclosure are directed to an artificial reality (XR) browser configured to trigger an immersive experience. Implementations display an element at a browser chrome of the XR browser when an immersive experience is loaded. For example, the XR browser can include an application programming interface (API) that supports configuration of a browser chrome element by components of a webpage. The API call can cause the display of the browser chrome element, change a display property for the browser chrome element, or configure the browser chrome element in any other suitable manner. Upon receiving input at the browser chrome element (configured by the API call), the XR browser can transition from displaying a two-dimensional panel view of a webpage supported by loaded web resources (e.g., hypertext transfer protocol (HTTP) pages, graphic images, etc.) to a three-dimensional environment supported by preloaded immersive resources (e.g., three-dimensional models, graphic images, etc.).

Abstract: One embodiment of the present invention provides an interpretation support server, an interpretation support system, an interpretation support method, an interpretation support program, and an interpretation terminal that enable a plurality of users to efficiently perform interpretation. The interpretation support server according to one aspect of the present invention classifies an operation received from a first terminal into a display operation that permits display of an operation result on a second terminal and a hide operation that prohibits display of the operation result on the second terminal, causes the second terminal to display a result of performed display operation in real time in a case where the display operation is performed at the first terminal, and prohibits the second terminal from displaying a result of performed hide operation in a case where the hide operation is performed at the first terminal.

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.

Abstract: In an approach to security for displayed confidential holographic objects, one or more computer processors receive a request from a user to display a holographic object in association with a device. One or more computer processors identify content to be moved to the holographic object. One or more computer processors determine the content includes confidential information. One or more computer processors request authentication from the user. One or more computer processors receive the authentication from the user. One or more computer processors create a holographic boundary, where the holographic boundary blocks a view of the holographic object from one or more unauthorized users. One or more computer processors display the holographic boundary. One or more computer processors display the holographic object in association with the device.

Abstract: An ergonomics evaluation system for AR applications of an AR device is described. In one aspect, a method includes accessing user interface elements of an augmented reality application, accessing a plurality of user models and corresponding simulated augmented reality device sensor data for the plurality of user models, identifying simulated user interactions, from the plurality of user models, with a simulated augmented reality device operating the augmented reality application, based on the plurality of user models and corresponding simulated augmented reality device sensor data for the plurality of user models, applying a computer vision algorithm to the simulated user interactions, identifying user postures and user motions based on the simulated user interactions, and generating a first ergonomic feedback based on the user postures and the user motions.

Abstract: A surgical system includes a camera tracking system that determines a first pose transform between a first object coordinate system and the first tracking camera coordinate system based on first object tracking information from the first tracking camera which indicates pose of the first object. The camera tracking system determines a second pose transform between the first object coordinate system and the second tracking camera coordinate system based on first object tracking information from the second tracking camera indicating pose of the first object, and determines a third pose transform between a second object coordinate system and the second tracking camera coordinate system based on second object tracking information from the second tracking camera indicating pose of the second object. The camera tracking system determines a fourth pose transform between the second object coordinate system and the first tracking camera coordinate system.

Abstract: Disclosed are systems and methods for mixed reality collaboration. A method may include receiving persistent coordinate data; presenting a first virtual session handle to a first user at a first position via a transmissive display of a wearable device, wherein the first position is based on the persistent coordinate data; presenting a virtual object to the first user at a second location via the transmissive display, wherein the second position is based on the first position; receiving location data from a second user, wherein the location data relates a position of the second user to a position of a second virtual session handle; presenting a virtual avatar to the first user at a third position via the transmissive display, wherein the virtual avatar corresponds to the second user, wherein the third position is based on the location data, and wherein the third position is further based on the first position.

Abstract: A method for displaying a three dimensional (“3D”) image includes rendering a frame of 3D image data. The method also includes analyzing the frame of 3D image data to generate best known depth data. The method further includes using the best known depth data to segment the 3D image data into near and far frames of two dimensional (“2D”) image data corresponding to near and far depths respectively. Moreover, the method includes displaying near and far 2D image frames corresponding to the near and far frames of 2D image data at near and far depths to a user respectively.

Abstract: In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on a viewpoint of a user in the three-dimensional environment. In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on viewpoints of a plurality of users in the three-dimensional environment. In some embodiments, the electronic device modifies an appearance of a real object that is between a virtual object and the viewpoint of a user in a three-dimensional environment. In some embodiments, the electronic device automatically selects a location for a user in a three-dimensional environment that includes one or more virtual objects and/or other users.

Abstract: In one embodiment, a method includes rendering, for a VR display device and based on a field of view of a user in a real-world environment, a first output image of a VR environment. The method includes determining whether the user is approaching within a threshold distance of a real-world object in the real-world environment. The method includes accessing one or more images of the real-world object in the real-world environment captured by one or more cameras of the VR display device. The method includes rendering, for the VR display device, a second output image comprising a portion of the VR environment and an outline-rendered view of the real-world object based on the accessed images.