Abstract: The subject technology identifies a set of graphical elements in an augmented reality (AR) facial pattern. The subject technology determines at least one primitive shape based on the set of graphical elements. The subject technology generates a JavaScript Object Notation (JSON) file using at least one primitive shape. The subject technology generates internal facial makeup format (IFM) data using the JSON file. The subject technology publishes the IFM data to a product catalog service.

Abstract: An information processing device includes: a processor configured to generate an body object in a virtual space corresponding to a body in a real space, associate an associated object with at least a part of the body object, the associated object being displayed in the virtual space in association with the body, and move, when movement of the body object in the virtual space is detected, the associated object while maintaining a relative positional relationship between the associated object and the body object.

Abstract: A cross reality system enables any of multiple devices to efficiently and accurately access previously persisted maps of very large scale environments and render virtual content specified in relation to those maps. The cross reality system may build a persisted map, which may be in canonical form, by merging tracking maps from the multiple devices. A map merge process determines mergibility of a tracking map with a canonical map and merges a tracking map with a canonical map in accordance with mergibility criteria, such as, when a gravity direction of the tracking map aligns with a gravity direction of the canonical map. Refraining from merging maps if the orientation of the tracking map with respect to gravity is not preserved avoids distortions in persisted maps and results in multiple devices, which may use the maps to determine their locations, to present more realistic and immersive experiences for their users.

Abstract: A method, device, and computer program product for determining quality of a wireless network, includes: connecting, by a mobile device, to one or more access points of the wireless network in a physical environment; capturing, via a camera of the mobile device, a live rendering of the physical environment; generating, by the mobile device, a rendering of the physical environment; detecting, via the mobile device, a signal quality of the connection to each of the one or more access points; storing, in memory of the mobile device, each current position and a plurality of previous positions of the mobile device in the physical environment in association with the detected signal quality; and generating, in a processor of the mobile device, a virtual path graphic by linking the current positions and the plurality of previous positions of the mobile device in the physical environment.

Abstract: In some examples, an electronic device includes a first display device and a processor. The processor determines whether the electronic device is paired with a head-mounted device comprising a second display device. In response to determining that the electronic device is paired with the head-mounted device, the processor presents first image information on the first display device, sends second image information to the head-mounted device, and coordinates with the head-mounted device to cause the head-mounted device to display the second image information on the second display device, where the first image information and the second image information are to present an aggregate view to a user of the head-mounted device.

Abstract: Systems and methods for rendering one or more different types of datasets is described. An exemplar method includes: (i) obtaining a first type of dataset, wherein each first data value within the first type of dataset is associated with one or more three-dimensional coordinates, which define a location or region in real space; (ii) obtaining a second type of dataset, wherein each second data value within the second type of dataset is associated with one or more of the three-dimensional coordinates; (iii) spatializing the first type of dataset to create a first type of spatialized dataset; (iv) spatializing the second type of dataset to create a second type of spatialized dataset; (v) aligning the first type of spatialized dataset with the second type of spatialized dataset to create an enhanced three-dimensional spatialized environment; and (vi) rendering the enhanced three-dimensional spatialized environment on a display component.

Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.

Abstract: In one implementation, a method includes: instantiating a first objective-effectuator (OE) associated with first attributes and a second OE associated with second attributes into a synthesized reality (SR) setting, wherein the first OE is encapsulated within the second OE; providing a first objective to the first OE based on the first and second attributes; providing a second objective to the second OE based on the second attributes, wherein the first and second objectives are associated with a time period between a first and second temporal points; generating a first set of actions for the first OE based on the first objective and a second set of actions for the second OE based on the second objective; and rendering for display the SR setting for the time period including the first set of actions performed by the first OE and the second set of actions performed by the second OE.

Abstract: The present disclosure relates to an AR animation generation system that detects a change in position of a mobile computing system in a real-world environment, determines that a position for a virtual object in an augmented reality (AR) scene is to be changed from a first position in the AR scene to a second position in the AR scene, identifies an animation profile to be used for animating the virtual object, wherein the animation profile is associated with the virtual object, and animates the virtual object in the AR scene using the animation profile. Animating the virtual object in the AR scene includes moving the virtual object in the AR scene from the first position to the second position along a path, wherein the path and a movement of the virtual object along the path are determined based on the animation profile.

Abstract: A computer server system comprises a communications module; a processor coupled with the communications module; and a memory coupled to the processor and storing processor-executable instructions which, when executed by the processor, configure the processor to receive, via the communications module and from a requesting device, a signal that includes a request to send a stored-value card to a recipient, the request identifying one or more parameters of the stored-value card; generate the stored-value card and a three-dimensional object representing the stored-value card according to the one or more parameters; and send, via the communications module and to a mobile device of the recipient, a signal that includes the three-dimensional object representing the stored-value card for display in augmented reality.

Abstract: A visualisation assembly including a three-dimensional physical projection object and an electronic visualisation device has: a camera for optically capturing the physical projection object; electronics having data-processing software by means of which image data can be generated from the optical capturing of the physical projection object and a rendered VR model can be generated on the basis of the image data created and the stored model data; and a display apparatus, on which the physical projection object superimposed with the rendered VR model can be displayed. The physical projection object forms a relief.

Abstract: A method for visualizing a reference object in an augmented reality (AR) workspace includes: calibrating the AR workspace by mapping a first coordinate space to the AR workspace; projecting an interface with control elements onto the AR workspace; obtaining an image of the AR workspace that includes the interface and the reference object; identifying the reference object in the image using an image recognition algorithm; retrieving a reference file associated with the reference object, where the reference file includes structural information describing one or more layers of the reference object; identifying a first point of interest (POI) on the reference object; generating, based on the structural information of the reference file, a virtual x-ray representation of structures of the reference object; projecting the virtual x-ray representation onto the AR workspace. The virtual x-ray representation includes a rendering of an internal structure of the reference object.

Abstract: A computer-implemented method implements a resilient interdependent spatial alignment (RISA) process to improve and maintain spatial alignment between two associated coordinate systems by moving a follow coordinate system to align it to a lead coordinate system. In some use cases, the coordinate systems may be a physical space and a corresponding digital model of the space. A user device such as an augmented reality headset or robotic sensors may be moving in the physical space, and alignment to the model is continually maintained, updated and improved responsive to acquired spatial data to enable, for example, holographic display of the model in the headset very closely aligned to the physical space. Multiple volumes can each have corresponding digital “spaces” or RisaSites to manage anchor data with dynamic hand-off among them while accommodating differing scale and density.

Abstract: A display driver includes interface circuitry, image processing circuitry, and drive circuitry. The interface circuitry is configured to receive a full frame image and a foveal image from a source external to the display driver. The image processing circuitry is configured to: upscale the full frame image; render a foveated image from the upscaled full frame image and the foveal image. The foveated image includes a foveal area based on the foveal image, a peripheral are based on the upscaled full frame image, and a border area based on the foveal image and the upscaled full frame image. The border area being located between the foveal area and the peripheral area. The drive circuitry is configured to drive a display panel using the foveated image.

Abstract: Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.

Abstract: A computer-implemented method for lighting subjects for artificial reality scenes may include (i) identifying (a) a physical camera configured to capture a physical subject for insertion into an artificial reality scene, (b) a physical light source that is positioned such that the physical light source lights the physical subject recorded by the physical camera, and (c) lighting conditions in the artificial reality scene, (ii) determining at least one lighting parameter to light the physical subject such that lighting conditions of the physical subject blend visually with the lighting conditions in the artificial reality scene, and (iii) configuring the physical light source to light the physical subject according to the at least one lighting parameter. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Disclosed is a three-dimensional (“3D”) scanning system that synchronizes the scanning of a scene with the viewing of the scan results relative to a live view of the scene. The system includes a first device that scans a first set of surfaces that are exposed to the first device from a first position. The system further includes a second device that receives the scan data as it is generated for each scanned surface of the first set of surfaces. The second device augments a visualization of a second set of surfaces, within a field-of-view of the second device from a second position, with the scan data that is generated for a subset of scanned surfaces from the first position corresponding to one or more surfaces of the second set of surfaces visualized from the second position.

Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.

Abstract: Disclosed is a location tracking system and associated methods for precisely locating a target device with a recipient device via different forms of location tracking and augmented reality. The recipient device receives a first position of the target device over a data network. The recipient device is moved according to the first position until the target device is in Ultra-WideBand (“UWB”) signaling range of the recipient device. The recipient device then measures a distance and direction of the target device relative to the recipient device based on Time-of-Flight (“ToF”) measurements generated from the UWB signaling. The recipient device determines a second position of the target device based on the distance and direction of the target device, and generates an augmented reality view with a visual reference at a particular position in images of a captured scene that corresponds to the second position of the target device.

Abstract: The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.