Abstract: A method of decoding a point cloud comprises: reconstructing a position of a point of the point cloud; determining a quantized attribute value for the point; deriving a quantization parameter (QP) bit depth offset for the point; deriving a QP range for the point based on the QP bit depth offset for the point; determining a quantization step size for the point based on the QP range for the point; and inverse quantizing the quantized attribute value for the point based on the quantization step size for the point.

Abstract: Systems and methods for attaching a virtual input device to a virtual object in a mixed reality (MR) environment are provided. The system includes a memory, a processor communicatively coupled to the memory, and a display device. The display device is configured to display a MR environment provided by at least one application implemented by the processor. The mixed reality environment includes a virtual object corresponding to an application, and a virtual input device. The at least one application docks the virtual input device to the virtual object with an offset relative to the virtual object.

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may provide immersive VR experiences by replacing the view of the real world with virtual environments. Active vehicle systems and/or vehicle control systems may be integrated with the VR system to provide physical effects with the virtual experiences. The virtual environments may be altered to accommodate a passenger upon determining that the passenger is prone to or is exhibiting signs of motion sickness.

Abstract: Lidar systems and methods are presented herein. In one embodiment, a lidar system includes a laser operable to propagate ultrashort laser pulses to a target during a plurality of scanning periods. The lidar system also includes a streak tube imaging system operable to collect returns of the ultrashort laser pulses from the target during each scanning period, and to generate a two-dimensional image of the returns during each scanning period. The lidar system also includes a processor operable to generate a representation of the target based on the 2D images from the streak tube imaging system.

Abstract: This disclosure provides a method for embedding information into a video, a computer device, and a storage medium. The method includes: constructing a model conforming to a pixel distribution characteristic of the first embedding region; controlling update of the model based on a subsequent to-be-processed frame of the reference frame; identifying a background and a foreground of a second embedding region in the to-be-processed frame based on the model; generating a template used for occluding the background and exposing the foreground; applying the template to to-be-embedded information to generate an updated to-be-embedded information by occluding region of the to-be-embedded information corresponding to the foreground; and overlaying the second embedding region with the updated to-be-embedded information, so that the foreground of the second embedding region is devoid of occlusion by the overlaid to-be-embedded information.

Abstract: A dynamic user interface (UI) input system and method for smart glasses based on availability states of a user is provided. In embodiments, a method includes determining, by a computing device of smart glasses, an initial availability state of a user's hands for a user interface (UI) navigation event based on incoming image data; selecting, by the computing device, a UI configuration and a control profile for the UI navigation event from stored UI configurations and control profiles of the user based on the initial availability state of the user's hands; and initiating, by the computing device, the UI navigation event based on the selected UI configuration and the control profile, wherein content is displayed in a virtual UI of the smart glasses according to the UI configuration, and UI navigation by the user is controlled based on the control profile.

Abstract: Free space machine interface and control can be facilitated by predictive entities useful in interpreting a control object's position and/or motion (including objects having one or more articulating members, i.e., humans and/or animals and/or machines). Predictive entities can be driven using motion information captured using image information or the equivalents. Predictive information can be improved applying techniques for correlating with information from observations.

Abstract: A method, user device, and system for displaying augmented anatomical features is disclosed. The method includes detecting a target individual, displaying a visual representation of the body, and determining an anatomical profile of the target individual based on a plurality of reference markers. The method further includes displaying, on the display, a graphical representation of the inner anatomical features onto the visual representation of the body so as to assist in the identification of the inner anatomical features. In another aspect, an initial three-dimensional representation of the body is mapped and a preferred anatomical profile is determined based upon the reference markers. The initial three-dimensional representation of the body is modified to be the shape of the preferred anatomical profile and displayed.

Abstract: An apparatus and method are described for using tessellation hardware to generate bounding volume hierarchies (BVHs) and perform other ray tracing operations. For example, one embodiment of an apparatus comprises: a shader to output a plurality of tessellation factors and one or more input surfaces; and a tessellation circuit comprising first circuitry and/or logic to tessellate each input surface to generate a new set of primitives and second circuitry and/or logic to concurrently generate a bounding volume hierarchy (BVH) 1521 based on the new set of primitives.

Abstract: A depth image engine and a depth image calculation method are provided. The depth image engine comprises: a buffer, configured to receive a data flow of a first image; an image rotator, configured to perform, after the buffer receives the entire data flow of the first image, a rotation operation on the first image to generate a second image; and a depth value calculator, configured to receive the second image and a reference image to perform a matching calculation on the second image and the reference image to generate a depth image.

Abstract: A processor may receive an image of a user and an avatar representing the user within a computing environment. The processor may generate a score for the avatar on the basis of its resemblance to the image using a machine learning (ML) process. The processor may configure at least one option for action by the user within the computing environment according to the score.

Abstract: A simultaneous localization and mapping-based electronic device includes: a data acquisition device configured to acquire external data; a memory; and a processor configured to be operatively connected to the data acquisition device and the memory, wherein the processor is further configured to extract features of surrounding objects from the acquired external data, calculate a score of a registration error of the extracted features when the number of the extracted features is greater than a set number stored in the memory, and select the set number of features from the among the extracted features, based on the calculated score.

Abstract: An amusement park system includes a modular attraction system having a ride vehicle having seats to accommodate passengers, an on-board system integrated with the ride vehicle and having on-board game systems connected via a network. Each on-board game system is configured to provide an augmented reality (AR) experience, or a virtual reality (VR) experience, or both, via a respective visual experience generator device. The AR experience, or the VR experience, or both, is provided within a game shared between the on-board game systems. The on-board game systems are integrated into the ride vehicle, and are connected via the network to one another in a manner that allows for ready removal of all or a portion of one of the on-board game systems without affecting operation of the remaining on-board game systems.

Abstract: Element rendering method and devices, a computer-readable storage medium, and a computer devices are disclosed. The method includes: acquiring at least one to-be-rendered element and a target display position corresponding to each to-be-rendered element; searching a locally stored element bitmap for each to-be-rendered element; if the to-be-rendered element is found from the element bitmap, determining an arrangement position of the to-be-rendered element in the element bitmap; otherwise, drawing the to-be-rendered element in an empty area, and determining an arrangement position of the drawn to-be-rendered element in the element bitmap; and triggering to render and display each to-be-rendered element at a corresponding target display position based on the element bitmap of each to-be-rendered element and the arrangement position of each to-be-rendered element in the element bitmap. The solution provided by this application can efficiently draw rendering elements.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.

Abstract: The technical problem of adding content that originates from a third party application to an augmented reality component maintained by a messaging server system is addressed by configuring the augmented reality component to modify content captured by a camera according to values of one or more attributes and by permitting delivery of said values, from the third party application to the messaging server system, in the payload of a deep link that references the identification of the augmented reality component.

Abstract: In an aspect, an apparatus for generating an augmented reality is presented. An apparatus includes at least a processor and a memory communicatively connected to the at least a processor. A memory includes instructions configuring at least a processor to receive optical data through a sensing device in electronic communication with at least a processor. At least a processor is configured to generate an augmented reality view through a display device as a function of optical data. An augmented reality view includes a virtual avatar. At least a processor is configured to analyze at least an environmental element of optical data. At least a processor is configured to compare at least an environmental element to a priority threshold. At least a processor is configured to display at least a message through a display device as a function of a comparison.

Abstract: A display control device provided at a vehicle and including a processor, a first display section, a second display section adjacent to the first display section, and a third display section adjacent to the second display section in a different direction from the first display section. The processor being configured to: control the first display section, the second display section, and the third display section; acquire notification information to be notified to a driver of the vehicle; and execute an animation such that the notification information currently being displayed on one of the first display section or the third display section is displayed on the second display section and then displayed on another of the first display section or the third display section.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for changing perception of artificial reality content in a shared artificial reality environment. Various aspects may include determining user perception preferences associated with a user representation in the environment. Aspects may also include generating coordinates of a coordinate system and determining a distance between coordinates. Aspects may also include changing a perception parameter corresponding to the user representation based on the determined distances. Aspects may also include determining a visual style of the user representation based on an associated selected artificial reality application. Aspects may include providing instructions to display a virtual area including the user representation according to determined visual style and changed perception parameter.

Abstract: A cradle can be used to capture video of an object, such as hair. That video can then be used to extract and visualize color information relating to that material using a colorcloud. The colorcloud contains all the colors that were present in one or more frames of the video. The cradle comprises a video recording device that is able to see the material through a window on the cradle. A smartphone can be used with the cradle to act as the video recording device, as well as provide lighting.