Abstract: A method for dynamically presenting labels with the same information respectively to first and second users in a common extended reality environment includes displaying a first label with first text to a first user and a different second label with second text to a second user based on the respective positions of each user in the extended reality environment. The first user sees the first label without seeing the second label and the second user sees the second label without seeing the first label.

Abstract: An electronic device is provided. The electronic device includes a memory and at least one processor.

Abstract: The present invention provides a data processing method and server based on voxel data, a medium, and a computer program product. Pixel data is converted into voxel data, and this is highly compatible with a GPU operation. Layer data and connection data are designed from the voxel data, and a parallel computing speed is faster by using the layer data and the connection data, so that compared with the existing CPU computing mode, the performance of the GPU-based data computing solution is 2 to 3 orders of magnitude higher than that of the CPU-based computing mode, making the AI algorithm more refined and higher anthropomorphic. In the dynamic update process, due to the fast parallel computing speed, the data of the global super-large map of the game can be quickly updated.

Abstract: Extended reality (XR) management systems and techniques are described. In some examples, an XR management system receives sensor data from an XR interface device having at least one sensor. The XR management system generates, based on the receipt of the sensor data from the XR interface device, processing instructions for an XR processing device to process the sensor data to generate XR content. The XR management system sends the sensor data and the processing instructions to the XR processing device. The XR management system receives the XR content from the XR processing device. The XR management system generates layer content. The XR management system sends the XR content and the layer content to the XR interface device to cause the XR interface device to output the XR content and the layer content in a layered arrangement.

Abstract: A system for customization of augmented reality (AR) effects is described. The operations performed by the system includes determining whether a user media texture has been uploaded and assign a user media texture index to the uploaded media texture asset. The indexed uploaded media texture asset is provided and AR effect on digital content is deployed.

Abstract: Techniques for augmenting repair of a network failure in a Passive Optical Network (PON) include receiving sensor data at a client device indicating a current environment that includes an optical network terminal (ONT) in a PON. The PON includes an optical line terminal (OLT) optically connected to the ONT via one or more optical fibers. The client device analyzes the current environment to detect a cause of a network failure corresponding to the ONT, and generates a set of instructions for repairing the ONT based on the detected cause of the network failure. Then the client device provides the set of instructions for a user to follow to repair the ONT. The set of instructions are provided as the user repairs the ONT.

Abstract: Various implementations provide a representation of at least a portion of a user within a three-dimensional (3D) environment other than the user's physical environment. Based on detecting a condition, a representation of another object of the user's physical environment is shown to provide context. As examples, a representation of a sitting surface may be shown based on detecting that the user is sitting down, representations of a table and coffee cup may be shown based on detecting that the user is reaching out to pick up a coffee cup, a representation of a second user may be shown based on detecting a voice or the user turning his attention towards a moving object or sound, and a depiction of a puppy may be shown when the puppy's bark is detected.

Abstract: The systems and methods display, by at least one processor on a first portion of a real-world environment visible on a display of a user device, one or more virtual objects at a first virtual coordinate in three-dimensional (3D) space. The systems and methods receive a request to move the one or more virtual objects to a second virtual coordinate in 3D space. The systems and methods in response to receiving the request, maintain display of the one or more virtual objects at the second virtual coordinate as a second portion of the real-world environment is visible on the display of the user device.

Abstract: Methods, systems, mobile devices, and non-transitory computer-readable mediums for determining a scale of an object with a mobile device. The mobile device includes at least one object-facing camera (e.g., a monocular camera) and an away-facing stereo camera system. Information captured using the away-facing stereo camera system is used to estimate relative pose information for determining the scale of the object in images captured by the object-facing camera. The proposed system leverages the scene images surrounding the mobile device to resolve scale ambiguity and calculate the absolute scale.

Abstract: Ray tracing systems and computer-implemented methods for generating a hierarchical acceleration structure for intersection testing in a ray tracing system. Nodes of the hierarchical acceleration structure are determined, wherein each of the nodes represents a region in a scene, and wherein the nodes are linked to form the hierarchical acceleration structure. Data is stored representing the hierarchical acceleration structure including data defining the regions represented by a plurality of the nodes of the hierarchical acceleration structure. At least one node is an implicitly represented node, wherein data defining a region represented by an implicitly represented node is not explicitly included as part of the stored data but can be inferred from the stored data.

Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.

Abstract: A method for integrating media content with a three-dimensional (3D) scene to provide an immersive view of a location includes obtaining a 3D scene of the location which is generated based on a plurality of images, receiving media content temporally associated with the location, integrating at least a portion of the media content with the 3D scene of the location, and providing the integrated 3D scene of the location having the at least the portion of the media content integrated with the 3D scene of the location to represent a state of the location based on the temporal association of the media content with the location.

Abstract: Various implementations disclosed herein include devices, systems, and methods that adjust a combined user representation via light normalization techniques. For example, a process may include obtaining a first user representation of at least a first portion of a user generated via a first technique based on the user in a first lighting condition in a first physical environment. The process may further include obtaining a second user representation of at least a second portion of the user, the second user representation being generated by generating and delighting an initial user representation based on a lighting representation of a second physical environment having a second lighting condition, and producing the second user representation by relighting the delighted initial user representation based on the first lighting condition. The process may further include generating combined user representation based on the first user representation and the second user representation.

Abstract: The present invention relates to an editing method of a dynamic spectrum program, which includes the following steps. Downloading the spectral recipe is to download the spectral recipe with multi light scene with specific color temperature or at least one specific color temperature to the editing device through the internet, and connect the editing device with the software as a service system or platform as a service system configured in the cloud. Perform the correlation editing between the specific function and the spectral recipe. The editing device divides the specific function to be achieved into multiple blocks through the software as a service system or the platform as a service system, and the blocks correspond to the spectral recipe of the multi light scene respectively. And forming a functional dynamic spectrum program, which is to configure multiple blocks for corresponding time to form a dynamic spectrum program.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate a shared control of a virtual object by two or more users. A virtual object is displayed by a first device, for example, as part of an augmented reality experience where the display of the object is overlaid on a real-world environment. User input indicative of a modification to the virtual object is received. The virtual object is modified, and a modified virtual object is displayed by a second device.

Abstract: The digital content platform is a series of groundbreaking technologies, namely its innovative Blockchain-based scarcity liking system, its 3D augmented reality recording methodology, and its storage and transmission mechanism of that 3D content. The technology behind the present invention solves multiple issues that currently exist within the technology space to democratize innovation and technology for the masses. The present invention uses cryptocurrency and Blockchain technology to implement a liking system that allows creators to mint their content as an NFT that users can then “like” with Carbon12 cryptocurrency, effectively restoring creators to a position of ownership over their data and allowing users to view content in an ad-free environment catered to their experience.

Abstract: A transparent optical module system or device comprising an optical architecture hierarchy based on a patch unit. In aspects, the transparent optical module comprises a display sparsely populated with pixels. The patch unit comprises one or more regions of display pixels, or a pixel pattern(s), and an associated lenslet, for example on a microlens array. The lenslet is capable of transmitting display-emitted light to an eye of the wearer of the transparent optical module, which then focuses the light to form a retinal image, which is seen or perceived by the wearer. The patch units can be combined further into patch groups, wherein members of a group serve a similar role in retinal image production as a patch unit and/or lenslet. This hierarchy allows the system to be scaled to larger and more complex systems.

Abstract: A haptic rendering device and corresponding rendering method allow to render a haptic effect defined in a haptic signal comprising information representative of an immersive scene description. The immersive scene comprises information representative of at least one element of the scene and information representative of a haptic object, comprising a type of haptic effect, at least one parameter of the haptic effect, and a haptic volume or surface where the haptic effect is active. The parameter of the haptic effect may be a haptic texture map. A corresponding syntax is proposed.

Abstract: A method for processing media content includes aggregating, by at least one hardware processor, a plurality of three-dimensional (3D) images to obtain a 3D volume representation of a plurality of two-dimensional (2D) images of media content. A 3D void space associated with the plurality of 2D images is segmented based on the 3D volume representation into a plurality of 3D void segments. A media element is inserted into at least one 3D void segment of the plurality of 3D void segments. At least one 2D image of the plurality of 2D images is modified to include the at least one 3D void segment.

Abstract: Methods and systems are disclosed for performing operations for deforming an external mesh. The operations comprise receiving a video that includes a depiction of a real-world object. The operations comprise generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video. The operations comprise obtaining an external mesh associated with an Augmented-Reality (AR) element. The operations comprise accessing a plurality of deformation attributes associated with the external mesh, each attribute corresponding to a different deformation model. The operations comprise separately deforming, based on respective deformation models, a first portion of the external mesh and a second portion of the external mesh. The operations comprise modifying the video to include a display of the AR element based on the separately deformed first and second portions of the external mesh.