Abstract: The present invention embodies a novel navigational system that enhances the experience of pilots and passengers of physical aircraft (and other physical vehicles) traveling through actual three-dimensional space. In addition to facilitating the creation of a virtual course through which physical aircraft will travel while flying through actual three-dimensional space, the present invention also facilitates the creation of a virtual environment (modeling remote, inaccessible and imaginary locations) into which the virtual course is integrated, and manages the synchronization of the physical aircraft to the virtual course within the virtual environment during actual physical flight. In this manner, the present invention enhances the experience of pilots and passengers by illustrating dynamic views of the physical aircraft traveling along the virtual course within the virtual environment. The present invention enables competitive, sightseeing, educational, entertaining and various other types of experiences.

Abstract: In some embodiments, a computer system facilitates depth conflict mitigation for a virtual object that is in contact with one or more physical objects in a three-dimensional environment by changing visual properties of one or more portions of the virtual object. In some embodiments, a computer system facilitates depth conflict mitigation for a virtual object that is in contact with one or more physical objects in a three-dimensional environment by displaying the virtual object in a virtual environment within the three-dimensional environment. In some embodiments, a computer system facilitates depth conflict mitigation for a virtual object that is in contact with one or more physical objects in a three-dimensional environment by variably changing visual properties of one or more portions of the virtual object and/or by variably displaying the virtual object in a virtual environment based on one or more characteristics of the depth conflict.

Abstract: A method and apparatus for enhancing user interaction within a virtual environment by linking physical objects to corresponding virtual manifestations. The method comprises: receiving, from a scanning device, an image of a pattern on a surface of a physical object; analyzing the image to recognize the pattern and associate the pattern with corresponding virtual content stored in data storage; rendering, by the computer system, a virtual manifestation within the virtual environment; receiving, from the scanning device, an indication of an occlusion of the pattern caused by user interaction with the physical object; interpreting the occlusion based on a user input to the virtual environment; modifying the virtual manifestation in response to the user input; updating the virtual manifestation in real-time to reflect movements of the physical object.

Abstract: Techniques, which may be embodied herein as systems, computing devices, methods, algorithms, software, code, computer readable media, or the like, are described herein for generating heatmap visualizations. A heatmap visualization can be a graphical representation of data where the coordinates of a cell in the visualization can be a key that describes a group of data represented by the cell. The colors of a heatmap may indicate information about the data represented by the cell (e.g., the amount of data in the cell). These cells can be rendered by calculating a per-pixel metric rate for each dataset in the heatmap visualization and mapping a dataset's rate onto pixels within the visualization that correspond to the dataset. After this mapping, the maximum rate within the visualization can be used to determine the visualization's colors and the cells can be rendered by coloring each pixel (e.g. pixel row) in its corresponding color.

Abstract: A system for digital twinning a lift device includes a lift device, and processing circuitry. The lift device includes at least one of a sensor, a device, or an electronic control system. The processing circuitry is configured to obtain machine-specific data from the at least one of the sensor, device, or the electronic control system of the lift device. The processing circuitry is also configured to obtain a user input regarding a requested configuration of the lift device. The processing circuitry is further configured to generate a virtual lift device using the requested configuration of the lift device and the machine-specific data obtained from the lift device. The processing circuitry is further configured to operate a user device to present the virtual lift device according to the requested configuration in a virtual environment of a webpage or in an augmented reality environment.

Abstract: Provided is an information processing apparatus including a display control unit and a fitting unit. The display control unit displays a distribution image indicating distribution of a plurality of marker points extracted from a face model of a performer in a superimposed manner on a face image of the performer. The fitting unit fits the face model to the face image by using position information of a placed marker each time the marker is placed on a face of the performer after the distribution image is superimposed, and adjusts a superimposed position of the distribution image based on a fitting result.

Abstract: A wearable terminal apparatus to be worn by a user for use includes at least one processor, a camera, and a communication unit. The camera images a space as a visible region of the user. The communication unit performs data communication with an external device to be used by a remote instructor. The at least one processor transmits an image obtained by the camera to the external device via the communication unit. The at least one processor receives instruction information related to an instruction to generate an instruction image via the communication unit, the instruction being made based on the image in the external device. The at least one processor causes a display unit to display the instruction image, the instruction image being visually recognized at a position based on the received instruction information in the space. The at least one processor accepts a user operation to change the displayed instruction image and updates display of the instruction image in accordance with the user operation.

Abstract: The application discloses a method, electronic device, and storage medium for image processing, which includes: in response to determining that the trigger of an effect display function is detected, adding a virtual model to a collected image to be processed to obtain a presentation video frame; magnifying-displaying an image area of the virtual model in the presentation video frame, and processing the virtual model into a target three-dimensional effect model in response to determining that a magnification stop condition is reached; fusing the target three-dimensional effect model and a target object in the image to be processed to present a target video frame.

Abstract: Systems and methods for occluding virtual objects in an augmented reality environment are described. A method includes generating a distance map associated with a physical object, determining a location of a virtual object in an artificial-reality environment, determining, based at least in part upon the distance map and the location of the virtual object, a first portion of the physical object that is closer than a first portion of the virtual object from the viewpoint of the user, determining a second portion of the virtual object that is not obscured by the physical object from the viewpoint of the user, and rendering a display image. The display image comprises a first set of pixels corresponding to the first portion of the physical object in a first state, and the display image comprises a second set of pixels corresponding to the second portion of the virtual object in a second state.

Abstract: Described is a system for overlaying visual content onto a real-world object by identifying a prompt of a user indicating a user's intent, accessing an image template, wherein the image template includes placement of features within the image template, and processing a combination of data associated with the image template and the prompt using a generative machine learning model to generate a first populated image template in which one or more portions of the image template are populated with visual content representing the user's intent. The system then proceeds to access an image depicting a real-world object and overlay the first populated image template that includes the visual content representative of the user's intent on at least a portion of the real-world object based on the placement of the features of the image template.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for annotation of 3D models with signs of use that are visible in 2D images. In one aspect, methods are performed by data processing apparatus. The methods can include projecting signs of use in a relatively larger field of view image of an instance of an object onto a 3D model of the object based on a pose of the instance in the relatively larger field of view image, and estimating a relative pose of the instance of the object in a relatively smaller field of view image based on matches between the signs of use in the relatively larger field of view image and the same signs of use in the relatively smaller field of view image.

Abstract: This application provides an image rendering method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product. The method comprises the following steps: acquiring texture data of a virtual object; performing differential fitting processing on the texture data to obtain fitted texture data; baking the fitted texture data into a texture image to obtain a rendered texture image; and performing, based on the rendered texture image, image rendering processing corresponding to the virtual.

Abstract: A system for the recommendation of a makeup look to a user in response to data corresponding to a smart cosmetic device, wherein the recommended makeup look is presented to a user for application using the smart cosmetic device. The smart cosmetic device collects user behavioral history such as cosmetic substance usage (e.g., color and formula of a particular cosmetic substance), design configuration (e.g., spray canister, pen, and so on), and usage pattern (e.g., frequency of use for a particular cosmetic substance at a particular time of the day, a particular day of the week, or a particular event). Data associated with user behavioral history is processed by the system to generate at least one user-personalized makeup look recommendation for presentation to the user.

Abstract: A technique for rendering is provided. The technique includes determining a level of detail for a shade space texture and a screen space; shading the shade space texture having a resolution based on the level of detail; and for a reconstruction operation, performing sampling from the shade space texture, the sampling including a high frequency attenuation of samples of the shade space texture.

Abstract: A multi-viewer extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and a plurality of XR devices is described. The multi-viewer XR streaming method comprises the steps of streaming, by means of a first XR application instance of the plurality of XR application instances, first XR images to at least one XR device, wherein the first XR images correspond to virtual content viewed from a first spectator position; determining a position of the at least one XR device relative to the first spectator position; and reprojecting, by means of the at least one XR device, the first XR images based on the determined position of the at least one XR device. Further, an XR streaming system is described.

Abstract: Techniques are described for moving and aligning groups of teeth, including the teeth of an entire arch, for orthodontic treatment planning. One or more 3D models each representing one of a plurality of the patient's teeth may be analyzed to identify feature points that represent clinically relevant reference points on the tooth. An arch shape may be generated based on the feature points. One or more control points, which characterize the path of the arch shape, may then be generated (e.g., from the identified feature points). A user may provide input that modifies the positions of one or more of the control points to adjust the arrangement of teeth, thereby producing a new arch shape, and new positions of the teeth may be determined according to the new arch shape.

Abstract: In various embodiments, a computer animation application automatically solves inverse kinematic problems when generating object animations. The computer animation application determines a target vector based on a target value for a joint parameter associated with a joint chain and at least one of a target position or a target orientation for an end-effector associated with the joint chain. The computer animation application executes a trained machine learning model on the target vector to generate a predicted vector that includes data associated with multiple joint parameters associated with the joint chain.

Abstract: A customized computer-generated virtual environment corresponding to an environment familiar to a user for providing items in locations that are familiar to the user based on corresponding real-world environments and locations is provided. In association with the customized computer-generated virtual environment, a method may include generating an interactive virtual environment, wherein the generated interactive virtual environment includes virtual rooms and virtual areas based on the familiar environment. The method may also include identifying an item and a location of the item in the familiar environment, and correlating and associating the identified item with a corresponding location in the generated interactive virtual environment. The method may further include identifying and retrieving different items having a determined similarity to the identified item.

Abstract: A method of operating a service providing device includes: collecting a source image and processing face warping of the collected source image to transform the collected source image into a warping image based on a benchmark image; constructing, using the face warped source image, a style database to which style information of the source image is mapped; and providing a style recommendation service based on style transfer using the style database. The providing includes: performing face warping on a user image input from a user terminal; performing style transfer of the face warped source image in response to the face warped user image; and processing face reverse warping of the image subjected to the style transfer to output as a virtual style synthesis image.

Abstract: Disclosed is a method for encoding 3D volumetric data to estimate pose and shape data from 3D volumetric data, generate a 3D estimation model by applying the estimated data to a 3D template model, and encode residual data of the 3D volumetric data together with the 3D estimation model, and the method includes: (a) receiving 3D volumetric data; (c) estimating a 3D pose from the 3D volumetric data; (d) estimating a 3D shape from the 3D volumetric data; (e) generating a 3D estimation model by modifying a predefined 3D template model; (f) calculating a residual of the 3D volumetric data with respect to the 3D estimation model; and (h) generating the pose estimation data, the shape estimation data and data on the residual as transmission data. Accordingly, an amount of data in the 3D volumetric model is significantly reduced and complexity is reduced.