Abstract: Techniques are disclosed for facilitating electronic commerce in an augmented reality environment. In some embodiments, a method comprises detecting, by a mobile device, presence of the physical product or the real life service; and presenting, on the mobile device, information to conduct the transaction of a physical product or a real life service via the augmented reality environment. In some embodiments, a method comprises detecting one or more targets in the augmented reality platform using a select area in a perspective of a user, the perspective being captured by a mobile device; and prompting the user to choose an object of interest from the one or more detected targets.

Abstract: Disclosed in the embodiments of the present disclosure are a three dimension (3D) target point rendering method, apparatus, a device and a storage medium. The method comprises: selecting and determining a preset number of mesh vertexes in a target model as initial 3D target points; acquiring first depth information of the initial 3D target points, and determining a non-hidden 3D target point based on the first depth information; determining a display size and a rotation angle of the non-hidden 3D target point; and rendering the non-hidden 3D target points based on the display size and the rotation angle.

Abstract: The present invention includes vibrating a second presentation visual object with respect to a first presentation visual object so as to include a vibration component of a specific control frequency, the second presentation visual object being in contact with or in proximity to the first presentation visual object, and making an apparent force appear to be applied from the second presentation visual object to the first presentation visual object.

Abstract: The present invention embodies a novel navigational system that enhances the experience of pilots and passengers of physical aircraft (and other physical vehicles) traveling through actual three-dimensional space. In addition to facilitating the creation of a virtual course through which physical aircraft will travel while flying through actual three-dimensional space, the present invention also facilitates the creation of a virtual environment (modeling remote, inaccessible and imaginary locations) into which the virtual course is integrated, and manages the synchronization of the physical aircraft to the virtual course within the virtual environment during actual physical flight. In this manner, the present invention enhances the experience of pilots and passengers by illustrating dynamic views of the physical aircraft traveling along the virtual course within the virtual environment. The present invention enables competitive, sightseeing, educational, entertaining and various other types of experiences.

Abstract: In some embodiments, a computer system facilitates depth conflict mitigation for a virtual object that is in contact with one or more physical objects in a three-dimensional environment by changing visual properties of one or more portions of the virtual object. In some embodiments, a computer system facilitates depth conflict mitigation for a virtual object that is in contact with one or more physical objects in a three-dimensional environment by displaying the virtual object in a virtual environment within the three-dimensional environment. In some embodiments, a computer system facilitates depth conflict mitigation for a virtual object that is in contact with one or more physical objects in a three-dimensional environment by variably changing visual properties of one or more portions of the virtual object and/or by variably displaying the virtual object in a virtual environment based on one or more characteristics of the depth conflict.

Abstract: A method and apparatus for enhancing user interaction within a virtual environment by linking physical objects to corresponding virtual manifestations. The method comprises: receiving, from a scanning device, an image of a pattern on a surface of a physical object; analyzing the image to recognize the pattern and associate the pattern with corresponding virtual content stored in data storage; rendering, by the computer system, a virtual manifestation within the virtual environment; receiving, from the scanning device, an indication of an occlusion of the pattern caused by user interaction with the physical object; interpreting the occlusion based on a user input to the virtual environment; modifying the virtual manifestation in response to the user input; updating the virtual manifestation in real-time to reflect movements of the physical object.

Abstract: Techniques, which may be embodied herein as systems, computing devices, methods, algorithms, software, code, computer readable media, or the like, are described herein for generating heatmap visualizations. A heatmap visualization can be a graphical representation of data where the coordinates of a cell in the visualization can be a key that describes a group of data represented by the cell. The colors of a heatmap may indicate information about the data represented by the cell (e.g., the amount of data in the cell). These cells can be rendered by calculating a per-pixel metric rate for each dataset in the heatmap visualization and mapping a dataset's rate onto pixels within the visualization that correspond to the dataset. After this mapping, the maximum rate within the visualization can be used to determine the visualization's colors and the cells can be rendered by coloring each pixel (e.g. pixel row) in its corresponding color.

Abstract: A system for digital twinning a lift device includes a lift device, and processing circuitry. The lift device includes at least one of a sensor, a device, or an electronic control system. The processing circuitry is configured to obtain machine-specific data from the at least one of the sensor, device, or the electronic control system of the lift device. The processing circuitry is also configured to obtain a user input regarding a requested configuration of the lift device. The processing circuitry is further configured to generate a virtual lift device using the requested configuration of the lift device and the machine-specific data obtained from the lift device. The processing circuitry is further configured to operate a user device to present the virtual lift device according to the requested configuration in a virtual environment of a webpage or in an augmented reality environment.

Abstract: Provided is an information processing apparatus including a display control unit and a fitting unit. The display control unit displays a distribution image indicating distribution of a plurality of marker points extracted from a face model of a performer in a superimposed manner on a face image of the performer. The fitting unit fits the face model to the face image by using position information of a placed marker each time the marker is placed on a face of the performer after the distribution image is superimposed, and adjusts a superimposed position of the distribution image based on a fitting result.

Abstract: A wearable terminal apparatus to be worn by a user for use includes at least one processor, a camera, and a communication unit. The camera images a space as a visible region of the user. The communication unit performs data communication with an external device to be used by a remote instructor. The at least one processor transmits an image obtained by the camera to the external device via the communication unit. The at least one processor receives instruction information related to an instruction to generate an instruction image via the communication unit, the instruction being made based on the image in the external device. The at least one processor causes a display unit to display the instruction image, the instruction image being visually recognized at a position based on the received instruction information in the space. The at least one processor accepts a user operation to change the displayed instruction image and updates display of the instruction image in accordance with the user operation.

Abstract: The application discloses a method, electronic device, and storage medium for image processing, which includes: in response to determining that the trigger of an effect display function is detected, adding a virtual model to a collected image to be processed to obtain a presentation video frame; magnifying-displaying an image area of the virtual model in the presentation video frame, and processing the virtual model into a target three-dimensional effect model in response to determining that a magnification stop condition is reached; fusing the target three-dimensional effect model and a target object in the image to be processed to present a target video frame.

Abstract: Systems and methods for occluding virtual objects in an augmented reality environment are described. A method includes generating a distance map associated with a physical object, determining a location of a virtual object in an artificial-reality environment, determining, based at least in part upon the distance map and the location of the virtual object, a first portion of the physical object that is closer than a first portion of the virtual object from the viewpoint of the user, determining a second portion of the virtual object that is not obscured by the physical object from the viewpoint of the user, and rendering a display image. The display image comprises a first set of pixels corresponding to the first portion of the physical object in a first state, and the display image comprises a second set of pixels corresponding to the second portion of the virtual object in a second state.

Abstract: Described is a system for overlaying visual content onto a real-world object by identifying a prompt of a user indicating a user's intent, accessing an image template, wherein the image template includes placement of features within the image template, and processing a combination of data associated with the image template and the prompt using a generative machine learning model to generate a first populated image template in which one or more portions of the image template are populated with visual content representing the user's intent. The system then proceeds to access an image depicting a real-world object and overlay the first populated image template that includes the visual content representative of the user's intent on at least a portion of the real-world object based on the placement of the features of the image template.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for annotation of 3D models with signs of use that are visible in 2D images. In one aspect, methods are performed by data processing apparatus. The methods can include projecting signs of use in a relatively larger field of view image of an instance of an object onto a 3D model of the object based on a pose of the instance in the relatively larger field of view image, and estimating a relative pose of the instance of the object in a relatively smaller field of view image based on matches between the signs of use in the relatively larger field of view image and the same signs of use in the relatively smaller field of view image.

Abstract: This application provides an image rendering method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product. The method comprises the following steps: acquiring texture data of a virtual object; performing differential fitting processing on the texture data to obtain fitted texture data; baking the fitted texture data into a texture image to obtain a rendered texture image; and performing, based on the rendered texture image, image rendering processing corresponding to the virtual.

Abstract: A system for the recommendation of a makeup look to a user in response to data corresponding to a smart cosmetic device, wherein the recommended makeup look is presented to a user for application using the smart cosmetic device. The smart cosmetic device collects user behavioral history such as cosmetic substance usage (e.g., color and formula of a particular cosmetic substance), design configuration (e.g., spray canister, pen, and so on), and usage pattern (e.g., frequency of use for a particular cosmetic substance at a particular time of the day, a particular day of the week, or a particular event). Data associated with user behavioral history is processed by the system to generate at least one user-personalized makeup look recommendation for presentation to the user.

Abstract: A technique for rendering is provided. The technique includes determining a level of detail for a shade space texture and a screen space; shading the shade space texture having a resolution based on the level of detail; and for a reconstruction operation, performing sampling from the shade space texture, the sampling including a high frequency attenuation of samples of the shade space texture.

Abstract: A multi-viewer extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and a plurality of XR devices is described. The multi-viewer XR streaming method comprises the steps of streaming, by means of a first XR application instance of the plurality of XR application instances, first XR images to at least one XR device, wherein the first XR images correspond to virtual content viewed from a first spectator position; determining a position of the at least one XR device relative to the first spectator position; and reprojecting, by means of the at least one XR device, the first XR images based on the determined position of the at least one XR device. Further, an XR streaming system is described.

Abstract: Techniques are described for moving and aligning groups of teeth, including the teeth of an entire arch, for orthodontic treatment planning. One or more 3D models each representing one of a plurality of the patient's teeth may be analyzed to identify feature points that represent clinically relevant reference points on the tooth. An arch shape may be generated based on the feature points. One or more control points, which characterize the path of the arch shape, may then be generated (e.g., from the identified feature points). A user may provide input that modifies the positions of one or more of the control points to adjust the arrangement of teeth, thereby producing a new arch shape, and new positions of the teeth may be determined according to the new arch shape.

Abstract: In various embodiments, a computer animation application automatically solves inverse kinematic problems when generating object animations. The computer animation application determines a target vector based on a target value for a joint parameter associated with a joint chain and at least one of a target position or a target orientation for an end-effector associated with the joint chain. The computer animation application executes a trained machine learning model on the target vector to generate a predicted vector that includes data associated with multiple joint parameters associated with the joint chain.