Abstract: An augmented reality (AR) display device can display a virtual assistant character that interacts with the user of the AR device. The virtual assistant may be represented by a robot (or other) avatar that assists the user with contextual objects and suggestions depending on what virtual content the user is interacting with. Animated images may be displayed above the robot's head to display its intents to the user. For example, the robot can run up to a menu and suggest an action and show the animated images. The robot can materialize virtual objects that appear on its hands. The user can remove such an object from the robot's hands and place it in the environment. If the user does not interact with the object, the robot can dematerialize it. The robot can rotate its head to keep looking at the user and/or an object that the user has picked up.

Abstract: A tool allows a user to create new designs for apparel and preview these designs in three dimensions before manufacture. Software and lasers are used in finishing apparel to produce a desired wear pattern or other design. Based on a laser input file with a pattern, a laser will burn the pattern onto apparel. With the tool, the user will be able to create, make changes, and view images of a design, in real time, before burning by a laser. Input to the tool includes fabric template images, laser input files, and damage input. The tool allows adding of tinting and adjusting of intensity and bright point. The user can also move, rotate, scale, and warp the image input.

Abstract: A first electronic device with one or more processors, memory, one or more cameras, and a display generation component captures, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device. The position information indicates a location of the second electronic device within an augmented reality environment that includes a physical environment in which the first electronic device and the second electronic device are located. The first electronic device, after capturing the image of the second electronic device that includes the position information, displays, via the display generation component of the first electronic device, one or more virtual objects within the augmented reality (AR) environment using the position information captured from the second electronic device.

Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including dividing responsibility for the rendering geometry of the graphics between the plurality of GPUs based on a plurality of screen regions, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs. The method including generating information regarding a piece of geometry with respect to a first screen region for which a first GPU has a first division of responsibility, while rendering the piece of geometry at a second GPU for an image. The method including rendering the piece of geometry at the first GPU using the information.

Abstract: In one implementation, a method for generating a blended animation. The method includes: obtaining a motion input vector for a current time period; generating a motion output vector and pose information for the current time period based on the motion input vector; selecting an animated motion from a bank of animated motions for the current time period that matches the pose information within a threshold tolerance value; obtaining a blending coefficients vector for the current time period; generating a blended animation for the current time period by blending the motion output vector with the animated motion based on the blending coefficients vector; and generating a reward signal for the blended animation for the current time period.

Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.

Abstract: Methods, apparatus, systems and articles of manufacture are disclosed for augmented reality measuring of equipment. An example apparatus disclosed herein includes an image comparator to compare camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data, and an inspection image analyzer to, in response to the image comparator identifying the vehicle part, measure the vehicle part by causing an interface generator to generate an overlay representation of the reference vehicle part on the camera data displayed on a user interface, and determining, based on one or more user inputs to adjust the overlay representation, a measurement corresponding to the vehicle part.

Abstract: In one embodiment, a method includes instructing, at a first time, a camera having a plurality of pixel sensors to capture a first image of an environment comprising an object to determine a first object pose; determining, based on the first object pose, a predicted object pose of the object at a second time; generating pixel-activation instructions based on a buffer region around a projection of a 3D model of the object having the predicted object pose onto a virtual image plane associated with a predicted camera pose, where the size of the buffer region may be dependent on predicted dynamics for the object; instructing, at the second time, the camera to use a subset of the plurality of pixel sensors to capture a second image of the environment according to the pixel-activation instructions, and; determining, based on the second image, a second object pose of the object.

Abstract: Among other things, this document describes systems, devices, and methods for improving the delivery and performance of web pages authored to produce virtual reality (VR) or augmented reality (AR) experiences. In some embodiments, such web pages are analyzed. This analysis may be initiated at the request of a content server that receives a client request for the HTML. The analysis may involve, asynchronous to the client request, loading the page into a non-user-facing browser environment and allowing the VR or AR scene to execute, even including executing animation routines for a predetermined period of time. Certain characteristics of the scene and of objects are thereby captured. Based on this information, an object list ordered by loading priority is prepared. Consulting this information in response to subsequent requests for the page, a content server can implement server push, early hints and/or other delivery enhancements.

Abstract: A display of an augmented reality-enabled (AR) device, such as a mobile phone, can be used to transfer a graphical object between a secondary display, such as a computer monitor, that is captured by a camera of the AR device, and AR space, where the object is visible only through the AR interface of the AR device. A graphical object can be selected through the AR interface and, for example, moved around on a canvas of the secondary display by the user of the AR device. When the AR interface is used to move an enabled object near an edge of the canvas or physical boundary of the secondary display, the object as shown on the secondary display can be made to disappear from the secondary display to be replaced by a virtual object shown only on the AR interface in a similar location.

Abstract: A computer-implemented method includes capturing visual data of an environment using an image sensor of an electronic device and non-visual data of the environment using one or more non-image sensors of the electronic device. Feature descriptors of one or more objects in the environment are generated using the visual data of the environment and the non-visual data of the environment. A map of the environment is generated using the feature descriptors of the one or more objects. One or more virtual objects are anchored to at least one of the objects using the map. The visual data, the non-visual data, and the map are combined in a digital multimedia container file. The digital multimedia container file is stored on the electronic device or on another electronic device connected to the electronic device.

Abstract: A computer generated (CG) hair groom for a virtual character can include strand-based (also referred to as instanced) hair in which many thousands of digital strands represent real human hair strands. Embodiments of systems and methods for transferring CG hair groom data from a first (or source) virtual character to a second (or target) virtual character are provided. Some embodiments can factor in a difference between a hairline of the first virtual character and a hairline of the second virtual character to improve the overall appearance or fit of the hair groom on the second virtual character.

Abstract: An environment association system (“EAS”) comprising: a processor and a memory; an object recognition process configured to identify objects within images, the objects including one or more of a vehicle, a vehicle lift, a vehicle repair tool, and an alignment fixture; and an EAS interface configured to communicate with a user device, the user device comprising a camera and a display; wherein the processor is configured to: determine, for at least one object in the set of objects, create a virtual overlay for the image based on the position of the at least one object within the image and a virtual marking associated with the at least one object; and provide the virtual overlay to the user device, wherein the virtual overlay is configured to cause the user device to simultaneously display the image and the virtual overlay via the display. The system provides information about the alignment of lifting points of the object with lifting members.

Abstract: Systems and methods for displaying a virtual character in a mixed reality environment are disclosed. In some embodiments, a view of the virtual character is based on an animation rig comprising primary joints and helper joints. The animation rig may be in a pose defined by spatial relationships between the primary joints and helper joints. The virtual character may be moving in the mixed reality environment. In some instances, the virtual character may be moving based on a comparison of interestingness values associated with elements in the mixed reality environment. The spatial relationship transformation associated with the movement may be indicated by movement information. In some embodiments, the movement information is received from a neural network.

Abstract: Implementations of the subject technology provide systems and methods for recording an extended reality experience in a way that allows the experience to be played back at a later time from a different viewpoint or perspective. This allows computer-generated content that was rendered for display to a user during the recording, to be re-rendered during playback at the correct time and location in the recording, but from a different perspective. In order to facilitate this type of viewer-centric playback, the recording includes a computer-generated content track that references resources for re-rendering the computer-generated content at each point in time in the recording.

Abstract: Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.

Abstract: Systems, methods, and non-transitory computer readable media configured for managing content placement in extended reality environments are provided. In one implementation, at least one processor associated with the non-transitory computer readable medium may receive a request from an entity to place virtual content at a specific geographic location in at least one shared extended reality environment that includes a plurality of virtual objects, wherein the virtual objects are viewable by a plurality of users. Different content placement rules may define where content may be placed. Based on the obtained information, the processor may determine that the request meets or does not meet the specific content placement rule. The at least one processor may implement the specific content placement rule to prevent content from being displayed when the specific content placement rule is not met and may enable content to be displayed when the specific content placement rule is met.

Abstract: A method of evaluating a joint includes obtaining test data indicative of movement of the joint during a test of the joint, generating visualization data for a three-dimensional representation of the joint to be rendered via a display, generating plane data for a representation of a plane to be rendered via the display with the three-dimensional representation of the joint, the plane having a position and an orientation fixed relative to a bone of the joint, adjusting the visualization data to animate the three-dimensional representation to depict, via the display, the movement of the joint during the test, and adjusting the plane data to update the position and the orientation of the plane in accordance with the movement of the joint.

Abstract: Empowered by augmented reality (AR) technologies, the present disclosure allows a user to display virtual content in a physical reality and turn an AR-ready handheld mobile device into a dimension measuring tool. The present disclosure allows the user to first display a virtual container asset, with its actual size in physical reality, in any given configuration, and then create a virtual dimensional equivalent of an item-to-be-fit based on dimensional data captured by a 6-degree-of-freedom (6DoF) device or the like. Finally, the user can place the virtual item into the virtual container to evaluate the capacity and fit in the given configuration.

Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.