Abstract: A method for managing a multi-user animation platform is disclosed. A three-dimensional space within a computer memory is modeled. An avatar of a client is located within the three-dimensional space, the avatar being graphically represented by a three-dimensional figure within the three-dimensional space. The avatar is responsive to client input commands, and the three-dimensional figure includes a graphical representation of client activity. The client input commands are monitored to determine client activity. The graphical representation of client activity is then altered according to an inactivity scheme when client input commands are not detected. Following a predetermined period of client inactivity, the inactivity scheme varies non-repetitively with time.

Abstract: In a method modifying a user's virtual environment, a banking module retrieves and analyzes context data associated with the user. The banking module applies user and location parameters to determine whether at least one of an avatar modification and an environment modification is available for rendering. Responsive to determining that the avatar selection is not available for rendering, determining whether the avatar is accessible to the user. Responsive to determining that avatar is not accessible to the user, presenting the avatar selection for redemption.

Abstract: To allow free animation production in virtual space, an animation production method executed by a computer comprising: a step of placing a virtual camera for shooting a character in a virtual space; a step of placing an object to which a size is set in the virtual space; a step of scaling the object according to the size; and a step of generating an image shot by the camera.

Abstract: The present invention provides a system and method of position estimation for remotely operated vehicles, even in noisy environments. In some embodiments, a position estimation engine includes a 2D projection module, a registration module, a position estimation module, and an efficiency module. The improved position estimation starts with a real frame from a video and a virtual image that is the projection of the 3D elements given the ROV's noisy position. The position estimate begins by projecting each of the visible structures individually and then registers them with the real image. Then the 2D transformation resulting from the registration process is used to estimate the 3D ROV's position. Then, the ROV's position estimates are robustly combined. Because this position estimation needs to run in real-time or near real-time, an efficiency module improves the efficiency of the position estimation.

Abstract: A method includes generating, in coordination with an emergent content engine, a first objective for a first objective-effectuator and a second objective for a second objective-effectuator instantiated in a computer-generated reality (CGR) environment. The first and second objectives are associated with a mutual plan. The method includes generating, based on characteristic values associated with the first and second objective-effectuators a first directive for the first objective-effectuator and a second directive for the second objective-effectuator. The first directive limits actions generated by the first objective-effectuator over a first set of time frames associated with the first objective and the second directive limits actions generated by the second objective-effectuator over a second set of time frames associated with the second objective.

Abstract: In an approach to improve virtual reality (VR) by rendering objects in a viewing area within a virtual environment as static embodiments display, by a user interface on a computing device, a plurality of captured frames of a physical surrounding area. Additionally, embodiments determine a primary focus area and a secondary focus area of the displayed plurality of captured frames using object recognition techniques and detect movement of a second object in the secondary focus area. Additionally, responsive to detecting movement of the second object in the secondary focus area, embodiments render the second object as static in the displayed plurality of captured frames.

Abstract: A computer-implemented method implements a resilient interdependent spatial alignment (RISA) process to improve and maintain spatial alignment between two associated coordinate systems by moving a follow coordinate system to align it to a lead coordinate system. In some use cases, the coordinate systems may be a physical space and a corresponding digital model of the space. A user device such as an augmented reality headset or robotic sensors may be moving in the physical space, and alignment to the model is continually maintained, updated and improved responsive to acquired spatial data to enable, for example, holographic display of the model in the headset very closely aligned to the physical space. Multiple volumes can each have corresponding digital “spaces” or RisaSites to manage anchor data with dynamic hand-off among them while accommodating differing scale and density.

Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.

Abstract: The specification describes methods and systems for increasing a dimensional depth of a two-dimensional image of a face to yield a face image that appears three dimensional. The methods and systems identify key points on the 2-D image, obtain a texture map for the 2-D image, determines one or more proportions within the 2-D image, and adjusts the texture map of the 3-D model based on the determined one or more proportions within the 2-D image.

Abstract: The present technology relates to devices and systems for volume visualization and interaction in a virtual reality or augmented reality environment.

Abstract: A cross reality system enables any of multiple devices to efficiently and accurately access previously persisted maps of very large scale environments and render virtual content specified in relation to those maps. The cross reality system may build a persisted map, which may be in canonical form, by merging tracking maps from the multiple devices. A map merge process determines mergibility of a tracking map with a canonical map and merges a tracking map with a canonical map in accordance with mergibility criteria, such as, when a gravity direction of the tracking map aligns with a gravity direction of the canonical map. Refraining from merging maps if the orientation of the tracking map with respect to gravity is not preserved avoids distortions in persisted maps and results in multiple devices, which may use the maps to determine their locations, to present more realistic and immersive experiences for their users.

Abstract: The present technology includes calculating the 3-D RF propagation pattern in a space for at least one Wi-Fi access point and displaying a visualization of the RF propagation pattern in augmented reality (AR). The augmented reality view of the space can be created by capturing at least one image of the space and displaying at least one image of the space on a display with the visualization of the Wi-Fi access point RF propagation pattern on the display overlaid at least one image of the space. The disclosed technology further can calculate the RF propagation properties and render a visualization of the RF propagation patterns in a 3D space by utilizing hardware on a user device. The AR display is useful in visualizing, in-person aspects of a Wi-Fi network and coverage, and can be used in troubleshooting, maintenance, and simulations of equipment variations.

Abstract: Users can view images or renderings of items placed (virtually) within a physical space. For example, a rendering of an item can be placed within a live camera view of the physical space. A snapshot of the physical space can be captured and the snapshot can be customized, shared, etc. The renderings can be represented as two-dimensional images, e.g., virtual stickers or three-dimensional models of the items. Users can have the ability to view different renderings, move those items around, and develop views of the physical space that may be desirable. The renderings can link to products offered through an electronic marketplace and those products can be consumed. Further, collaborative design is enabled through modeling the physical space and enabling users to view and move around the renderings in a virtual view of the physical space.

Abstract: A plurality of methods of registering and matching biological tissue images from a dynamic 3D medical model generated using medical images taken of biological tissues of a particular patient with a live video feed of the biological tissues of the particular patient, and a computer system for implementing such methods.

Abstract: A cross reality system enables any of multiple devices to efficiently render shared location-based content. The cross reality system may include a cloud-based service that responds to requests from devices to localize with respect to a stored map. The service may return to the device information that localizes the device with respect to the stored map. In conjunction with localization information, the service may provide information about locations in the physical world proximate the device for which virtual content has been provided. Based on information received from the service, the device may render, or stop rendering, virtual content to each of multiple users based on the user's location and specified locations for the virtual content.

Abstract: Systems and methods configured to facilitate animation are disclosed. Exemplary implementations may: obtain a first scene definition; receive second entity information; integrate the second entity information into the first scene definition such that a second scene definition is generated; for each of the entities of the entity information, execute a simulation of the virtual reality scene from the second scene definition for at least a portion of the scene duration; for each of the entities of the entity information, analyze the second scene definition for deviancy between the given entity and the second motion capture information; for each of the entities of the entity information, indicate, based on the analysis for deviancy, the given entity as deviant; and for each of the entities of the entity information, re-integrate the given entity into the second scene definition.

Abstract: Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.

Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.

Abstract: Methods, systems, computer-readable media, and apparatuses are presented for generating a photorealistic viewable model using augmented reality (AR). An AR scene is generated by overlaying a virtual object onto a view of a physical environment. When placed into the AR scene, the virtual object can interact with the physical environment by, for example, reflecting or taking on colors, shadows, brightness, and other attributes of the physical environment. To generate the viewable model, the virtual object is manipulated (e.g., moved or rotated) within the AR scene and a plurality of images are generated by capturing the virtual object as the virtual object is being manipulated. The viewable model can be generated based on one or more of the images and can be output in the form of an interactive presentation, for example, a spin image.

Abstract: A system, method, and computer-readable medium for validating the components and configuration of a system, comprising: identifying the system, identifying a set of components installed in the system, associating the system with a set of components installed therein, generating a system model comprised of component models for the set of components in a design configuration, comparing the system model with the system, and displaying the model or an overlay based on the model relative to the system or an image of the system and an indicator that all components are installed properly and the system is in a design configuration or an indicator that a component is installed improperly or the system is not in the design configuration.