Abstract: A computer-implemented method for lighting subjects for artificial reality scenes may include (i) identifying (a) a physical camera configured to capture a physical subject for insertion into an artificial reality scene, (b) a physical light source that is positioned such that the physical light source lights the physical subject recorded by the physical camera, and (c) lighting conditions in the artificial reality scene, (ii) determining at least one lighting parameter to light the physical subject such that lighting conditions of the physical subject blend visually with the lighting conditions in the artificial reality scene, and (iii) configuring the physical light source to light the physical subject according to the at least one lighting parameter. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Disclosed is a three-dimensional (“3D”) scanning system that synchronizes the scanning of a scene with the viewing of the scan results relative to a live view of the scene. The system includes a first device that scans a first set of surfaces that are exposed to the first device from a first position. The system further includes a second device that receives the scan data as it is generated for each scanned surface of the first set of surfaces. The second device augments a visualization of a second set of surfaces, within a field-of-view of the second device from a second position, with the scan data that is generated for a subset of scanned surfaces from the first position corresponding to one or more surfaces of the second set of surfaces visualized from the second position.

Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.

Abstract: The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.

Abstract: Disclosed is a location tracking system and associated methods for precisely locating a target device with a recipient device via different forms of location tracking and augmented reality. The recipient device receives a first position of the target device over a data network. The recipient device is moved according to the first position until the target device is in Ultra-WideBand (“UWB”) signaling range of the recipient device. The recipient device then measures a distance and direction of the target device relative to the recipient device based on Time-of-Flight (“ToF”) measurements generated from the UWB signaling. The recipient device determines a second position of the target device based on the distance and direction of the target device, and generates an augmented reality view with a visual reference at a particular position in images of a captured scene that corresponds to the second position of the target device.

Abstract: A system and method of adjusting a refresh rate to match a given remote desktop stream frame rate is described. The system may include a processing device to transmit, as a media stream, a portion of a remote desktop image with a frame rate that matches a refresh rate to a remote desktop client.

Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.

Abstract: The disclosed systems, components, methods, and processing steps are directed to determining user-item fit characteristics of an item for a user body part by accessing a three-dimensional (3D) reconstructed model of the user body part, accessing information about one or more 3D reference models of the item, the information for each 3D reference model including respective dimensional measurement, spatial, and geometrical attributes, performing a 3D matching process based on the 3D reconstructed model and the accessed information of the one or more 3D reference models to determine a best-fitting 3D reference model from the one or more 3D reference models, integrating the best-fitting 3D reference model with the 3D reconstructed model to provide a 3D best fit representation and displaying the 3D best fit representation along with visual indications of user-item fit characteristics.

Abstract: A method for managing a multi-user animation platform is disclosed. A three-dimensional space within a computer memory is modeled. An avatar of a client is located within the three-dimensional space, the avatar being graphically represented by a three-dimensional figure within the three-dimensional space. The avatar is responsive to client input commands, and the three-dimensional figure includes a graphical representation of client activity. The client input commands are monitored to determine client activity. The graphical representation of client activity is then altered according to an inactivity scheme when client input commands are not detected. Following a predetermined period of client inactivity, the inactivity scheme varies non-repetitively with time.

Abstract: An electronic device includes a communication device, a camera device, a display device, a processor, and a memory connected to the processor. The memory stores instructions that, when executed, cause the processor to identify, when information on a shared object based on augmented reality is received from an external electronic device through the communication device, a first location of the shared object included in the information, identify whether the first location is included within a camera view distance and a camera direction of the camera device, generate reception information of the shared object in a specified type for each condition in which the first location is included in a range of at least one of the camera view distance or the camera direction using a second location of the electronic device as a reference point, and output an augmented reality image obtained by merging the generated reception information with a real image obtained from the camera device to the display device.

Abstract: The present disclosure relates to systems that capture a combination of image data and environmental data of the environment. The system uses the environmental data to create a detailed virtual scan of the environment. Computer generated models and images (“assets”) are inserted into the detailed virtual environment from the scan. These assets are scaled and placed within the virtual environment at specific locations and having a specific orientation. The scaled and positioned asset is then composited with the real-time video signal allowing a user to view the asset in real-time on a display.

Abstract: There is provided systems and methods for generating 3D structure estimation of at least one target from a set of 2D Cryo-electron microscope particle images. The method includes: receiving the set of 2D particle images of the target from a Cryo-electron microscope; splitting the set of particle images into at least a first half-set and a second half-set; iteratively performing: determining local resolution estimation and local filtering on at least a first half-map associated with the first half-set and a second half-map associated with the second half-set; aligning 2D particles from each of the half-sets using at least one region of the associated half-map; for each of the half-maps, generating an updated half-map using the aligned 2D particles from the associated half-set; and generating a resultant 3D map using all the half-maps.

Abstract: An automated teller machine (ATM) diagnostic and repair system includes an image capture device, a display, a processor, and a memory. The image capture device is configured to capture at least one of images or videos. The memory includes instructions stored thereon that, when executed by the processor, cause the processor to receive diagnostic data from an ATM. The instructions, when executed by the processor, further cause the processor to capture at least one of an image or a video of the ATM using the image capture device. The instructions, when executed by the processor, further cause the processor to receive a selection of a particular component of the ATM from a user and to provide at least one of an augmented image or an augmented video of the ATM including a modified view of the particular component.

Abstract: Systems and methods configured to facilitate animation are disclosed. Exemplary implementations may: obtain a first scene definition; receive second entity information; integrate the second entity information into the first scene definition such that a second scene definition is generated; for each of the entities of the entity information, execute a simulation of the virtual reality scene from the second scene definition for at least a portion of the scene duration; for each of the entities of the entity information, analyze the second scene definition for deviancy between the given entity and the second motion capture information; for each of the entities of the entity information, indicate, based on the analysis for deviancy, the given entity as deviant; and for each of the entities of the entity information, re-integrate the given entity into the second scene definition.

Abstract: A method of merging distant virtual spaces is disclosed. Data describing an environment surrounding a MR merging device is received. A first slice plane is generated, positioned, and displayed within the environment. A second MR merging device is connective with in a second environment. Data describing inbound content from the second MR merging device is received. Content data is sent from the MR merging device to the second MR merging device. The inbound content data is processed and displayed on the first slice plane.

Abstract: Present disclosure discloses an image processing system and method for manipulating two-dimensional (2D) images of three-dimensional (3D) objects of a predetermined class (e.g., human faces). A 2D input image of a 3D object of the predetermined class is manipulated by manipulating physical properties of the 3D object, such as a 3D shape of the 3D input object, an albedo of the 3D input object, a pose of the 3D input object, and lighting illuminating the 3D input object. The physical properties are extracted from the 2D input image using a neural network that is trained to reconstruct the 2D input image. The 2D input image is reconstructed by disentangling the physical properties from pixels of the 2D input image using multiple subnetworks. The disentangled physical properties produced by the multiple subnetworks are combined into a 2D output image using a differentiable renderer.

Abstract: An example method includes identifying a need and an emotional state of a user who is participating in an interaction with a support application, retrieving a set of preferences for the user, selecting a set of features for an avatar to be presented to the user, wherein the set of features is selected based at least on the emotional state of the user and the set of preferences, selecting a stored workflow based on the need of the user, and rendering the avatar to exhibit the set of features and to present the stored workflow as part of the interaction.

Abstract: This disclosure presents a method and computer program product to denoise a ray traced scene. An apparatus for processing a ray traced scene is also disclosed. In one example, the method includes: (1) generating filtered scene data by filtering modified scene data from original scene data utilizing a spatial filter, and (2) providing a denoised ray traced scene by adjusting the filtered scene data utilizing a temporal filter. The modified and adjusted scene data can be sent to a rendering processor or system to complete rendering to generate a final scene.

Abstract: The present technology includes calculating the 3-D RF propagation pattern in a space for at least one Wi-Fi access point and displaying a visualization of the RF propagation pattern in augmented reality (AR). The augmented reality view of the space can be created by capturing at least one image of the space and displaying at least one image of the space on a display with the visualization of the Wi-Fi access point RF propagation pattern on the display overlaid at least one image of the space. The disclosed technology further can calculate the RF propagation properties and render a visualization of the RF propagation patterns in a 3D space by utilizing hardware on a user device. The AR display is useful in visualizing, in-person aspects of a Wi-Fi network and coverage, and can be used in troubleshooting, maintenance, and simulations of equipment variations.

Abstract: Methods, systems and apparatuses may provide for technology that determines the size of a graphics primitive, renders pixels associated with the graphics primitive on a per tile basis if the size exceeds a threshold, and renders the pixels associated with the graphics primitive in a mesh order if the size does not exceed the threshold. In one example, the technology discards state data associated with the graphics primitive in response to a completion of rendering the pixels associated with the graphics primitive in the mesh order.