Abstract: A method of creating a 3D model, which is a visual representation of at least one physiological parameter, the method comprises deploying an AI model to execute on a computing device communicably connected to a medical imaging device, said medical imaging device acquiring medical imaging data, wherein the AI model is trained so that when it is deployed, the computing device identifies at least one physiological parameter from medical imaging data; acquiring, at the computing device, new medical imaging data; processing, using the AI model, the new medical imaging data to identify at least one physiological parameter (the “at least one identified physiological parameter”); employing the at least one identified physiological parameter to select a corresponding 3D model; and modifying the corresponding 3D model to alter one or more model parameters therein, to match the at least one identified physiological parameter, thereby customizing the visual appearance of the corresponding 3D model.

Abstract: The systems described in this disclosure can be used in construction settings to facilitate the tasks being performed. The location of projectors and augmented reality headsets can be calculated and used to determine what images to display to a worker, based on a map of work to be performed, such as a construction plan. Workers can use spatially-aware tools to make different locations be plumb, level, or equidistant with other locations. Power to tools can be disabled if they are near protected objects.

Abstract: Various implementations disclosed herein include devices, systems, and methods that uses object relationships represented in the scene graph to adjust the position of objects. For example, an example process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on sensor data obtained during a scanning process, detecting positions of a set of objects in the physical environment based on the 3D representation, generating a scene graph for the 3D representation of the physical environment based on the detected positions of the set of objects, wherein the scene graph represents the set of objects and relationships between the objects, and determining a refined 3D representation of the physical environment by refining the position of at least one object in the set of objects based on the scene graph and an alignment rule associated with a relationship in the scene graph.

Abstract: Various implementations of the present application set forth a method comprising generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing a physical space that includes a real-world asset, generating, based on second sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space, combining, based on a correlation the three-dimensional data and the two-dimensional data, the two-dimensional data and the three-dimensional data into an extended reality (XR) stream, where the XR stream includes a digital representation of the real-world asset, and transmitting, to a remote device, the XR stream for rendering at least a portion of the digital representation of the real-world asset in a remote XR environment.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for animating a pull-to-refresh gesture. The program and method provide for receiving a pull gesture in a messaging application; selecting, in response to receiving the pull gesture, a set of users corresponding to contacts in the messaging application; and displaying a set of images for each user in the set of users, in association with refreshing screen content.

Abstract: Embodiments disclosed herein mitigate technological and social barriers in navigating virtual reality experiences, and with practical applications for the real estate industry. According to one embodiment, a computer-implemented method for navigating a virtual reality simulation is provided. The method includes generating a virtual reality simulation comprising a plurality of virtual spaces. The method includes rendering, in a display of a user device, a first virtual space in the virtual reality simulation, the first virtual space comprising a digital model comprising a plurality of selectable regions, wherein each selectable region is associated with a physical location within a three-dimensional structure. The method includes obtaining an input from a user, the input indicating a selection of a first region of the plurality of selectable regions of the digital model.

Abstract: In various embodiments, a method comprises generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing a physical space that includes a real-world asset, generating, based on second sensor data captured by an image sensor, two-dimensional data representing the physical space, generating an adaptable 3D representation of the physical space based on the three-dimensional and two-dimensional data, the adaptable representation including coordinates representing different positions in a 3D-coordinate space corresponding to the physical space and the coordinates encapsulate a digital representation of the asset, transforming the adaptable representation into geometry data comprising a set of vertices and a set of faces comprising edges between vertices, applying, based on a first input, a first color along a specified path that appears on a face to generate a first paint path, and transmitting, to a remote device, data corresponding to the first input.

Abstract: Various implementations of the present application set forth a method comprising receiving, by a remote device from a host device, geometry data representing a physical space that is remote to a location of the remote device, where the geometry data comprises a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, receiving, by the remote device, an input representing an interaction with at least one portion of the adaptable 3D representation, and transmitting, to the host device, data corresponding to the interaction.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a floorplan user interface. One of the methods includes receiving, from a user device, a request for presentation of image content that depicts a floorplan; determining whether one or more criteria for providing image tiles instead of a vector image that depicts the floorplan are satisfied, each of the image tiles having the same tile size, having a file size that is smaller than a vector image file size for the vector image, and depicting a portion of the floorplan; and in response to determining that the one or more criteria for providing image tiles instead of a vector image that depicts the floorplan are satisfied, providing, to the user device, one or more image tiles from the image tiles to cause the user device to present the one or more image tiles on a display.

Abstract: A map database creation method is provided. The method includes: obtaining a factor set including factors; dividing a map database into levels based on the factors, and taking each interval of the last level as one sub-database; creating an initial map based on a factor value of each factor corresponding to each sub-database, and creating the sub-database as an initial map database by storing the corresponding initial map in the sub-database; finding the initial map matching a current lighting condition from the initial map database based on the current lighting condition, and taking the found initial map as a positioning map; and performing a visual positioning based on the positioning map, creating an expanded map corresponding to the current lighting condition based on the visual positioning, and creating the sub-database corresponding to the current lighting condition as an expanded map database by storing the corresponding expanded map in the sub-database.

Abstract: The present invention is a method for accessing a model of a building; selecting a set of floor joists, wherein the floor joists are identified by a set of members, the type of members, and the member properties; isolating a plurality of the floor joists, wherein the floor joists interface with another floor joists in a horizontal type interface; selecting members of the floor joists involved in the interface, wherein the interface is identified as a connection between the floor joists; detecting the member type and the interface type; calculating a set of actual values associated with the interface type; comparing the set of actual values with a set of required values and determining the delta of the actual values and the required values; and identifying each interface where the delta is outside a predetermined range.

Abstract: Techniques for preparing a model (e.g., a digital model) of a person's teeth are described. The techniques include receiving a model of a maxillary arch and a mandibular arch of a person's teeth, operating an automated mesh cleaning operation to modify the model, segmenting the model to identify individual teeth and gum tissue in the model, identifying and marking features of each tooth of the model, and adjusting the individual teeth of the model into a recommended orientation relative to each other, and applying a treatment method. The treatment method may include a selection of a bracket type and an aligner type. The techniques may determine a proposed location of brackets or aligners on the individual teeth based on the applied treatment method and export a digital model of a bracket tray for formation of a bracket tray that can be used to secure the brackets to a person's teeth.

Abstract: Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

Abstract: Various implementations of the present application set forth a method comprising receiving, by a remote device from a host device, geometry data representing a physical space that is remote to a location of the remote device, where the geometry data comprises a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, receiving, by the remote device, an input representing an interaction with at least one portion of the adaptable 3D representation, and transmitting, to the host device, data corresponding to the interaction.

Abstract: Provided are methods and systems for automatic creation of a customized avatar animation of a user. An example method commences with receiving production parameters and creating, based on the production parameters, a multidimensional array of a plurality of blank avatar animations. Each blank avatar animation has a predetermined number of frames and a plurality of features associated with each frame. The method further includes receiving user parameters including body dimensions, hair, and images of a face of a user. The method continues with selecting, from the plurality of blank avatar animations, two blank avatar animations closest to the user based on the body dimensions. The method further includes interpolating corresponding frames of the two blank avatar animations to produce an interpolated avatar animation. The method continues with compositing the face and the hair with the interpolated avatar animation using a machine learning technique to render the customized avatar animation.

Abstract: A method for presenting a mapping pseudo-hologram using individual video signal output of a real-time engine according to an embodiment of the present disclosure includes: (a) creating a partial viewpoint video including a character of a virtual reality content corresponding to a first user through a camera positioned at any one point in the virtual reality content; (b) creating a hologram video including at least one of objects around the character in the partial viewpoint video; and (c) projecting the hologram video onto a hologram screen placed between the first user and a second user different from the first user, and in the process (c), the hologram video is projected to be overlaid on the first user when the second user sees the first user.

Abstract: The disclosure relates to a system for evaluating movement of a body of a user. The system may include a video display, one or more digital cameras, and a processor. The processor may control the one or more cameras to generate images of at least the part of the body over a period of time. The processor may estimate a position of a plurality of joints of the body. The processor may receive a selection of a tracked pose, and determine, from the plurality of joints, a set of joints associated with the tracked pose. The processor may generate at least one joint vector connecting joints in the set of joints, and assign, based on changes in the joint vector over the period of time, a form score to a performance of the tracked pose. The processor may then generate a user interface that depicts the form score.

Abstract: Various implementations disclosed herein include devices, systems, and methods for generating variations of an object. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes obtaining a request to populate an environment with variations of an object characterized by at least one visual property. In some implementations, the method includes generating the variations of the object by assigning corresponding values for the at least one visual property based on one or more distribution criterion. In some implementations, the method includes displaying the variations of the object in the setting in order to satisfy a presentation criterion.

Abstract: In example embodiments, techniques are provided for visualizing a 3D model in an interactive editing workflow. A user modifies one or more elements of a model of the 3D model, by inserting one or more new elements having geometry, changing the geometry of one or more existing elements and/or deleting one or more existing elements having geometry. An updated view of the 3D model is then rendered to reflect the modification to the one or more elements in part by obtaining, for each new element or changed existing element of the model visible in the view, a polygon mesh that represents geometry of the individual element, obtaining a set of tiles that each include a polygon mesh that represent collective geometry of a set of elements intersecting the tile's volume, displaying the polygon mesh for each new element or changed existing element, and displaying the set of tiles while hiding any deleted or changed existing elements therein.

Abstract: Techniques for context-aware identification of anomalies in civil infrastructure. A method includes applying an anomaly identification model to features extracted from visual content showing civil infrastructure in order to determine at least one anomalous portion shown in the visual multimedia content, a type of each anomalous portion, and a quantification of each anomalous portion; wherein the anomaly identification model is selected based on a type of material of the civil infrastructure; and generating a semantically labeled three-dimensional (3D) model based on the at least one anomalous portion and the type of each anomalous portion, wherein the semantically labeled 3D model includes anomalous points; wherein each anomalous point represents one of the at least one anomalous portion; wherein the anomalous points collectively define a pattern of the at least one anomalous portion; wherein each anomalous point is visually distinguished to indicate the quantification of the respective anomalous portion.