Abstract: A method of creating a 3D model, which is a visual representation of at least one physiological parameter, the method comprises deploying an AI model to execute on a computing device communicably connected to a medical imaging device, said medical imaging device acquiring medical imaging data, wherein the AI model is trained so that when it is deployed, the computing device identifies at least one physiological parameter from medical imaging data; acquiring, at the computing device, new medical imaging data; processing, using the AI model, the new medical imaging data to identify at least one physiological parameter (the “at least one identified physiological parameter”); employing the at least one identified physiological parameter to select a corresponding 3D model; and modifying the corresponding 3D model to alter one or more model parameters therein, to match the at least one identified physiological parameter, thereby customizing the visual appearance of the corresponding 3D model.

Abstract: The systems described in this disclosure can be used in construction settings to facilitate the tasks being performed. The location of projectors and augmented reality headsets can be calculated and used to determine what images to display to a worker, based on a map of work to be performed, such as a construction plan. Workers can use spatially-aware tools to make different locations be plumb, level, or equidistant with other locations. Power to tools can be disabled if they are near protected objects.

Abstract: Various implementations disclosed herein include devices, systems, and methods that uses object relationships represented in the scene graph to adjust the position of objects. For example, an example process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on sensor data obtained during a scanning process, detecting positions of a set of objects in the physical environment based on the 3D representation, generating a scene graph for the 3D representation of the physical environment based on the detected positions of the set of objects, wherein the scene graph represents the set of objects and relationships between the objects, and determining a refined 3D representation of the physical environment by refining the position of at least one object in the set of objects based on the scene graph and an alignment rule associated with a relationship in the scene graph.

Abstract: Various implementations of the present application set forth a method comprising generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing a physical space that includes a real-world asset, generating, based on second sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space, combining, based on a correlation the three-dimensional data and the two-dimensional data, the two-dimensional data and the three-dimensional data into an extended reality (XR) stream, where the XR stream includes a digital representation of the real-world asset, and transmitting, to a remote device, the XR stream for rendering at least a portion of the digital representation of the real-world asset in a remote XR environment.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for animating a pull-to-refresh gesture. The program and method provide for receiving a pull gesture in a messaging application; selecting, in response to receiving the pull gesture, a set of users corresponding to contacts in the messaging application; and displaying a set of images for each user in the set of users, in association with refreshing screen content.

Abstract: Methods and apparatus for visualizing a surface covering on at least a portion of a surface in an image of a scene. The method comprises identifying, using at least one computer processor, a surface plane from the image of the scene, determining, for each pixel of a plurality of pixels corresponding to the surface plane, whether the pixel corresponds to at least a portion of the surface in the scene, and generating an updated image of the scene by overlaying on the surface plane, a visualization of a plurality of surface covering tiles on pixels along the surface plane determined to correspond to at least a portion of the surface in the scene.

Abstract: Embodiments disclosed herein mitigate technological and social barriers in navigating virtual reality experiences, and with practical applications for the real estate industry. According to one embodiment, a computer-implemented method for navigating a virtual reality simulation is provided. The method includes generating a virtual reality simulation comprising a plurality of virtual spaces. The method includes rendering, in a display of a user device, a first virtual space in the virtual reality simulation, the first virtual space comprising a digital model comprising a plurality of selectable regions, wherein each selectable region is associated with a physical location within a three-dimensional structure. The method includes obtaining an input from a user, the input indicating a selection of a first region of the plurality of selectable regions of the digital model.

Abstract: Embodiments are provided for digital dental modeling. One method embodiment includes receiving a three-dimensional data set including a first jaw and a second jaw of a three-dimensional digital dental model and receiving a two-dimensional data set corresponding to at least a portion of the first jaw and the second jaw. The method includes mapping two-dimensional data of the two-dimensional data set to the three-dimensional digital dental model by transforming a coordinate system of the two-dimensional data to a coordinate system of the three-dimensional data set. The method includes positioning the first jaw with respect to the second jaw based on the two-dimensional data mapped to the three-dimensional data set. The method includes using at least a portion of the two-dimensional data mapped to the three-dimensional data set as a target of movement of the first jaw with respect to the second jaw in the three-dimensional digital dental model.

Abstract: In various embodiments, a method comprises generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing a physical space that includes a real-world asset, generating, based on second sensor data captured by an image sensor, two-dimensional data representing the physical space, generating an adaptable 3D representation of the physical space based on the three-dimensional and two-dimensional data, the adaptable representation including coordinates representing different positions in a 3D-coordinate space corresponding to the physical space and the coordinates encapsulate a digital representation of the asset, transforming the adaptable representation into geometry data comprising a set of vertices and a set of faces comprising edges between vertices, applying, based on a first input, a first color along a specified path that appears on a face to generate a first paint path, and transmitting, to a remote device, data corresponding to the first input.

Abstract: Various implementations of the present application set forth a method comprising receiving, by a remote device from a host device, geometry data representing a physical space that is remote to a location of the remote device, where the geometry data comprises a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, receiving, by the remote device, an input representing an interaction with at least one portion of the adaptable 3D representation, and transmitting, to the host device, data corresponding to the interaction.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a floorplan user interface. One of the methods includes receiving, from a user device, a request for presentation of image content that depicts a floorplan; determining whether one or more criteria for providing image tiles instead of a vector image that depicts the floorplan are satisfied, each of the image tiles having the same tile size, having a file size that is smaller than a vector image file size for the vector image, and depicting a portion of the floorplan; and in response to determining that the one or more criteria for providing image tiles instead of a vector image that depicts the floorplan are satisfied, providing, to the user device, one or more image tiles from the image tiles to cause the user device to present the one or more image tiles on a display.

Abstract: A map database creation method is provided. The method includes: obtaining a factor set including factors; dividing a map database into levels based on the factors, and taking each interval of the last level as one sub-database; creating an initial map based on a factor value of each factor corresponding to each sub-database, and creating the sub-database as an initial map database by storing the corresponding initial map in the sub-database; finding the initial map matching a current lighting condition from the initial map database based on the current lighting condition, and taking the found initial map as a positioning map; and performing a visual positioning based on the positioning map, creating an expanded map corresponding to the current lighting condition based on the visual positioning, and creating the sub-database corresponding to the current lighting condition as an expanded map database by storing the corresponding expanded map in the sub-database.

Abstract: The present invention is a method for accessing a model of a building; selecting a set of floor joists, wherein the floor joists are identified by a set of members, the type of members, and the member properties; isolating a plurality of the floor joists, wherein the floor joists interface with another floor joists in a horizontal type interface; selecting members of the floor joists involved in the interface, wherein the interface is identified as a connection between the floor joists; detecting the member type and the interface type; calculating a set of actual values associated with the interface type; comparing the set of actual values with a set of required values and determining the delta of the actual values and the required values; and identifying each interface where the delta is outside a predetermined range.

Abstract: Techniques for preparing a model (e.g., a digital model) of a person's teeth are described. The techniques include receiving a model of a maxillary arch and a mandibular arch of a person's teeth, operating an automated mesh cleaning operation to modify the model, segmenting the model to identify individual teeth and gum tissue in the model, identifying and marking features of each tooth of the model, and adjusting the individual teeth of the model into a recommended orientation relative to each other, and applying a treatment method. The treatment method may include a selection of a bracket type and an aligner type. The techniques may determine a proposed location of brackets or aligners on the individual teeth based on the applied treatment method and export a digital model of a bracket tray for formation of a bracket tray that can be used to secure the brackets to a person's teeth.

Abstract: An imaging system for correcting visual artifacts during production of extended-reality images for display apparatus. The imaging system includes at least first camera and second camera for capturing first image and second image of real-world environment, respectively; and processor(s) configured to: analyse first and second images to identify visual artifact(s) and determine image segment of one of first image and second image that corresponds to visual artifact(s); generate image data for image segment, based on at least one of: information pertaining to virtual object, other image segment(s) neighbouring image segment, corresponding image segment in other of first image and second image, previous extended-reality image(s), photogrammetric model of real-world environment; and process one of first image and second image, based on image data, to produce extended-reality image for display apparatus.

Abstract: Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

Abstract: Various implementations of the present application set forth a method comprising receiving, by a remote device from a host device, geometry data representing a physical space that is remote to a location of the remote device, where the geometry data comprises a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, receiving, by the remote device, an input representing an interaction with at least one portion of the adaptable 3D representation, and transmitting, to the host device, data corresponding to the interaction.

Abstract: Provided are methods and systems for automatic creation of a customized avatar animation of a user. An example method commences with receiving production parameters and creating, based on the production parameters, a multidimensional array of a plurality of blank avatar animations. Each blank avatar animation has a predetermined number of frames and a plurality of features associated with each frame. The method further includes receiving user parameters including body dimensions, hair, and images of a face of a user. The method continues with selecting, from the plurality of blank avatar animations, two blank avatar animations closest to the user based on the body dimensions. The method further includes interpolating corresponding frames of the two blank avatar animations to produce an interpolated avatar animation. The method continues with compositing the face and the hair with the interpolated avatar animation using a machine learning technique to render the customized avatar animation.

Abstract: A LiDAR point cloud that includes two candidate clusters for merging is received. At a first phase, a distance between the two clusters is determined. If the distance is greater than a threshold, the candidate clusters are not merged. Otherwise, an additional point cloud is received for each cluster at different times. A motion characteristic is determined for each cluster. If the motion characteristic for each cluster is close (indicating that the objects are moving at the same speed), then the clusters are merged. Otherwise the clusters are not merged. The motion characteristic for a cluster can be determined by performing an alignment operation using the point cloud received for the cluster, and using the error associated with the alignment operation as the motion characteristic for the cluster. The decision to merge clusters is based on raw point cloud data, which can take place early in the tracking cycle.

Abstract: A method for presenting a mapping pseudo-hologram using individual video signal output of a real-time engine according to an embodiment of the present disclosure includes: (a) creating a partial viewpoint video including a character of a virtual reality content corresponding to a first user through a camera positioned at any one point in the virtual reality content; (b) creating a hologram video including at least one of objects around the character in the partial viewpoint video; and (c) projecting the hologram video onto a hologram screen placed between the first user and a second user different from the first user, and in the process (c), the hologram video is projected to be overlaid on the first user when the second user sees the first user.