Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for casting from a virtual environment to a video communications platform. The system may provide a video conference session in a video conference application. A connection may be established between the video conference application and a VR or AR device. The video conference application may receive 2D video content from the VR or AR device. The 2D video content may comprise a view of a virtual environment. The video conference application may stream the 2D video content in the video conference session.

Abstract: A method of performing anisotropic texture filtering includes generating one or more parameters describing an elliptical footprint in texture space; performing isotropic filtering at each of a plurality of sampling points along a major axis of the elliptical footprint, wherein a spacing between adjacent sampling points of the plurality of sampling points is proportional to ?{square root over (1???2)} units, wherein ? is a ratio of a major radius of an ellipse to be sampled and a minor radius of the ellipse to be sampled, wherein the ellipse to be sampled is based on the elliptical footprint; and combining results of the isotropic filtering at the plurality of sampling points with a Gaussian filter to generate at least a portion of a filter result.

Abstract: An information processing apparatus generates a map element that is based on a position and orientation of an image capturing apparatus and three-dimensional position information about a feature point included in an image, generates three-dimensional map information based on a plurality of map elements at a plurality of different positions and orientations, corrects, in such a way as to make smaller a reprojection error of a common feature point in a first map element group, at least one of a position and orientation of the image capturing apparatus and the three-dimensional position included in the first map element group, and corrects, in such a way as to make smaller a reprojection error of the common feature point with use of a second map element group, at least one of a position and orientation of the image capturing apparatus and the three-dimensional position information included in the second map element group.

Abstract: The information processing system obtains a plurality of images based on image capturing by a plurality of imaging devices; obtains viewpoint information for specifying a position of a virtual viewpoint and a view direction from the virtual viewpoint; and generates a plurality of virtual viewpoint contents each of which corresponds to one of a plurality of image formats based on the common plurality of obtained images and the obtained viewpoint information, and the plurality of image formats is image formats whose numbers of virtual viewpoints specified by the viewpoint information used for generation of the virtual viewpoint contents are different from one another.

Abstract: An augmented reality (AR) platform supports concurrent operation of multiple AR applications developed by third-party software developers. The AR platform may include an application programming interface (API) that third-party software developers can use to integrate features of the AR platform into the overall user experience of their AR applications. The AR platform includes a feature set having a variety of AR-specific features that interact with and are accessible to the AR applications or AR layers that define a collection of AR content.

Abstract: Various implementations disclosed herein include devices, systems, and methods for generating variations of an object. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes obtaining a request to populate an environment with variations of an object characterized by at least one visual property. In some implementations, the method includes generating the variations of the object by assigning corresponding values for the at least one visual property based on one or more distribution criterion. In some implementations, the method includes displaying the variations of the object in the setting in order to satisfy a presentation criterion.

Abstract: Graphics processing systems may render multiple views of a scene (e.g. a sequence of frames) in a tile-based manner. Groups of views may be rendered together such that tiles from a group of views are rendered in an interspersed order such that at least one tile from each of the views in the group is rendered before any of the views of the scene in the group are fully rendered. In this way similar tiles from different views within a group may be rendered sequentially. If a particular rendered tile is similar to the next tile to be rendered then data stored in a cache for rendering the particular tile is likely to be useful for rendering the next tile. Therefore, when rendering the next tile less data needs to be fetched from the system memory which can significantly improve the efficiency of the graphics processing system.

Abstract: A controller outputs an image of the virtual space in correspondence with a posture of a first user wearing the mounted display, outputs an image of the virtual space to a touch panel display used by a second user, performs a first action in the virtual space in correspondence with a touch operation performed by the second user on the touch panel display, outputs an image of the virtual space reflecting the first action to the mounted display, and performs a second action in the virtual space reflecting the first action in correspondence with an operation performed by the first user on an operation unit.

Abstract: A face image processing method and apparatus, a readable medium, and an electronic device, relates to the field of image processing technologies. The method includes: obtaining (101) sight line information in a face image to be processed in accordance with a preset recognition algorithm, where the sight line information includes: a first coordinate and an edge coordinate for an eye, and the edge coordinate is used to indicate an intersection of a sight line of an eye and an edge of the face image; determining (102) a target area in the face image according to the sight line information, where the target area includes a sight line segment with the first coordinate and the edge coordinate as endpoints; and rendering (103) a preset effect material to target area to obtain a target image.

Abstract: A user may select one or more potential common ancestors with a DNA match to view the target individual's relationship with them. The process may include identifying, from a first genealogical profile of the target individual. A first individual has a first linkage that connects the target individual towards the selected potential common ancestor. The process may also include identifying, from a second genealogical profile of the DNA match, a second individual who has a second linkage that connects the DNA match towards the selected potential common ancestor. The process may further include connecting the first linkage and the second linkage with the selected potential common ancestor by adding one or more individuals whose profiles are retrieved from other searchable genealogical profiles stored in the online system. With the nodes and connections available, the process may generate a map of visual connections between the target individual and the DNA match.

Abstract: Systems and methods described herein relate to reconstructing a scene in three dimensions from a two-dimensional image. One embodiment processes an image using a detection transformer to detect an object in the scene and to generate a NOCS map of the object and a background depth map; uses MLPs to relate the object to a differentiable database of object priors (PriorDB); recovers, from the NOCS map, a partial 3D object shape; estimates an initial object pose; fits a PriorDB object prior to align in geometry and appearance with the partial 3D shape to produce a complete shape and refines the initial pose estimate; generates an editable and re-renderable 3D scene reconstruction based, at least in part, on the complete shape, the refined pose estimate, and the depth map; and controls the operation of a robot based, at least in part, on the editable and re-renderable 3D scene reconstruction.

Abstract: Systems and methods for rapidly and reliably determining an arch with of a patient's dental arch. A first portion of a 3D model of a patient's dentition is identified that corresponds to a first target tooth, the first portion of the 3D model is associated with one or more attributes of the first target tooth. A second portion of the 3D model is identified that corresponds to a second target tooth opposing the first target tooth. The second portion is associated with one or more attributes of the second target tooth. The arch width is automatically measured based on the attributes of the first and second target teeth. A graphic representing the arch width is overlayed on the patient's dentition.

Abstract: Wearable head-mounted displays, such as virtual reality systems, present immersive experiences and environments to a wearer. However, the head-mounted displays, as well as the immersive environments that they produce, limit the wearer's ability to interact with outside observers. For example, a wearer may not be able to see outside observers, and outside observers may not have any insight to what the wearer is experiencing or where the wearer's attention is directed. Accordingly, a wearable electronic device may include an outward-facing display configured to display information to outside observers, such as images of the wearer's face or images that represent or indicate the state of the wearer and/or the head mounted display.

Abstract: An image registration apparatus including at least one processor and configured to project, to a first model, a first image generated based on an image obtained from a first camera to generate a first intermediate image, to map the first intermediate image to a first output model to generate a first output image, to project, to a second model, a second image generated based on an image obtained from a second camera to generate a second intermediate image, to map the second intermediate image to a second output model to generate a second output image, and to determine a match rate between the first output image and the second output image and transform at least one of the first model and the second model based on a determined match rate and a preset reference match rate.

Abstract: Systems and methods for segmenting scan data are disclosed. The methods include creating a graph from scan data representing a plurality of points in an environment associated with a ground and one or more objects, where the graph includes a plurality of vertices corresponding to the plurality of points in the environment, a first terminal vertex associated with the ground label, and a second terminal vertex associated with the non-ground label. A unary potential being the cost of assigning a vertex to a ground label or a non-ground label is assigned to each vertex, and a pairwise potential is assigned to each pair of neighboring vertices in the graph as a measure of a cost of assigning different labels. The methods include using the unary the pairwise potentials to identify labels for each point and segmenting the scan data to identify points associated with the ground.

Abstract: An image processing method includes the steps of: extracting a first two-dimensional feature point from a two-dimensional face image; on the basis of a geometric model of a standard face, deriving a three-dimensional feature point set including a first three-dimensional feature point corresponding to the first two-dimensional feature point; generating a three-dimensional face model including the three-dimensional feature point set; estimating an input pose of the two-dimensional face image to determine whether to update the three-dimensional feature point set; updating the three-dimensional feature point set by relocating the first three-dimensional feature point according to the first two-dimensional feature point, on the basis of the determination on whether to update the three-dimensional feature point set; and projecting the three-dimensional face model onto the two-dimensional face image.

Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.

Abstract: A method of creating a 3D model, which is a visual representation of at least one physiological parameter, the method comprises deploying an AI model to execute on a computing device communicably connected to a medical imaging device, said medical imaging device acquiring medical imaging data, wherein the AI model is trained so that when it is deployed, the computing device identifies at least one physiological parameter from medical imaging data; acquiring, at the computing device, new medical imaging data; processing, using the AI model, the new medical imaging data to identify at least one physiological parameter (the “at least one identified physiological parameter”); employing the at least one identified physiological parameter to select a corresponding 3D model; and modifying the corresponding 3D model to alter one or more model parameters therein, to match the at least one identified physiological parameter, thereby customizing the visual appearance of the corresponding 3D model.

Abstract: The systems described in this disclosure can be used in construction settings to facilitate the tasks being performed. The location of projectors and augmented reality headsets can be calculated and used to determine what images to display to a worker, based on a map of work to be performed, such as a construction plan. Workers can use spatially-aware tools to make different locations be plumb, level, or equidistant with other locations. Power to tools can be disabled if they are near protected objects.

Abstract: Various implementations disclosed herein include devices, systems, and methods that uses object relationships represented in the scene graph to adjust the position of objects. For example, an example process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on sensor data obtained during a scanning process, detecting positions of a set of objects in the physical environment based on the 3D representation, generating a scene graph for the 3D representation of the physical environment based on the detected positions of the set of objects, wherein the scene graph represents the set of objects and relationships between the objects, and determining a refined 3D representation of the physical environment by refining the position of at least one object in the set of objects based on the scene graph and an alignment rule associated with a relationship in the scene graph.