Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.

Abstract: Provided is a virtual costume fitting system including: a data input unit that receives a three-dimensional (3D) body model and a costume model; a corresponding point matching unit that matches corresponding points between the body model and the costume model; a costume deformation unit that moves a vertex of the costume model; a pose estimation unit that estimates a pose of the body model; a texture mapping unit that maps a texture of the costume model; a crease surface generation unit that generates a crease of a costume; a texture upgrading unit that updates a texture of the crease; a costume model renewal unit that corrects the texture; a mesh separation unit that separates a 3D mesh; and a mesh integrating unit that integrates the body model with the deformed costume model to generate a body model fitted with the costume.

Abstract: The present disclosure provides methods, apparatuses, and computer-readable mediums for representing shapes with probabilistic directed distance fields. In some embodiments, a method includes obtaining a camera representation and a latent shape vector representation of a scene. The camera representation indicates position information and direction information of a view of the scene. The method further includes calculating, based on the latent shape vector representation of the scene, a visibility score and a depth for each ray of a plurality of rays emanating from a corresponding plurality of positions and directions. The plurality of positions and directions are determined from the camera representation of the scene. The method further includes generating renders of geometric information of the scene using the visibility score and the depth of the plurality of rays.

Abstract: The systems described in this disclosure can be used in construction settings to facilitate the tasks being performed. The location of projectors and augmented reality headsets can be calculated and used to determine what images to display to a worker, based on a map of work to be performed, such as a construction plan. Workers can use spatially-aware tools to make different locations be plumb, level, or equidistant with other locations. Power to tools can be disabled if they are near protected objects.

Abstract: A user may select one or more potential common ancestors with a DNA match to view the target individual's relationship with them. The process may include identifying, from a first genealogical profile of the target individual. A first individual has a first linkage that connects the target individual towards the selected potential common ancestor. The process may also include identifying, from a second genealogical profile of the DNA match, a second individual who has a second linkage that connects the DNA match towards the selected potential common ancestor. The process may further include connecting the first linkage and the second linkage with the selected potential common ancestor by adding one or more individuals whose profiles are retrieved from other searchable genealogical profiles stored in the online system. With the nodes and connections available, the process may generate a map of visual connections between the target individual and the DNA match.

Abstract: Wearable head-mounted displays, such as virtual reality systems, present immersive experiences and environments to a wearer. However, the head-mounted displays, as well as the immersive environments that they produce, limit the wearer's ability to interact with outside observers. For example, a wearer may not be able to see outside observers, and outside observers may not have any insight to what the wearer is experiencing or where the wearer's attention is directed. Accordingly, a wearable electronic device may include an outward-facing display configured to display information to outside observers, such as images of the wearer's face or images that represent or indicate the state of the wearer and/or the head mounted display.

Abstract: A virtual garment fitting method uses a database comprising avatar models of bodies of wearers which models are generated from multiple three-dimensional lidar scans and photographs of the wearer. The system graphically renders overlaid clothing overlays onto the avatar models—the clothing overlays are generated based on standardized images and sizing data stored within a database. The creation of the avatar models results in the ability to have the wearer actually experience in their virtual fitting as close as possible to a real scenario of fitting seeing their actual body shape and their face or limbs etc on the model.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a floorplan user interface. One of the methods includes receiving, from a user device, a request for presentation of image content that depicts a floorplan; determining whether one or more criteria for providing image tiles instead of a vector image that depicts the floorplan are satisfied, each of the image tiles having the same tile size, having a file size that is smaller than a vector image file size for the vector image, and depicting a portion of the floorplan; and in response to determining that the one or more criteria for providing image tiles instead of a vector image that depicts the floorplan are satisfied, providing, to the user device, one or more image tiles from the image tiles to cause the user device to present the one or more image tiles on a display.

Abstract: A display device of the present invention includes a display controller executing display control processing of controlling an operation of a predetermined display destination to cause the display destination to display a plurality of N-dimensional graphs. The plurality of N-dimensional graphs include a first graph and a second graph. When a predetermined condition related to acquisition of fixed value change information including auxiliary explanatory variable information designating one or more of auxiliary explanatory variables as objects to be changed in value, and information indicating current variable values is satisfied, the display control processing includes processing of updating the first graph and the second graph to be displayed on the display destination to a changed graph due to changing of values of the auxiliary explanatory variables indicated by the auxiliary explanatory variable information to the current variable values indicated by the fixed value change information.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for ingesting 3D objects from a virtual environment for 2D data representation. The system may provide a video conference session including a first video stream of a video conference participant and a second video stream of a virtual environment. The system may receive a 3D data representation of a 3D object in the virtual environment and generate a 2D data representation of the 3D object based on the 3D data representation. The system may display the 2D data representation in the video conference session.

Abstract: A display control device is a device that controls four display devices provided in an automobile, and includes: four image generating units that generate four on-screen displays; a setting unit that sets a color display mode as a set display mode; and an image processing unit that unifies a color display mode of each of the four on-screen displays generated to the set display mode, and display each of the four on-screen displays that have been unified to the set display mode on a different one of the four display devices.

Abstract: Systems and associated methods are provided for distributed three-dimensional (3D) content generation whereby different 3D assets for a 3D scene are generated by different asset generators at different network tiers according to the latency sensitivity of each 3D asset. The system retrieves a 3D asset for the requested 3D scene, and differentiates a first 3D asset that is latency sensitive from a second 3D asset that is latency tolerant. The system generates the first 3D asset with a first asset generator at a first network tier, and generates the second 3D asset with a second asset generator at a more distant second network tier. The system distributes the generated primitives for the first 3D asset to the user device with a first amount of latency and the generated primitives for the second 3D asset to the user device with a second amount of latency.

Abstract: Disclosed herein are systems and methods that relate to wireless communication mesh network design and operation.

Abstract: The technique of this disclosure suppresses a reduction in visibility of a predetermined object in virtual viewpoint image data. An image processing apparatus includes: an image capturing information acquisition unit configured to acquire image capturing information indicating a position and orientation of each of a plurality of image capturing apparatuses; an object information acquisition unit configured to acquire object information indicating a position and orientation of an object to be captured by the image capturing apparatuses, the object having a specific viewing angle; and a determination unit configured to determine, based on the acquired image capturing information and the position and orientation of the object indicated by the acquired object information, an image to be used for generating a virtual viewpoint image according to a position and orientation of a virtual viewpoint among a plurality of images based on capturing by the image capturing apparatuses.

Abstract: According to various embodiments, an augmented reality device may comprise a display, at least one camera, a communication circuit, and at least one processor operatively connected with the display, the at least one camera, and the communication circuit. The at least one processor may be configured to obtain a first image through the at least one camera, identify that a wireless power receiver and a wirelesspower transmitter configured to transmit wireless power to the wirelesspower receiver are included in the first image, receive information regarding the wireless power from the wirelesspower receiver through the communication circuit, and display, on the display, an augmented reality object indicating an arrangement of at least one of the wirelesspower transmitter or the wirelesspower receiver, based on the information regarding the wireless power.

Abstract: Various implementations disclosed herein include devices, systems, and methods that uses object relationships represented in the scene graph to adjust the position of objects. For example, an example process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on sensor data obtained during a scanning process, detecting positions of a set of objects in the physical environment based on the 3D representation, generating a scene graph for the 3D representation of the physical environment based on the detected positions of the set of objects, wherein the scene graph represents the set of objects and relationships between the objects, and determining a refined 3D representation of the physical environment by refining the position of at least one object in the set of objects based on the scene graph and an alignment rule associated with a relationship in the scene graph.

Abstract: An electronic device includes a camera, a display, and a processor, wherein the processor is configured to acquire an image using the camera, determine a 3D graphic object corresponding to an object included in the acquired image, and apply the determined 3D graphic object to a 3D avatar and display the same.

Abstract: Techniques for responsive video canvas generation are described to impart three-dimensional effects based on scene geometry to two-dimensional digital objects in a two-dimensional design environment. A responsive video canvas, for instance, is generated from input data including a digital video and scene data. The scene data describes a three-dimensional representation of an environment and includes a plurality of planes. A visual transform is generated and associated with each plane to enable digital objects to interact with the underlying scene geometry. In the responsive video canvas, an edit positioning a two-dimensional digital object with respect to a particular plane of the responsive video canvas is received. A visual transform associated with the particular plane is applied to the digital object and is operable to align the digital object to the depth and orientation of the particular plane. Accordingly, the digital object includes visual features based on the three-dimensional representation.

Abstract: A tinting material may be generated and applied to the backdrop of an application presented on a user interface. The user interface is presented on a display and includes a background. The background comprises a first color, which includes a luminosity value, a hue value, and a saturation value. A tint color, having a luminosity value, a hue value, a saturation value, and an opacity value, is received. The luminosity value of the first color is modified to generate a second color, and the hue value and saturation value of the generated second color are modified to generate a third color. A tinting material color is generated that includes the modified luminosity value of the second color, the modified hue value of the third color, and the modified saturation value of the third color, and an application is presented on the user interface that includes the tinting material color.

Abstract: A holographic aberration correction method and apparatus are provided. The holographic aberration correction apparatus includes: generating a plurality of sub-holograms in a hologram, as a matrix; calculating a plurality of eigenmodes and an eigenvalue and a weight corresponding to each of the eigenmodes by performing singular value decomposition on the matrix; selecting a predefined number of eigenmodes in the order of largest eigenvalues; calculating a plurality of first results which are obtained by multiplying a plurality of identical images by respective weights corresponding to the plurality of selected eigenmodes; calculating a plurality of second results by performing convolution of the plurality of first results and the plurality of selected eigenmodes, respectively; and generating an aberration-corrected hologram by adding the plurality of second results.