Abstract: A system configured to assist a user in scanning a physical environment in order to generate a three-dimensional scan or model. In some cases, the system may include an interface to assist the user in capturing data usable to determine a scale or depth of the physical environment and to perform a scan in a manner that minimizes gaps.

Abstract: In one implementation, a method of generating an object model is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a point cloud including a plurality of points, wherein each of the plurality of points is associated with a plurality of sets of coordinates in a three-dimensional space at a respective plurality of time periods. The method includes generating an object model including a plurality of vertices corresponding to the plurality of points and a plurality of edges between respective pairs of the plurality of vertices. The method includes generating, based on the sets of coordinates of a particular point, a characterization vector of a particular vertex corresponding to the particular point, wherein the characterization vector includes a joint label and joint data with respect to one or more of the plurality of edges of the particular vertex.

Abstract: A method for using a trained generative adversarial network to improve vehicle orientation and navigation includes loading a semantically-segmented 3D point cloud into a virtual reality simulation environment; processing the 3D point cloud; and displaying an output including at least one attribute. A computing system for using a trained generative adversarial network to improve vehicle orientation and navigation includes one or more processors, and one or more memories having stored thereon computer-executable instructions that, when executed, cause the computing system to: load a semantically-segmented 3D point cloud into a virtual reality simulation environment; process the 3D point cloud; and display an output including at least one attribute.

Abstract: A display device can include a display panel to display an input image across a first subpixel region and a second subpixel region; a display panel driver to supply pixel data of the input image to subpixels of the display panel; a light source disposed under the display panel in an area overlapped by the second subpixel region; and a controller to drive the light source in an emission permitting section set within a non-driving period of a group of subpixels among the subpixels that are disposed in at least a portion of the second subpixel region.

Abstract: In one embodiment, a method includes generating a front panel of a garment based on one or more images including the garment, generating a back panel of the garment, aligning the front panel and the back panel in a three-dimensional space so that the front panel is in front of a three-dimensional body and the back panel is behind the three-dimensional body, identifying one or more pairs of boundary segments of the front panel and the back panel, wherein each pair of boundary segments of the front panel and the back panel are to be attached together, and generating a digital garment by attaching each of the identified one or more pairs of boundary segments of the front panel and the back panel through a plurality of iterative simulations using a physics simulation model.

Abstract: Methods and systems for populating overlays within a virtual environment. An example method includes obtaining a virtual reality model of an overall region; accessing a plurality of records associated with respective ones of a plurality of properties modeled in the virtual reality model, wherein each of the plurality of records represents a respective status of a respective insurance claim for the respective property, and wherein all of the insurance claims are related to a same damage-causing event for the overall region; generating a plurality of overlays for respective ones of the plurality of records, wherein each of the plurality of overlays depicts the status of the claim for the respective property; and causing the pluralities of overlays to be rendered in a virtual environment for the virtual reality model at substantially the same time.

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.

Abstract: A collaborative session (e.g., a virtual time capsule) in which access to a collaborative object and added virtual content is selectively provided to participants/users. In one example of the collaborative session, a participant (the host) creates a new session and invites participants to join. The session creator (i.e., the host) and other approved participants can access the contents of a session (e.g., which may be recorded using an application such as lens cloud feature; available from Snap Inc. of Santa Monica, California). A timestamp is associated with each received virtual content, and the users are provided with a timelapse of the collaborative object as a function of the timestamps.

Abstract: One method embodiment comprises storing data on a storage system that is representative of a point cloud comprising a very large number of associated points; organizing the data into an octree hierarchy of data sectors, each of which is representative of one or more of the points at a given octree mesh resolution; receiving a command from a user of a user interface to present an image based at least in part upon a selected viewing perspective origin and vector; and assembling the image based at least in part upon the selected origin and vector, the image comprising a plurality of data sectors pulled from the octree hierarchy, the plurality of data sectors being assembled such that sectors representative of points closer to the selected viewing origin have a higher octree mesh resolution than that of sectors representative of points farther away from the selected viewing origin.

Abstract: One embodiment is directed to a system for presenting views of a very large point data set, comprising: a storage system comprising data representing a point cloud comprising a very large number of associated points; a controller operatively coupled to the storage cluster and configured to automatically and deterministically organize the point data into an octree hierarchy of data sectors, each of which is representative of one or more of the points at a given octree mesh resolution; and a user interface through which a user may select a viewing perspective origin and vector, which may be utilized to command the controller to assemble an image based at least in part upon the selected origin and vector, the image comprising a plurality of data sectors pulled from the octree hierarchy.

Abstract: A non-transitory computer readable storage medium includes instructions that, when executed by one or more processors, cause a computer to: generate a loss value; update one or more weights of a generative adversarial network; and store the updated weights on a non-transitory computer readable storage medium. A computer-implemented method includes generating a loss value; updating one or more weights of a generative adversarial network; and storing the updated weights on a non-transitory computer readable storage medium. A computing system for training a generative adversarial network includes generating a loss value; updating one or more weights of a generative adversarial network; and storing the updated weights on a non-transitory computer readable storage medium.

Abstract: A first video generator generates first information for displaying, as a first video, a character object of a first user and a first object. A second video generator displays the first object and a third object different from the second object. An association portion associates the character object of the first user with a fourth object associated with the third object when the character object of the first user and the third object have a predetermined relationship. The second video generator displays the fourth object in association with the character object of the first user when the fourth object is associated with the character object of the first user by the association portion.

Abstract: A method for using a trained generative adversarial network to improve underwriting, claim handling and retail operations includes receiving a 3D point cloud; and generating a gap-filled semantically-segmented 3D point cloud using a trained generative adversarial network. A computing system for using a trained generative adversarial network to improve vehicle orientation and navigation includes one or more processors, and one or more memories having stored thereon computer-executable instructions that, when executed, cause the computing system to: receive a 3D point cloud; and generate a gap-filled semantically-segmented 3D point cloud using the trained generative adversarial network. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed, cause a computer to: receive a 3D point cloud; and generate a gap-filled semantically-segmented 3D point cloud using a trained generative adversarial network.

Abstract: A method, device, and apparatus for synthesizing a motion sequence of a virtual object and a non-transitory computer-readable storage medium are disclosed. The method can include obtaining description information of a motion sequence of a virtual object, and determining a continuous motion clip set similar to at least some motions in the motion sequence based on the description information and a continuous motion clip library constructed with video materials. The method can further include synthesizing the motion sequence of the virtual object based on the continuous motion clip set, where each continuous motion clip in the continuous motion clip library includes a unique identifier of the continuous motion clip, motion information of the continuous motion clip, and a representation vector corresponding to the each continuous motion clip.

Abstract: A projection apparatus according to the present invention, includes: a projection optical system configured to project an input image onto a projection plane, and at least one memory and at least one processor which function as: a position-detecting unit configured to detect a position pointed to by a pointer on the projection plane; and a control unit configured to perform control so that the projection optical system projects the input image and projects a graphic at the position detected by the position-detecting unit, wherein in a case where an image is scrolled in a specific range of the input image, the control unit performs control so that the graphic corresponding to the specific range moves in a direction in accordance with the scrolling.

Abstract: A computer-implemented method for using a trained generative adversarial network to improve construction and urban planning includes receiving a semantically-segmented point cloud corresponding to a construction site; determining a volumetric soil measurement; and generating a cost estimate. A computing system for using a trained generative adversarial network to improve vehicle orientation and navigation includes one or more processors, and one or more memories having stored thereon computer-executable instructions that, when executed, cause the computing system to: receive a semantically-segmented point cloud corresponding to a construction site; determine a volumetric soil measurement; and generate a cost estimate. A non-transitory computer-readable medium includes computer-executable instructions that, when executed, cause a computer to: receive a semantically-segmented point cloud corresponding to a construction site; determine a volumetric soil measurement; and generate a cost estimate.

Abstract: Technology described herein can be embodied in a method of providing visual feedback during surgery. The method includes obtaining a set of vectors representing a model of an anatomical organ, the set produced from a representation of the organ as imaged under one or more imaging modalities. The method includes obtaining a set of pixel positions of a display device, wherein the pixel positions correspond to a view of the organ. The method further includes generating, using at least a portion of the set of vectors, multiple fragment-vectors for each pixel position in the set of pixel positions, the multiple fragment-vectors each representing a corresponding portion of the organ along a line-of-sight through the organ, and generating a pixel value for each pixel position in the set of pixel positions, and presenting, on the display device, an augmented image of the view of the organ using the generated pixel values.

Abstract: Examples of the disclosure describe systems and methods for recording augmented reality and mixed reality experiences. In an example method, an image of a real environment is received via a camera of a wearable head device. A pose of the wearable head device is estimated, and a first image of a virtual environment is generated based on the pose. A second image of the virtual environment is generated based on the pose, wherein the second image of the virtual environment comprises a larger field of view than a field of view of the first image of the virtual environment. A combined image is generated based on the second image of the virtual environment and the image of the real environment.

Abstract: The method performed at an electronic device including one or more processors, a non-transitory memory, and a depth sensor includes: obtaining a task associated with a physical object within a physical environment; obtaining a task associated with a physical object within a physical environment; obtaining depth information, via the depth sensor, associated with the physical environment; determining one or more measurements for the physical object based at least in part on the depth information; generating a graphical overlay for the task based at least in part on the task associated with the physical object and the one or more measurements for the physical object; and causing presentation of the graphical overlay relative to a representation of the physical object, wherein the representation is obtained using sensor readings of the physical object.

Abstract: A first video generator generates first information for displaying, as a first video, a character object of a first user and a first object. A second video generator displays the first object and a third object different from the second object. An association portion associates the character object of the first user with a fourth object associated with the third object when the character object of the first user and the third object have a predetermined relationship. The second video generator displays the fourth object in association with the character object of the first user when the fourth object is associated with the character object of the first user by the association portion.