Abstract: An augmented reality (AR) platform supports concurrent operation of multiple AR applications developed by third-party software developers. The AR platform may include an application programming interface (API) that third-party software developers can use to integrate features of the AR platform into the overall user experience of their AR applications. The AR platform includes a feature set having a variety of AR-specific features that interact with and are accessible to the AR applications or AR layers that define a collection of AR content.

Abstract: Embodiments are provided for digital dental modeling. One method embodiment includes receiving a three-dimensional data set including a first jaw and a second jaw of a three-dimensional digital dental model and receiving a two-dimensional data set corresponding to at least a portion of the first jaw and the second jaw. The method includes mapping two-dimensional data of the two-dimensional data set to the three-dimensional digital dental model by transforming a coordinate system of the two-dimensional data to a coordinate system of the three-dimensional data set. The method includes positioning the first jaw with respect to the second jaw based on the two-dimensional data mapped to the three-dimensional data set. The method includes using at least a portion of the two-dimensional data mapped to the three-dimensional data set as a target of movement of the first jaw with respect to the second jaw in the three-dimensional digital dental model.

Abstract: A system, method and computer program product are provided for generating line-of-sight information using imagery. In some aspects, the method includes receiving a raster image depicting at least one object in a region of interest, and measuring a shadow of the at least one object in the raster image. The method also includes determining an angle of the sun from the shadow of the at least one object, and creating a plurality of virtual shadows for the at least one object using the angle of the sun. The method further includes generating line-of-sight information for the at least one object based on an intersection of the plurality of virtual shadows with objects in the region of interest.

Abstract: Systems and methods for segmenting scan data are disclosed. The methods include receiving scan data representing a plurality of points in an environment associated with a ground surface and one or more objects, and creating a graph from the scan data. The graph includes a plurality of vertices corresponding to the plurality of points. The method further includes assigning a unary potential to each of the plurality of vertices that is a cost of assigning that vertex to a ground label or a non-ground label, and assigning a pairwise potential to each pair of neighboring vertices in the graph that is the cost of assigning different labels to neighboring vertices. The methods include using the unary potentials and the pairwise potentials to identify labels for each of the plurality of points, and segmenting the scan data to identify points associated with the ground based on the identified labels.

Abstract: A visualization combination engine may be used to combine a first data visualization based on a first data set with a second data visualization based on a second data set. The combination process may be initiated by, for example, clicking and dragging the first data visualization onto the second data visualization. The visualization combination engine may create the combined data visualization without requiring the user to manually combine the first and second data sets. The combination may be carried out by identifying a key that is common between the two data sets and combining the first and second data sets into a combined data set based on the key, and then creating the combined data visualization based on the combined data set. One or more cues may be used during the process to provide helpful information and/or allow user selection of the properties of the combined data visualization.

Abstract: A method, a system, a device, and a computer readable storage medium for video reconstruction are disclosed. The method includes: obtaining an image combination of multi-angle free-perspective video frames, parameter data corresponding to the image combinations of the video frames, and position information of a virtual viewpoint based on a user interaction; selecting texture images and depth maps of corresponding groups in the image combinations of the video frames at a time moment of the user interaction according to a preset rule and based on the position information of the virtual viewpoint and the parameter data corresponding to the image combinations of the video frames; and combining and rendering the texture images and the depth maps of the corresponding groups based on the position information of the virtual viewpoint and parameter data corresponding to the depth maps and the texture images of the corresponding groups to obtain a reconstructed image.

Abstract: A method of simulating avatar attention in a virtual environment includes, for a given avatar within the environment; periodically calculating the respective interest value of a plurality of elements in the virtual environment in dependence upon one or more factors, where at least one of said factors is evaluated responsive to a relationship between the respective element and that given avatar, selecting the element with the highest calculated interest value, and causing a representation of that given avatar's eyes to point at the selected element within the virtual environment.

Abstract: A method for managing, by an electronic device, content in an augmented reality (AR) system is provided. The method includes identifying a digital artefact that is used by a first application of an electronic device, executing and displaying an image capturing application to capture images, displaying the digital artefact on a captured image which includes an object of a real world where the digital artefact is displayed on or around the object, and, while the digital artefact is displayed, receiving an user input on at least one of the digital artefact or the object for performing an action associated with the digital artefact.

Abstract: A device can receive an identification of an environmental model associated with a user navigating a website and receive an identification of an item model associated with an item requested by the user to be shown in connection with the environmental model on a client device. The environmental model could be a body model of the user or of another force like wind. The item model models how the item would move in connection with the environmental model. The device identifies movement associated with the environmental model and generates, based on the environmental model and the item model, frames each having respective data of the item as it would move on the environmental model according to the movement to yield movement key attributes. The device transmits the movement key attributes to the client device for rendering using a client device rendering engine.

Abstract: The technique of this disclosure suppresses a reduction in visibility of a predetermined object in virtual viewpoint image data. An image processing apparatus includes: an image capturing information acquisition unit configured to acquire image capturing information indicating a position and orientation of each of a plurality of image capturing apparatuses; an object information acquisition unit configured to acquire object information indicating a position and orientation of an object to be captured by the image capturing apparatuses, the object having a specific viewing angle; and a determination unit configured to determine, based on the acquired image capturing information and the position and orientation of the object indicated by the acquired object information, an image to be used for generating a virtual viewpoint image according to a position and orientation of a virtual viewpoint among a plurality of images based on capturing by the image capturing apparatuses.

Abstract: Method for texturing a 3D model of at least one scene (5), comprising: a) the meshing with surface elements (50; 55) of a point cloud (45) representing the scene, so as to generate the 3D model, each surface element representing an area of the scene, b) the unfolding of the 3D model for obtaining a 2D model formed of a plane mesh (60a; 60b) formed of polygons (65), each surface element corresponding to a single polygon, and vice versa, and c) for at least one, preferably all the surface elements, iv) the identification, from an image bank (40a; 40b), of the images representing the area of the scene and which have been acquired by a camera the image plane (72a-b) of which has a normal direction, in the corresponding acquisition position, forming an angle (?a-b) less than 10°, preferably less than 5°, better less than 3° with a direction normal (70) to the face of the surface element, v) the selection of an image (40a-b) from the identified images, and, vi) the association of a texture property with a corresp

Abstract: Disclosed herein is a simulated reality (SR) display system with an adjustable perspective. A simulated reality display system with an adaptable user space can receive a real world layout corresponding to a physical space in which the SR environment will be displayed to the user. Using the real world layout, a default user space can be adapted to conform to one or more aspects of the physical space forming an adjusted user space. Assets of an SR layer can be repositioned relative to the adjusted user space, with the SR layer defining a layout of a plurality of assets in the SR environment. The SR environment can be displayed on the display device, in accordance with the SR layer, allowing the user to safely move around the user space to explore the SR environment without undesirable interactions with the one or more aspects of the physical space.

Abstract: In one aspect, a headset may include at least one processor, at least one transparent display accessible to the at least one processor, and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to detect an indication accompanying audio video (AV) content, with the indication associated with augmented reality (AR) content. The AR content may be different from the AV content but associated with the AV content. The instructions may also be executable to transmit a request for the AR content, receive the AR content, and present the AR content on the at least one transparent display.

Abstract: Mating virtual objects in virtual reality environment, involves generating a bounding box having a plurality of faces corresponding to a plurality of exterior surfaces of a subject virtual object. A spatial mesh corresponding to surfaces of the real world environment is generated. A magnetic mate is generated to initially align a bounding box first face to a first spatial mesh surface. A shadow mate is provided between a bounding box second face and a second spatial mesh surface, by projecting a virtual ray from the subject virtual object bounding box second face toward the second spatial mesh surface, determining a mate point corresponding to an intersection of the virtual ray and the second spatial mesh surface, and displaying a mating button in the virtual reality environment at the mate point.

Abstract: A method for providing a virtual exhibition space by using a 2.5-dimensionalization is provided.

Abstract: A method for adjusting image includes determining, from a background image, a background sub-image corresponding to a foreground sub-image. The foreground sub-image is within a first range of a foreground image, the background image is an image of an external environment, and the foreground image is an image produced by a display device. The method also includes determining a first image attribute of the background sub-image; and adjusting the foreground sub-image based on at least the first image attribute.

Abstract: A density gradient analysis tool can be employed in conjunction with heat mapping systems. A data distribution of data points can be generated. The data distribution can include bins that represent an interval of time and density corresponding to a number of data points in each bin. Further, the data distribution can aggregate data points in each bin. A heat map can be generated based on the data distribution that includes regions corresponding to bins and coloration associated with aggregate values. Further, the heat maps can be interactive including an ability to transition between time periods, expand an interval of time, and select a subset of data for further inspection.

Abstract: An avatar personalization engine can generate personalized avatars for a user by creating a 3D user model based on one or more images of the user. The avatar personalization engine can compute a delta between the 3D user model and an average person model, which is a model created based on the average measurements from multiple people. The avatar personalization engine can then apply the delta to a generic avatar model by changing measurements of particular features of the generic avatar model by amounts specified for corresponding features identified in the delta. This personalizes the generic avatar model to resemble the user. Additional features matching characteristics of the user can be added to further personalize the avatar model, such as a hairstyle, eyebrow geometry, facial hair, glasses, etc.

Abstract: Methods and apparatus for visualizing a surface covering on at least a portion of a surface in an image of a scene. The method comprises identifying, using at least one computer processor, a surface plane from the image of the scene, determining, for each pixel of a plurality of pixels corresponding to the surface plane, whether the pixel corresponds to at least a portion of the surface in the scene, and generating an updated image of the scene by overlaying on the surface plane, a visualization of a plurality of surface covering tiles on pixels along the surface plane determined to correspond to at least a portion of the surface in the scene.

Abstract: Aspects of the embodiments are directed to systems, methods, and computer program products for displaying floorplans and electromagnetic (EM) emissions to facilitate EM emission design within the floorplan. The display of the floorplan and EM emissions can be performed on a wearable device, such as a augmented reality implement or virtual reality implement. The implement can also facilitate a configuration, manipulation, and revision of floorplan and EM emitter positioning, to allow an operator to more precisely configure EM emitter placement and selection.