Abstract: Mixed reality social interactions are described. Techniques described herein include determining authentication information associated with a mixed reality display device and determining that a content item is visible in a mixed reality environment associated with the mixed reality display device. In an example, a content item may be determined to be visible based at least in part on content data indicating that the content item is owned by the mixed reality display device and/or has been shared with the mixed reality display device. The content data may also indicate an identification of a content item of the plurality of content items, an owner of the content item, and permissions associated with the content item. The techniques further describe causing a graphical representation of the content item to be presented via a display on the mixed reality display device.

Abstract: A computer system is described for automatically generating a 3D model, including hardware and non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause it to obtain wire-frame data of a structure within a geographic area; identify a geographic location of the structure; retrieve multiple geo-referenced oblique images representing the geographic location and containing a real façade texture of the structure; locate a geographical position of a real façade texture of the structure; select one or more base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, and, apply the real façade texture of the one or more base oblique image to the wire-frame data of the structure to create a three dimensional model providing a real-life representation of physical characteristics of the structure.

Abstract: A “Shared Tactile Immersive Virtual Environment Generator” (STIVE Generator) constructs fully immersive shared virtual reality (VR) environments wherein multiple users share tactile interactions via virtual elements that are mapped and rendered to real objects that can be touched and manipulated by multiple users. Generation of real-time environmental models of shared real-world spaces enables mapping of virtual interactive elements to real objects combined with multi-viewpoint presentation of the immersive VR environment to multiple users. Real-time environmental models classify geometry, positions, and motions of real-world surfaces and objects. Further, a unified real-time tracking model comprising position, orientation, skeleton models and hand models is generated for each user. The STIVE Generator then renders frames of the shared immersive virtual reality corresponding to a real-time field of view of each particular user.

Abstract: A computer system is described for automatically generating a 3D model, including hardware and non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause it to obtain wire-frame data of a structure within a geographic area; identify a geographic location of the structure; retrieve multiple geo-referenced oblique images representing the geographic location and containing a real façade texture of the structure; locate a geographical position of a real façade texture of the structure; select one or more base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, and, apply the real façade texture of the one or more base oblique image to the wire-frame data of the structure to create a three dimensional model providing a real-life representation of physical characteristics of the structure.

Abstract: A computer system is described for automatically generating a 3D model, including hardware and non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause it to create wire-frame data of structures within a geographic area; identify a geographic location of a structure of the structures; receive multiple oblique images representing the geographic location and containing a real façade texture of the structure; locate a geographical position of a real façade texture of the structure; select one or more base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, and, relate the real façade texture of the one or more base oblique image to the wire-frame data of the structure to create a three dimensional model providing a real-life representation of physical characteristics of the structure.

Abstract: Surface reconstruction contour completion embodiments are described which provide dense reconstruction of a scene from images captured from one or more viewpoints. Both a room layout and the full extent of partially occluded objects in a room can be inferred using a Contour Completion Random Field model to augment a reconstruction volume. The augmented reconstruction volume can then be used by any surface reconstruction pipeline to show previously occluded objects and surfaces.

Abstract: A “Layout Optimizer” provides various real-time iterative constraint-satisfaction methodologies that use constraint-based frameworks to generate optimized layouts that map or embed virtual objects into environments. The term environment refers to combinations of environmental characteristics, including, but not limited to, 2D or 3D scene geometry or layout, scene colors, patterns, and/or textures, scene illumination, scene heat sources, fixed or moving people, objects or fluids, etc., any of which may evolve or change over time. A set of parameters are specified or selected for each object. Further, the environmental characteristics are determined automatically or specified by users. Relationships between objects and/or the environment derived from constraints associated with objects and the environment are then used to iteratively determine optimized self-consistent and scene-consistent object layouts.

Abstract: Surface reconstruction contour completion embodiments are described which provide dense reconstruction of a scene from images captured from one or more viewpoints. Both a room layout and the full extent of partially occluded objects in a room can be inferred using a Contour Completion Random Field model to augment a reconstruction volume. The augmented reconstruction volume can then be used by any surface reconstruction pipeline to show previously occluded objects and surfaces.

Abstract: Surface reconstruction contour completion embodiments are described which provide dense reconstruction of a scene from images captured from one or more viewpoints. Both a room layout and the full extent of partially occluded objects in a room can be inferred using a Contour Completion Random Field model to augment a reconstruction volume. The augmented reconstruction volume can then be used by any surface reconstruction pipeline to show previously occluded objects and surfaces.

Abstract: A computer system is described for automatically generating a 3D model, including hardware and non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause it to create wire-frame data of structures within a geographic area; identify a geographic location of a structure of the structures; receive multiple oblique images representing the geographic location and containing a real façade texture of the structure; locate a geographical position of a real façade texture of the structure; select one or more base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, and, relate the real façade texture of the one or more base oblique image to the wire-frame data of the structure to create a three dimensional model providing a real-life representation of physical characteristics of the structure.

Abstract: An “AR Privacy API” provides an API that allows applications and web browsers to use various content rendering abstractions to protect user privacy in a wide range of web-based immersive augmented reality (AR) scenarios. The AR Privacy API extends the traditional concept of “web pages” to immersive “web rooms” wherein any desired combination of existing or new 2D and 3D content is rendered within a user's room or other space. Advantageously, the AR Privacy API and associated rendering abstractions are useable by a wide variety of applications and web content for enhancing the user's room or other space with web-based immersive AR content. Further, the AR Privacy API is implemented using any existing or new web page coding platform, including, but not limited to HTML, XML, CSS, JavaScript, etc., thereby enabling existing web content and coding techniques to be smoothly integrated into a wide range of web room AR scenarios.

Abstract: A computer system is described for automatically generating a three-dimensional model of a structure, including hardware and one or more non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause it to locate multiple oblique images containing a real façade texture of a structure having a geographical position from one or more database of oblique images; select a base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, the selection logic using a factorial analysis of the image raster content, wherein the factorial analysis is a weighted determination based on at least two factors; and, relate the real façade texture of the base oblique image to the three dimensional model to provide a real-life representation of physical characteristics of the structure within the three-dimensional model.

Abstract: Amalgamated maps, comprising interior maps overlaid on venues indicated in general maps can be automatically generated. Initially, interior maps can be obtained through targeted network searches, whose search results can be filtered to retain those that are most likely useable interior maps. A bounding polygon is generated for both interior map and venue exterior from general map. Subsequently, directional histograms representing orientations of lines in bounding polygons are generated and compared to automatically identify a rotation to align the interior map with the venue exterior from the general map. Anchor points are identified to locally deform the interior map, preserving internal structures, to better align with the venue exterior. Once aligned, the interior map can be combined with the general map, forming an amalgamated map. Updated geocoding can be performed based on locations of establishments in the venue as indicated by the interior map.

Abstract: An augmented reality (AR) experience is mapped to various environments. A three-dimensional data model that describes a scene of an environment, and a description of the AR experience, are input. The AR experience description includes a set of digital content that is to be mapped into the scene, and a set of constraints that defines attributes of the digital content when it is mapped into the scene. The 3D data model is analyzed to detect affordances in the scene, where this analysis generates a list of detected affordances. The list of detected affordances and the set of constraints are used to solve for a mapping of the set of digital content into the scene that substantially satisfies the set of constraints. The AR experience is also mapped to changing environments.

Abstract: Amalgamated maps, comprising interior maps overlaid on venues indicated in general maps can be automatically generated. Initially, interior maps can be obtained through targeted network searches, whose search results can be filtered to retain those that are most likely useable interior maps. A bounding polygon is generated for both interior map and venue exterior from general map. Subsequently, directional histograms representing orientations of lines in bounding polygons are generated and compared to automatically identify a rotation to align the interior map with the venue exterior from the general map. Anchor points are identified to locally deform the interior map, preserving internal structures, to better align with the venue exterior. Once aligned, the interior map can be combined with the general map, forming an amalgamated map. Updated geocoding can be performed based on locations of establishments in the venue as indicated by the interior map.

Abstract: A computer system is described for automatically generating a three-dimensional model of a structure, including hardware and one or more non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause it to locate multiple oblique images containing a real façade texture of a structure having a geographical position from one or more database of oblique images; select a base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, the selection logic using a factorial analysis of the image raster content, wherein the factorial analysis is a weighted determination based on at least two factors; and, relate the real façade texture of the base oblique image to the three dimensional model to provide a real-life representation of physical characteristics of the structure within the three-dimensional model.

Abstract: A computer system is described for automatically generating a three-dimensional model of a structure. The computer system includes hardware and one or more non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause the hardware to: locate multiple oblique images containing a real façade texture of a structure having a geographical position from one or more database of oblique images; select a base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, the selection logic using a factorial analysis of the image raster content; and, relate the real façade texture of the base oblique image to the three dimensional model to provide a real-life representation of physical characteristics of the structure within the three-dimensional model.

Abstract: A computer system is described for automatically generating a three-dimensional model of a structure. The computer system includes hardware and one or more non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause the hardware to: locate multiple oblique images containing a real façade texture of a structure having a geographical position from one or more database of oblique images; select a base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, the selection logic using a factorial analysis of the image raster content; and, relate the real façade texture of the base oblique image to the three dimensional model to provide a real-life representation of physical characteristics of the structure within the three-dimensional model.

Abstract: Methods are described for automatically generating a three-dimensional model of a structure including real façade textures obtained from geo-referenced oblique images. The geographical position of at least one real façade texture is located. Geo-referenced images containing the real façade texture are located. A base image having the real façade texture is selected from the geo-referenced images by analyzing image raster content. The real façade texture of the base image is applied to the three-dimensional model. Systems for generating the three-dimensional model are also described herein.

Abstract: Amalgamated maps, comprising interior maps overlaid on venues indicated in general maps can be automatically generated. Initially, interior maps can be obtained through targeted network searches, whose search results can be filtered to retain those that are most likely useable interior maps. A bounding polygon is generated for both interior map and venue exterior from general map. Subsequently, directional histograms representing orientations of lines in bounding polygons are generated and compared to automatically identify a rotation to align the interior map with the venue exterior from the general map. Anchor points are identified to locally deform the interior map, preserving internal structures, to better align with the venue exterior. Once aligned, the interior map can be combined with the general map, forming an amalgamated map. Updated geocoding can be performed based on locations of establishments in the venue as indicated by the interior map.