Abstract: A method renders photorealistic images in a web browser. The method is performed at a computing device having a general purpose processor and a graphics processing unit (GPU). The method includes obtaining an environment map and images of an input scene. The method also includes computing textures for the input scene including by encoding an acceleration structure of the input scene. The method further includes transmitting the textures to shaders executing on a GPU. The method includes generating samples of the input scene, by performing at least one path tracing algorithm on the GPU, according to the textures. The method also includes lighting or illuminating a sample of the input scene using the environment map, to obtain a lighted scene, and tone mapping the lighted scene. The method includes drawing output on a canvas, in the web browser, based on the tone-mapped scene to render the input scene.

Abstract: System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining images of the building structure, including non-camera anchors. The method also includes identifying reference poses for images based on the non-camera anchors. The method also includes obtaining world map data including real-world poses for the images. The method also includes selecting candidate poses from the real-world poses based on corresponding reference poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on correlating the reference poses with the selected candidate poses. Some implementations use structure from motion techniques or LiDAR, in addition to augmented reality frameworks, for scaling the 3-D representations of the building structure. In some implementations, the world map data includes environmental data, such as illumination data, and the method includes generating or displaying the 3-D representation.

Abstract: Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving planes associated with an architectural element based on detecting edge position(s) for an architectural element relative to a given plane and reconstructing the model based on the adjusted position(s).

Abstract: Systems and methods are disclosed for directed image capture of a subject of interest, such as a home. Directed image capture can produce higher quality images such as more centrally located within a display and/or viewfinder of an image capture device, higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) facilitate content placement for certain positions and quality assessments for the content of interest can be calculated such as for pixel distance of the content of interest to a centroid of the display or viewfinder, or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.

Abstract: Visualizing three dimensional content is complicated by display platforms capable of more degrees of freedom to display the content than interface tools have to navigate that content. Disclosed are methods and systems for displaying select portions of the content and generating virtual camera positions with associated look angles for the select portions, such as planar geometries of a three dimensional building, thereby constraining the degrees of freedom for improved navigation through views of the content. Look angles can be associated with axes of the content and fields of view.

Abstract: A process for receiving, from a computing device, a series of captured building images by overlaying, on a capture device display, a selected graphical guide from a set of sequentially related graphical guides. The process continues by capturing, by a capture device, a building image, wherein the capturing is performed during substantial alignment of an image of a selected building object with a corresponding orientation of the selected graphical guide. The process continues by receiving acknowledgement of the building image being captured for the selected graphical guide and the selected building object. The process is repeated for a plurality of building images.

Abstract: A process is provided for graphically guiding a user of a capture device (e.g., smartphone) to more accurately capture a series of images of a building. Images are captured as the picture taker moves around the building—taking a plurality (e.g., 4-16) of images from multiple angles and distances. Before capturing an image, a quality of the image may be determined to prevent low quality images from being captured or to provide instructions on how to improve the quality of the image capture. The series of captured images are uploaded to an image processing system to generate a 3D building model that is returned to the user. The returned 3D building model may incorporate scaled measurements of building architectural elements and may include a dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows, doors or roofing.

Abstract: A method and system is provided for automatic generation and navigation of optimal views of facades of multi-dimensional building models based on where and how the original images were captured. The system and method allows for navigation and visualization of facades of individual or multiple building models in a multi-dimensional building model visualization system.

Abstract: A system and method is provided for generating textured building models from wirelessly captured ground-level imagery. Ground-level images of facades of building objects are collected for identification of geometry planes and generation of building façade geometry. The 3D building model is properly geo-positioned, scaled and textured.

Abstract: Improper positioning of architectural features is corrected during construction or reconstruction of a multi-dimensional (e.g., 3D) building model using known architectural dimensions and known relationships to planes (facades). The system identifies architectural elements that have known architectural standard positions relative to planes within the multi-dimensional model. Dimensional measurements of architectural elements in the multi-dimensional model are used to properly position one or more architectural elements relative to associated planes within the multi-dimensional building model. For example, a window position on a 3D building model first façade is moved inward (offset) according to the known relationship of a window (architectural element) being inset relative to a façade (e.g., exterior wall). In addition, a window frame could be repositioned outwardly relative to the same façade plane based on a known relationship of a frame being located on an external surface of the façade (e.g.

Abstract: A system and method are provided for identifying scale, scale error, or improper positioning during construction or reconstruction of a multi-dimensional (e.g., 3D) building model using known architectural dimensions. The system identifies architectural elements that have known architectural standard positions relative to planes within the multi-dimensional model. Dimensional measurements of architectural elements in the multi-dimensional model (poorly scaled) are compared with known architectural standard dimensions, with or without scale error, to properly scale, rescale or position one or more planes within the multi-dimensional building model.

Abstract: A system and method is provided for generating textured 3D building models from ground-level and orthogonal imagery. Ground-level images for the sides of building objects are collected to form a 3D dense point cloud for identification of key architectural features, corresponding key façade geometry planes, and generation of a 3D building façade geometry. Orthogonal images are correlated to the 3D building model providing a properly geo-positioned, scaled and textured 3D building model.

Abstract: A geospatially accurate 3D model of a building or collection of buildings is used to communicate any type of geo-specific information by way of uniquely recognizable visual or non-visual highlighting such as color or texture coded building visualizations on rooftops or other objects within the 3D model.

Abstract: A system is provided including a database that ingests data from disparate image sources, with a variety of image metadata types and qualities, and manages images geospatially through the creation and continued refinement of camera solutions for each data object included. These camera solutions are calculated and refined by the database as additional data enters the system that could affect the solutions, through a combination of the application of image metadata towards image processing methods and the use of optical-only computer vision techniques. The database continually generates data quality metrics and relevant imagery and geometry analytics, which drive future collection tasking, system analytics, and human quality control requirements.

Abstract: A method of operating a three-dimensional (3D) map system including: receiving an image and a geo-location tag of the image; determining a building model for a physical building corresponding to an object captured in the image based on the geo-location tag; mapping, on a region-by-region basis, the image to a stored facade of the building model; and mapping, on a pixel-by-pixel basis, the image to the stored facade of the building model for displaying the image as a new facade of the building.

Abstract: A method for correcting 3D building objects is provided. Construction tools available within the visualization tool provide edge squaring and edge snapping of the 3D building objects, correcting incoherent angles and planes resulting from errors formed during the construction of the building model. Specified angular thresholds for perpendicular axis and parallel planes are provided in the construction tools to identify inaccuracies within selected buildings and new buildings are redrawn.

Abstract: Embodiments of the invention relate to the visualization of geographical information and the combination of image information to generate geographical information. Specifically, embodiments of the invention relate to a process and system for correlating oblique images data and terrain data without extrinsic information about the oblique imagery. Embodiments include a visualization tool to allow simultaneous and coordinated viewing of the correlated imagery. The visualization tool may also provide distance and measuring, three-dimensional lens, structure identification, path finding, visibility and similar tools to allow a user to determine distance between imaged objects.

Abstract: Embodiments of the invention relate to the visualization of geographical information and the combination of image information to generate geographical information. Specifically, embodiments of the invention relate to a process and system for correlating oblique images data and terrain data without extrinsic information about the oblique imagery. Embodiments include a visualization tool to allow simultaneous and coordinated viewing of the correlated imagery. The visualization tool may also provide distance and measuring, three-dimensional lens, structure identification, path finding, visibility and similar tools to allow a user to determine distance between imaged objects.

Abstract: Embodiments of the invention relate to the visualization of geographical information and the combination of image information to generate geographical information. Specifically, embodiments of the invention relate to a process and system for correlating oblique images data and terrain data without extrinsic information about the oblique imagery. Embodiments include a visualization tool to allow simultaneous and coordinated viewing of the correlated imagery. The visualization tool may also provide distance and measuring, three-dimensional lens, structure identification, path finding, visibility and similar tools to allow a user to determine distance between imaged objects.

Abstract: Embodiments of the invention relate to the visualization of geographical information and the combination of image information to generate geographical information. Specifically, embodiments of the invention relate to a process and system for correlating oblique images data and terrain data without extrinsic information about the oblique imagery. Embodiments include a visualization tool to allow simultaneous and coordinated viewing of the correlated imagery. The visualization tool may also provide distance and measuring, three-dimensional lens, structure identification, path finding, visibility and similar tools to allow a user to determine distance between imaged objects.