Patents Assigned to Hover, Inc.
  • Patent number: 12170840
    Abstract: An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.
    Type: Grant
    Filed: September 29, 2023
    Date of Patent: December 17, 2024
    Assignee: Hover Inc.
    Inventors: Manish Upendran, William Castillo, Derek Halliday
  • Publication number: 20240412322
    Abstract: Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving a plane associated with an architectural element based on a scale and a translation positional error, wherein the scaled is determined based on the architectural element, and the translation position error is based on a position of the architectural element, and reconstructing the multi-dimensional building model based on the moved plane.
    Type: Application
    Filed: August 19, 2024
    Publication date: December 12, 2024
    Applicant: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
  • Patent number: 12165255
    Abstract: A system and method is provided for measurements of building façade elements by combining ground-level and orthogonal imagery. The measurements of the dimension of building façade elements are based on ground-level imagery that is scaled and geo-referenced using orthogonal imagery. The method continues by creating a tabular dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows or doors. The tabular dataset can be part of an estimate report.
    Type: Grant
    Filed: January 17, 2024
    Date of Patent: December 10, 2024
    Assignee: Hover Inc.
    Inventors: Bo Hu, Sarthak Sahu
  • Publication number: 20240394976
    Abstract: A system and method for real-time updating of three-dimensional (3D) building models includes receiving a request to analyze building imagery to detect potential physical changes in or around a first building, receiving the building imagery, the building imagery including one or more images of the building, optionally building a first 3D building model (textured or untextured) based on the building imagery, retrieving, from computer storage, a previously stored version of the first 3D building model, comparing, on a region-by-region basis, the first 3D building model against the previously stored version of the first 3D building model, cataloging in computer storage, based on the comparing, changes to the previously stored version of the first 3D building model, where the changes to the first 3D building model represent physical changes to or around the building occurring since a time of the previous stored version of the 3D building model.
    Type: Application
    Filed: August 6, 2024
    Publication date: November 28, 2024
    Applicant: Hover Inc.
    Inventors: Manish Upendran, William Castillo, Adam J. Altman
  • Publication number: 20240348913
    Abstract: Methods, storage media, and systems for selecting an optimal two-dimensional image frame within one or more capture windows for a three-dimensional reconstruction pipeline. The method may include generating one or more capture windows. Each capture window may be proximate to a detected actuation, relative to a first image frame, or a combination thereof. A plurality of candidate image frames and sensor data may be captured within each capture window, assigned to each capture window, or a combination thereof. A frame cost for each candidate image frame may be generated based on sensor data, image data, or a combination thereof. An optimal image frame may be selected based on frame cost, sensor data, image data, or a combination thereof. The optimal image frame may be stored. Image frames other than the optimal image frame may be distinguished.
    Type: Application
    Filed: April 11, 2024
    Publication date: October 17, 2024
    Applicant: Hover Inc.
    Inventors: Matthew Thomas, Hongyuan He
  • Publication number: 20240346760
    Abstract: Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.
    Type: Application
    Filed: June 26, 2024
    Publication date: October 17, 2024
    Applicant: Hover Inc.
    Inventors: Shaohui Sun, Ioannis Pavlidis, Adam J. Altman
  • Publication number: 20240338879
    Abstract: Disclosed are methods, storage media, and systems for selecting a pair of consistent real-world camera poses for 3D reconstruction. The disclosed processes involve capturing multiple images of an object from various camera poses and analyzing the images and camera poses to select a consistent pair of camera poses. This selection is based on calculating perturbation errors and reprojection errors generated from 2D points or 2D line segments in the images. A weight is calculated for each camera pose pair based on these errors, and the pair with the largest weight, indicative of the highest consistency and stability, is selected.
    Type: Application
    Filed: April 3, 2024
    Publication date: October 10, 2024
    Applicant: Hover Inc.
    Inventors: Weien Ting, Zhiyao Xiong
  • Publication number: 20240314432
    Abstract: The disclosure relates to methods, storage media, and systems of detecting a persisting or sustained blur condition across 2D image frames captured for a 3D reconstruction pipeline. It may include receiving a plurality of image frames captured by a camera of a capture device, receiving sensor data of the capture device, detecting, based on the sensor data of the capture device, a blur condition for at least a threshold number of image frames within a capture window, responsive to detecting the blur condition, providing an augmentation for at least one image frame of the plurality of image frames based on the sensor data, applying the augmentation to the at least one image frame of the plurality of image frames, and displaying, on a display of the capture device, the at least one augmented image frame.
    Type: Application
    Filed: March 13, 2024
    Publication date: September 19, 2024
    Applicant: Hover Inc.
    Inventor: Atulya Shree
  • Publication number: 20240290056
    Abstract: Methods, storage media, and systems for augmenting two-dimensional (2D) data, three-dimensional (3D) data, 2D models, or 3D models are disclosed. Exemplary implementations may: receive a first plurality of images: generate a first 3D model based on the first plurality of images; receive a second plurality of images; generate a second 3D model based on the second plurality of images; and augment the first 3D model with the second 3D model.
    Type: Application
    Filed: July 7, 2022
    Publication date: August 29, 2024
    Applicant: Hover Inc.
    Inventors: Matthew Thomas, Jacob Burkhart, Yevheniia Dzitsiuk, Jeffrey Sommers, Harsh Barbhaiya, Manish Upendran, Kerry Gould, Anna Marie Clifton
  • Publication number: 20240290037
    Abstract: Methods, storage media, and systems for integrating disparate data streams of a current scan to generate visual cues of the current scan are disclosed. Exemplary implementations may: receive, from a data capture device, captured visual data and captured depth data of a current scan of an environment; generate a first plurality of masks based on the captured depth data; generate a depth propagation based on the first plurality of masks; generate augmented visual data based on the captured visual data, the first plurality of masks, and the depth propagation; and display, on a display of the data capture device, the augmented visual data.
    Type: Application
    Filed: July 7, 2022
    Publication date: August 29, 2024
    Applicant: Hover Inc.
    Inventors: Kerry Gould, Jeffrey Sommers, Harsh Barbhaiya
  • Publication number: 20240212274
    Abstract: A method and related software are disclosed for processing imagery related to three dimensional models. To display new visual data for select portions of images, an image of a physical structure such as a building with a façade is retrieved with an associated three dimensional model for that physical structure according to common geolocation tags. A scaffolding of surfaces composing the three dimensional model is generated and regions of the retrieved image are registered to the surfaces of the scaffolding to create mapped surfaces for the image. New image data such as texture information is received and applied to select mapped surfaces to give the retrieved image the appearance of having the new texture data at the selected mapped surface.
    Type: Application
    Filed: March 7, 2024
    Publication date: June 27, 2024
    Applicant: Hover Inc.
    Inventors: Ioannis Pavlidis, Vineet Bhatawadekar
  • Publication number: 20240203020
    Abstract: Systems and methods for generating or rendering a three-dimensional (3D) representation of a structure based on images of the structure are disclosed. A selectively rendered point cloud is generated based on the images of the structure and real cameras associated with a virtual camera observing the selectively rendered point cloud. Images attributes may be applied to the selectively rendered point cloud.
    Type: Application
    Filed: April 12, 2022
    Publication date: June 20, 2024
    Applicant: Hover Inc.
    Inventors: Matthew THOMAS, Harsh BARBHAIYA, Jeffrey SOMMERS
  • Publication number: 20240193859
    Abstract: A system and method is provided for measurements of building façade elements by combining ground-level and orthogonal imagery. The measurements of the dimension of building façade elements are based on ground-level imagery that is scaled and geo-referenced using orthogonal imagery. The method continues by creating a tabular dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows or doors. The tabular dataset can be part of an estimate report.
    Type: Application
    Filed: January 17, 2024
    Publication date: June 13, 2024
    Applicant: Hover Inc.
    Inventors: Bo Hu, Sarthak Sahu
  • Publication number: 20240193860
    Abstract: A system and method is provided for constructing a labeled and dimensioned multidimensional (e.g., 3D) building model from building object imagery (e.g., ground-level imagery). The method begins by retrieve building object imagery, the building object imagery collected based on directed capture with a mobile device. The method continues by constructing a scaled multi-dimensional building model, the scale based on sizing of at least one selected architectural feature. The method continues by identifying architectural elements within facades of the multi-dimensional building model. The method continues by determining dimensions of at least one of the architectural elements, the dimensions based on the scale. The method continues by determining dimensions (e.g., area) of at least one of the architectural elements. The method continues by labeling each identified architectural element with at least an identifier and by labeling at least one of the architectural elements with the determined dimensions.
    Type: Application
    Filed: February 16, 2024
    Publication date: June 13, 2024
    Applicant: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman
  • Patent number: 11961180
    Abstract: A computer system generates an outline of a roof of a structure based on a set of lateral images depicting the structure. For each image in the set of lateral images, one or more rooflines corresponding to the roof of the structure are determined. The computer system determines how the rooflines connect to one another. Based on the determination, the rooflines are connected to generate an outline of the roof.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: April 16, 2024
    Assignee: HOVER Inc.
    Inventors: Ajay Mishra, William Castillo, A. J. Altman, Manish Upendran
  • Patent number: 11954169
    Abstract: A method renders photorealistic images in a web browser. The method is performed at a computing device having a general purpose processor and a graphics processing unit (GPU). The method includes obtaining an environment map and images of an input scene. The method also includes computing textures for the input scene including by encoding an acceleration structure of the input scene. The method further includes transmitting the textures to shaders executing on a GPU. The method includes generating samples of the input scene, by performing at least one path tracing algorithm on the GPU, according to the textures. The method also includes lighting or illuminating a sample of the input scene using the environment map, to obtain a lighted scene, and tone mapping the lighted scene. The method includes drawing output on a canvas, in the web browser, based on the tone-mapped scene to render the input scene.
    Type: Grant
    Filed: August 2, 2022
    Date of Patent: April 9, 2024
    Assignee: Hover Inc.
    Inventors: Francisco Avila, Lucas Crane, Abhishek Tripathi
  • Patent number: 11954795
    Abstract: A method and related software are disclosed for processing imagery related to three dimensional models. To display new visual data for select portions of images, an image of a physical structure such as a building with a façade is retrieved with an associated three dimensional model for that physical structure according to common geolocation tags. A scaffolding of surfaces composing the three dimensional model is generated and regions of the retrieved image are registered to the surfaces of the scaffolding to create mapped surfaces for the image. New image data such as texture information is received and applied to select mapped surfaces to give the retrieved image the appearance of having the new texture data at the selected mapped surface.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: April 9, 2024
    Assignee: Hover Inc.
    Inventors: Ioannis Pavlidis, Vineet Bhatawadekar
  • Patent number: 11935188
    Abstract: A system and method is provided for constructing a labeled and dimensioned multidimensional (e.g., 3D) building model from building object imagery (e.g., ground-level imagery). The method begins by retrieve building object imagery, the building object imagery collected based on directed capture with a mobile device. The method continues by constructing a scaled multi-dimensional building model, the scale based on sizing of at least one selected architectural feature. The method continues by identifying architectural elements within facades of the multi-dimensional building model. The method continues by determining dimensions of at least one of the architectural elements, the dimensions based on the scale. The method continues by determining dimensions (e.g., area) of at least one of the architectural elements. The method continues by labeling each identified architectural element with at least an identifier and by labeling at least one of the architectural elements with the determined dimensions.
    Type: Grant
    Filed: April 25, 2023
    Date of Patent: March 19, 2024
    Assignee: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman
  • Patent number: 11922570
    Abstract: A system and method is provided for measurements of building façade elements by combining ground-level and orthogonal imagery. The measurements of the dimension of building façade elements are based on ground-level imagery that is scaled and geo-referenced using orthogonal imagery. The method continues by creating a tabular dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows or doors. The tabular dataset can be part of an estimate report.
    Type: Grant
    Filed: February 3, 2023
    Date of Patent: March 5, 2024
    Assignee: Hover Inc.
    Inventors: Bo Hu, Sarthak Sahu
  • Patent number: 11908077
    Abstract: A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
    Type: Grant
    Filed: January 27, 2023
    Date of Patent: February 20, 2024
    Assignee: HOVER Inc.
    Inventors: Ajay Mishra, Manish Upendran, A. J. Altman, William Castillo