Patents Assigned to Hover, Inc.
  • Patent number: 11380078
    Abstract: System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining images of the building structure, including non-camera anchors. The method also includes identifying reference poses for images based on the non-camera anchors. The method also includes obtaining world map data including real-world poses for the images. The method also includes selecting candidate poses from the real-world poses based on corresponding reference poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on correlating the reference poses with the selected candidate poses. Some implementations use structure from motion techniques or LiDAR, in addition to augmented reality frameworks, for scaling the 3-D representations of the building structure. In some implementations, the world map data includes environmental data, such as illumination data, and the method includes generating or displaying the 3-D representation.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: July 5, 2022
    Assignee: HOVER, INC.
    Inventors: Manish Upendran, William Castillo, Jena Dzitsiuk, Yunwen Zhou, Matthew Thomas
  • Publication number: 20220147662
    Abstract: The scale of modeled building objects from collected imagery is determined by identifying architectural elements within building object imagery, determining a scale of the identified architectural elements by matching them to known industry standard architectural element based on dimensional ratio comparisons and deriving an average scaling factor based on scale of the identified architectural elements. A three dimensional model of the building object is scaled according to the average scaling. Scaled architecture elements within a relative error can be used for scaling the model according to an updated scale factor.
    Type: Application
    Filed: January 25, 2022
    Publication date: May 12, 2022
    Applicant: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman
  • Patent number: 11310414
    Abstract: An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: April 19, 2022
    Assignee: Hover Inc.
    Inventors: Manish Upendran, William Castillo, Derek Halliday
  • Patent number: 11276229
    Abstract: The scale of modeled building objects from collected imagery is determined by identifying architectural elements within building object imagery, determining a scale of the identified architectural elements by matching them to known industry standard architectural element based on dimensional ratio comparisons and deriving an average scaling factor based on scale of the identified architectural elements. A three dimensional model of the building object is scaled according to the average scaling. Scaled architecture elements within a relative error can be used for scaling the model according to an updated scale factor.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: March 15, 2022
    Assignee: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman
  • Publication number: 20210366187
    Abstract: Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.
    Type: Application
    Filed: August 6, 2021
    Publication date: November 25, 2021
    Applicant: Hover Inc.
    Inventors: Shaohui Sun, Ioannis Pavlidis, Adam J. Altman
  • Publication number: 20210314484
    Abstract: Systems and methods are disclosed for directed image capture of a subject of interest, such as a home. Directed image capture can produce higher quality images such as more centrally located within a display and/or viewfinder of an image capture device, higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) facilitate content placement for certain positions and quality assessments for the content of interest can be calculated such as for pixel distance of the content of interest to a centroid of the display or viewfinder, or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.
    Type: Application
    Filed: June 20, 2021
    Publication date: October 7, 2021
    Applicant: Hover Inc.
    Inventors: William Castillo, Adam J. Altman, Ioannis Pavlidis, Sarthak Sahu, Manish Upendran
  • Patent number: 11113877
    Abstract: Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: September 7, 2021
    Assignee: Hover Inc.
    Inventors: Shaohui Sun, Ioannis Pavlidis, Adam J. Altman
  • Patent number: 11100704
    Abstract: A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: August 24, 2021
    Assignee: Hover Inc.
    Inventors: Ajay Mishra, Manish Upendran, A. J. Altman, William Castillo
  • Publication number: 20210256777
    Abstract: Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving a plane associated with an architectural element based on a scale and a translation positional error, wherein the scaled is determined based on the architectural element, and the translation position error is based on a position of the architectural element, and reconstructing the multi-dimensional building model based on the moved plane.
    Type: Application
    Filed: May 3, 2021
    Publication date: August 19, 2021
    Applicant: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
  • Publication number: 20210243362
    Abstract: Disclosed are techniques for enhancing two-dimensional (2D) image capture of subjects (e.g., a physical structure, such as a residential building) to maximize the feature correspondences available for three-dimensional (3D) model reconstruction. More specifically, disclosed is a computer-vision network configured to provide viewfinder interfaces and analyses to guide the improved capture of an intended subject for specified purposes. Additionally, the computer-vision network can be configured to generate a metric representing a quality of feature correspondences between images of a complete set of images used for reconstructing a 3D model of a physical structure. The computer-vision network can also be configured to generate feedback at or before image capture time to guide improvements to the quality of feature correspondences between a pair of images.
    Type: Application
    Filed: January 29, 2021
    Publication date: August 5, 2021
    Applicant: Hover Inc.
    Inventors: William Castillo, Brandon Scott, Alrik Firl, David Royston Cutts, Jonathan Mark Igner, Dario Rethage, Domenico Curro
  • Patent number: 11070720
    Abstract: Systems and methods are disclosed for directed image capture of a subject of interest, such as a home. Directed image capture can produce higher quality images such as more centrally located within a display and/or viewfinder of an image capture device, higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) facilitate content placement for certain positions and quality assessments for the content of interest can be calculated such as for pixel distance of the content of interest to a centroid of the display or viewfinder, or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: July 20, 2021
    Assignee: Hover Inc.
    Inventors: William Castillo, Adam J. Altman, Ioannis Pavlidis, Sarthak Sahu, Manish Upendran
  • Publication number: 20210217231
    Abstract: A system and method is provided for measurements of building façade elements by combining ground-level and orthogonal imagery. The measurements of the dimension of building façade elements are based on ground-level imagery that is scaled and geo-referenced using orthogonal imagery. The method continues by creating a tabular dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows or doors. The tabular dataset can be part of an estimate report.
    Type: Application
    Filed: March 30, 2021
    Publication date: July 15, 2021
    Applicant: Hover Inc.
    Inventors: Bo Hu, Sarthak Sahu
  • Publication number: 20210217230
    Abstract: The scale of modeled building objects from collected imagery is determined by identifying architectural elements within building object imagery, determining a scale of the identified architectural elements by matching them to known industry standard architectural element based on dimensional ratio comparisons and deriving an average scaling factor based on scale of the identified architectural elements. A three dimensional model of the building object is scaled according to the average scaling. Scaled architecture elements within a relative error can be used for scaling the model according to an updated scale factor.
    Type: Application
    Filed: December 18, 2020
    Publication date: July 15, 2021
    Applicant: Hover Inc.
    Inventors: Derek Halliday, Antonio Carlos Marques da Silva Junior, Roberto Klein, Adam J. Altman
  • Publication number: 20210201579
    Abstract: Visualizing three dimensional content is complicated by display platforms capable of more degrees of freedom to display the content than interface tools have to navigate that content. Disclosed are methods and systems for displaying select portions of the content and generating virtual camera positions with associated look angles for the select portions, such as planar geometries of a three dimensional building, thereby constraining the degrees of freedom for improved navigation through views of the content. Look angles can be associated with axes of the content and fields of view.
    Type: Application
    Filed: March 16, 2021
    Publication date: July 1, 2021
    Applicant: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman
  • Publication number: 20210192842
    Abstract: Systems and methods are disclosed for guiding image capture of a subject by determining a location of the subject and presenting on a display graphical guides representative of perspective views of the subject to be captured. Images of the subject may then be captured and additional graphical guides are presented to the user for display for additional images to be captured. Images may be captured in a predetermined sequence of graphical guides or responsive to a user input or camera information. Captured images may be uploaded to a system for additional processing.
    Type: Application
    Filed: March 10, 2021
    Publication date: June 24, 2021
    Applicant: Hover Inc.
    Inventors: William Castillo, Manish Upendran, Ajay Mishra, Adam J. Altman
  • Patent number: 11030823
    Abstract: Improper positioning of architectural features is corrected during construction or reconstruction of a multi-dimensional (e.g., 3D) building model using known architectural dimensions and known relationships to planes (facades). The system identifies architectural elements that have known architectural standard positions relative to planes within the multi-dimensional model. Dimensional measurements of architectural elements in the multi-dimensional model are used to properly position one or more architectural elements relative to associated planes within the multi-dimensional building model. For example, a window position on a 3D building model first façade is moved inward (offset) according to the known relationship of a window (architectural element) being inset relative to a façade (e.g., exterior wall). In addition, a window frame could be repositioned outwardly relative to the same façade plane based on a known relationship of a frame being located on an external surface of the façade (e.g.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: June 8, 2021
    Assignee: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
  • Patent number: 11017612
    Abstract: Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving planes associated with an architectural element based on detecting edge position(s) for an architectural element relative to a given plane and reconstructing the model based on the adjusted position(s).
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: May 25, 2021
    Assignee: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday
  • Publication number: 20210142577
    Abstract: Disclosed are techniques for generating a photorealistic image by augmenting or compositing at least a portion of a physical structure (e.g., a house) depicted in a two-dimensional (2D) image with synthetic image data. Additionally, disclosed are techniques for augmenting the depicted physical structure using a minimum amount of three-dimensional (3D) geometric data and applying a scene effect to the synthetic image data to create a photorealistic effect.
    Type: Application
    Filed: November 10, 2020
    Publication date: May 13, 2021
    Applicant: HOVER INC.
    Inventors: Matthew Thomas, Francisco Avila-Beltran, David Royston Cutts, William Castillo, Giridhar Murali, Brandon Scott, Jeffrey Sommers
  • Patent number: 10991158
    Abstract: Systems and methods are disclosed for guiding image capture of a subject by determining a location of the subject and presenting on a display graphical guides representative of perspective views of the subject to be captured. Images of the subject may then be captured and additional graphical guides are presented to the user for display for additional images to be captured. Images may be captured in a predetermined sequence of graphical guides or responsive to a user input or camera information. Captured images may be uploaded to a system for additional processing.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: April 27, 2021
    Assignee: Hover Inc.
    Inventors: William Castillo, Manish Upendran, Ajay Mishra, Adam J. Altman
  • Patent number: 10977862
    Abstract: Visualizing three dimensional content is complicated by display platforms capable of more degrees of freedom to display the content than interface tools have to navigate that content. Disclosed are methods and systems for displaying select portions of the content and generating virtual camera positions with associated look angles for the select portions, such as planar geometries of a three dimensional building, thereby constraining the degrees of freedom for improved navigation through views of the content. Look angles can be associated with axes of the content and fields of view.
    Type: Grant
    Filed: April 15, 2020
    Date of Patent: April 13, 2021
    Assignee: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman