Patents by Inventor Manish Upendran

Manish Upendran has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230171485
    Abstract: An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.
    Type: Application
    Filed: December 27, 2022
    Publication date: June 1, 2023
    Inventors: Manish Upendran, William Castillo, Derek Halliday
  • Patent number: 11663776
    Abstract: A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
    Type: Grant
    Filed: July 19, 2021
    Date of Patent: May 30, 2023
    Assignee: HOVER Inc.
    Inventors: Ajay Mishra, Manish Upendran, A. J. Altman, William Castillo
  • Publication number: 20230154107
    Abstract: Systems and methods are disclosed for guiding image capture of a subject by determining a location of the subject and presenting on a display graphical guides representative of perspective views of the subject to be captured. Images of the subject may then be captured and additional graphical guides are presented to the user for display for additional images to be captured. Images may be captured in a predetermined sequence of graphical guides or responsive to a user input or camera information. Captured images may be uploaded to a system for additional processing.
    Type: Application
    Filed: January 6, 2023
    Publication date: May 18, 2023
    Applicant: Hover Inc.
    Inventors: William Castillo, Manish Upendran, Ajay Mishra, Adam J. Altman
  • Publication number: 20230092286
    Abstract: A process for receiving, from a computing device, a series of captured building images. The process continues by processing, in real-time, each building image in the series of captured building images to determine if each building image meets a minimum criterion, wherein the minimum criteria includes applicability to be used in constructing a specific digital multi-dimensional building model. The process continues by aggregating each image meeting the minimum criteria, determining when a base set of building images has been aggregated, wherein the base set of building images includes a threshold number images to model at least a partial multi-dimensional building model representing the series of captured building images, determining one or more facades present in the partial multi-dimensional building model, determining preliminary dimensions for one or more architectural features of the one or more facades and returning, incrementally (in real-time), the preliminary dimensions to the computing device.
    Type: Application
    Filed: November 23, 2022
    Publication date: March 23, 2023
    Applicant: Hover Inc.
    Inventors: Manish Upendran, William Castillo, Ajay Mishra, Adam J. Altman
  • Patent number: 11593991
    Abstract: A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
    Type: Grant
    Filed: July 19, 2021
    Date of Patent: February 28, 2023
    Assignee: HOVER Inc.
    Inventors: Ajay Mishra, Manish Upendran, A. J. Altman, William Castillo
  • Patent number: 11574440
    Abstract: Systems and methods are disclosed for guiding image capture of a subject by determining a location of the subject and presenting on a display graphical guides representative of perspective views of the subject to be captured. Images of the subject may then be captured and additional graphical guides are presented to the user for display for additional images to be captured. Images may be captured in a predetermined sequence of graphical guides or responsive to a user input or camera information. Captured images may be uploaded to a system for additional processing.
    Type: Grant
    Filed: March 10, 2021
    Date of Patent: February 7, 2023
    Assignee: Hover Inc.
    Inventors: William Castillo, Manish Upendran, Ajay Mishra, Adam J. Altman
  • Publication number: 20230021025
    Abstract: A computer system trains a machine learning model to estimate a real-world measurement of a feature of a structure. The machine learning model is trained using a plurality of digital image sets, wherein each image set depicts a particular structure, and a plurality of measurements, wherein each measurement is a measurement of a feature of a particular structure. After the machine learning model is trained, it is used to estimate a measurement of a feature of a particular structure depicted in a particular image set.
    Type: Application
    Filed: September 23, 2022
    Publication date: January 19, 2023
    Inventors: Ajay Mishra, William Castillo, A.J. Altman, Manish Upendran
  • Patent number: 11558547
    Abstract: An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.
    Type: Grant
    Filed: March 21, 2022
    Date of Patent: January 17, 2023
    Assignee: Hover Inc.
    Inventors: Manish Upendran, William Castillo, Derek Halliday
  • Patent number: 11538219
    Abstract: A process for creating, responsive to a desired analysis, estimate information from received imagery by determining whether the imagery meets a minimum criterion for creating a multi-dimensional model that can address the desired analysis and building an aggregate set of images meeting the minimum criterion from which a multi-dimensional model is then built and an estimate responsive to the desired analysis is derived. The multi-dimensional model, and the responsive estimate, may be refined as additional images are provided to the aggregate set. Desired analyses may include dimensions such as square footage of a roof for building objects.
    Type: Grant
    Filed: September 4, 2020
    Date of Patent: December 27, 2022
    Assignee: Hover Inc.
    Inventors: Manish Upendran, William Castillo, Ajay Mishra, Adam J. Altman
  • Patent number: 11481993
    Abstract: A computer system trains a machine learning model to estimate a real-world measurement of a feature of a structure. The machine learning model is trained using a plurality of digital image sets, wherein each image set depicts a particular structure, and a plurality of measurements, wherein each measurement is a measurement of a feature of a particular structure. After the machine learning model is trained, it is used to estimate a measurement of a feature of a particular structure depicted in a particular image set.
    Type: Grant
    Filed: September 11, 2017
    Date of Patent: October 25, 2022
    Assignee: HOVER INC.
    Inventors: Ajay Mishra, William Castillo, A. J. Altman, Manish Upendran
  • Publication number: 20220327792
    Abstract: System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining images of the building structure, including non-camera anchors. The method also includes identifying reference poses for images based on the non-camera anchors. The method also includes obtaining world map data including real-world poses for the images. The method also includes selecting candidate poses from the real-world poses based on corresponding reference poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on correlating the reference poses with the selected candidate poses. Some implementations use structure from motion techniques or LiDAR, in addition to augmented reality frameworks, for scaling the 3-D representations of the building structure. In some implementations, the world map data includes environmental data, such as illumination data, and the method includes generating or displaying the 3-D representation.
    Type: Application
    Filed: May 31, 2022
    Publication date: October 13, 2022
    Inventors: Manish Upendran, William Castillo, Jena Dzitsiuk, Yunwen Zhou, Matthew Thomas
  • Publication number: 20220284617
    Abstract: A computer system generates an outline of a roof of a structure based on a set of lateral images depicting the structure. For each image in the set of lateral images, one or more rooflines corresponding to the roof of the structure are determined. The computer system determines how the rooflines connect to one another. Based on the determination, the rooflines are connected to generate an outline of the roof.
    Type: Application
    Filed: May 23, 2022
    Publication date: September 8, 2022
    Applicant: Hover Inc.
    Inventors: Ajay Mishra, William Castillo, A.J. Altman, Manish Upendran
  • Publication number: 20220284618
    Abstract: A computer system generates an outline of a roof of a structure based on a set of lateral images depicting the structure. For each image in the set of lateral images, one or more rooflines corresponding to the roof of the structure are determined. The computer system determines how the rooflines connect to one another. Based on the determination, the rooflines are connected to generate an outline of the roof.
    Type: Application
    Filed: May 23, 2022
    Publication date: September 8, 2022
    Applicant: Hover Inc.
    Inventors: Ajay Mishra, William Castillo, A.J. Altman, Manish Upendran
  • Publication number: 20220217268
    Abstract: An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.
    Type: Application
    Filed: March 21, 2022
    Publication date: July 7, 2022
    Inventors: Manish Upendran, William Castillo, Derek Halliday
  • Patent number: 11380078
    Abstract: System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining images of the building structure, including non-camera anchors. The method also includes identifying reference poses for images based on the non-camera anchors. The method also includes obtaining world map data including real-world poses for the images. The method also includes selecting candidate poses from the real-world poses based on corresponding reference poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on correlating the reference poses with the selected candidate poses. Some implementations use structure from motion techniques or LiDAR, in addition to augmented reality frameworks, for scaling the 3-D representations of the building structure. In some implementations, the world map data includes environmental data, such as illumination data, and the method includes generating or displaying the 3-D representation.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: July 5, 2022
    Assignee: HOVER, INC.
    Inventors: Manish Upendran, William Castillo, Jena Dzitsiuk, Yunwen Zhou, Matthew Thomas
  • Patent number: 11310414
    Abstract: An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: April 19, 2022
    Assignee: Hover Inc.
    Inventors: Manish Upendran, William Castillo, Derek Halliday
  • Publication number: 20210350617
    Abstract: A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
    Type: Application
    Filed: July 19, 2021
    Publication date: November 11, 2021
    Inventors: Ajay Mishra, Manish Upendran, A.J. Altman, William Castillo
  • Publication number: 20210314484
    Abstract: Systems and methods are disclosed for directed image capture of a subject of interest, such as a home. Directed image capture can produce higher quality images such as more centrally located within a display and/or viewfinder of an image capture device, higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) facilitate content placement for certain positions and quality assessments for the content of interest can be calculated such as for pixel distance of the content of interest to a centroid of the display or viewfinder, or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.
    Type: Application
    Filed: June 20, 2021
    Publication date: October 7, 2021
    Applicant: Hover Inc.
    Inventors: William Castillo, Adam J. Altman, Ioannis Pavlidis, Sarthak Sahu, Manish Upendran
  • Patent number: 11100704
    Abstract: A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: August 24, 2021
    Assignee: Hover Inc.
    Inventors: Ajay Mishra, Manish Upendran, A. J. Altman, William Castillo
  • Publication number: 20210256777
    Abstract: Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving a plane associated with an architectural element based on a scale and a translation positional error, wherein the scaled is determined based on the architectural element, and the translation position error is based on a position of the architectural element, and reconstructing the multi-dimensional building model based on the moved plane.
    Type: Application
    Filed: May 3, 2021
    Publication date: August 19, 2021
    Applicant: Hover Inc.
    Inventors: Manish Upendran, Adam J. Altman, Derek Halliday