Patents by Inventor Tilman Reinhardt

Tilman Reinhardt has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9990750
    Abstract: The present invention pertains to geographical image applications. A user may transition between nadir and street level imagery using unstitched oblique imagery. Oblique images offer a rich set of views of a target location and provide a smooth transition to or from other images such as nadir photographs taken by satellites or street level photographs taken by ground level users. Using unstitched oblique images avoids artifacts that may be introduced when stitching together one or more images. This allows an application to display images to a user and create the illusion of three dimensional motion.
    Type: Grant
    Filed: February 5, 2015
    Date of Patent: June 5, 2018
    Assignee: Google LLC
    Inventors: Tilman Reinhardt, Stephane Lafon, Andrew Timothy Szybalski
  • Patent number: 9626082
    Abstract: Embodiments relate to selecting textures for a user-supplied photographic image in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method includes a method for inputting a user-supplied photographic image that uses a photogrammetry algorithm to adjust a plurality of camera parameters for the user-supplied photographic image. In the method, a user-supplied photographic image inputted by a user is received. A set of geographic characteristics inputted by the user that correspond to a geographic location of a camera that took the user-supplied photographic image is received. A plurality of camera parameters that correspond to the geographic location of the camera that took the user-supplied photographic image is determined. The user-supplied photographic image to be texture mapped to the three-dimensional model is enabled.
    Type: Grant
    Filed: October 16, 2014
    Date of Patent: April 18, 2017
    Assignee: Google Inc.
    Inventors: Zhe Fan, Scott Shattuck, Mark A. Limber, Matthew W. Lowrie, Brian Gammon Brown, Matthew Robert Simpson, Tilman Reinhardt
  • Patent number: 9466107
    Abstract: Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, determining a correlation between a pose of a first camera and a pose of a second camera, generating one or more constraints incorporating the correlation, and determining at least one of camera parameters and three dimensional locations of features using a plurality of constraints including the generated one or more constraints. The first camera and the second camera have substantially rigid positions and poses relative to each other. A strength of the correlation is based at least upon a time interval between respective image captures by the first camera and the second camera.
    Type: Grant
    Filed: May 15, 2015
    Date of Patent: October 11, 2016
    Assignee: Google Inc.
    Inventors: Michael Hongmai Lin, Tilman Reinhardt
  • Patent number: 9465976
    Abstract: Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, detecting features in the plurality of images where each of the images cover at least a portion of the geographic area, comparing the detected features between respective ones of the images to determine a plurality of matched features, selecting a subset of the plurality of matched features, and determining the camera parameters and the three dimensional positions of one or more of the detected features using the selected subset. The respective matched features are selected depending on a quantity of other matched features in proximity to the respective matched features.
    Type: Grant
    Filed: September 14, 2015
    Date of Patent: October 11, 2016
    Assignee: Google Inc.
    Inventors: Joshua Sam Schpok, Michael Hongmai Lin, Tilman Reinhardt
  • Patent number: 9437034
    Abstract: Systems and methods for generating textures to be rendered in conjunction with a polygon mesh are provided. More particularly, a polygon mesh modeling a geographic area can be accessed. A plurality of source images depicting the geographic area can then be identified. The plurality of source images can be aligned to reduce projection misalignments between source images when the source images are projected to the polygon mesh. A texture can then be determined based at least in part on a weighted average of pixels in the plurality of source images corresponding to a point on the surface of the polygon mesh. Determining a texture can include removing at least one outlier pixel associated with a moving object from the weighted average.
    Type: Grant
    Filed: December 15, 2014
    Date of Patent: September 6, 2016
    Assignee: Google Inc.
    Inventors: Xiaolin Wei, Tilman Reinhardt
  • Patent number: 9269196
    Abstract: A system that runs in web browsers of mobile devices that allows mobile users to take photos of building exteriors and interiors or other real world objects, upload photos, share photos with others, and use the photo images to model the 3D models with the system's image-based modeling interface.
    Type: Grant
    Filed: October 21, 2014
    Date of Patent: February 23, 2016
    Assignee: Google Inc.
    Inventors: Zhe Fan, Mark Limber, Brian Gammon Brown, Tilman Reinhardt, Matthew Simpson
  • Patent number: 9165179
    Abstract: Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, detecting features in the plurality of images where each of the images cover at least a portion of the geographic area, comparing the detected features between respective ones of the images to determine a plurality of matched features, selecting a subset of the plurality of matched features and determining the camera parameters and the three dimensional positions of one or more of the detected features using the selected subset. The respective matched features are selected depending on a quantity of other matched features in proximity to the respective matched features.
    Type: Grant
    Filed: December 30, 2014
    Date of Patent: October 20, 2015
    Assignee: Google Inc.
    Inventors: Joshua Sam Schpok, Michael Hongmai Lin, Tilman Reinhardt
  • Publication number: 20150248759
    Abstract: Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, determining a correlation between a pose of a first camera and a pose of a second camera, generating one or more constraints incorporating the correlation, and determining at least one of camera parameters and three dimensional locations of features using a plurality of constraints including the generated one or more constraints. The first camera and the second camera have substantially rigid positions and poses relative to each other. A strength of the correlation is based at least upon a time interval between respective image captures by the first camera and the second camera.
    Type: Application
    Filed: May 15, 2015
    Publication date: September 3, 2015
    Inventors: Michael Hongmai Lin, Tilman Reinhardt
  • Publication number: 20150172628
    Abstract: Embodiments enable alteration of automatically-generated three-dimensional models using photogrammetry. In an embodiment, a method creates a three-dimensional model using a two-dimensional photographic image. An automatically generated three-dimensional model geocoded within a field of view of a camera that took the two-dimensional photographic image is received. A perspective of the camera that took the photographic image is represented by a set of camera parameters for the first two-dimensional photographic image. A user input constraint indicating that a feature of the automatically generated three-dimensional model corresponds to a position on two-dimensional photographic image is also received. In response to the user input constraint, the three-dimensional model is altered, using photogrammetry, according to the user input constraint and the set of camera parameters.
    Type: Application
    Filed: June 30, 2011
    Publication date: June 18, 2015
    Applicant: Google Inc.
    Inventors: Brian Gammon BROWN, Tilman Reinhardt, Zhe Fan, Scott Shattuck
  • Patent number: 9058538
    Abstract: Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, determining a correlation between a pose of a first camera and a pose of a second camera, generating one or more constraints incorporating the correlation, and determining at least one of camera parameters and three dimensional locations of features using a plurality of constraints including the generated one or more constraints. The first camera and the second camera have substantially rigid positions and poses relative to each other. A strength of the correlation is based at least upon a time interval between respective image captures by the first camera and the second camera.
    Type: Grant
    Filed: October 15, 2014
    Date of Patent: June 16, 2015
    Assignee: Google Inc.
    Inventors: Michael Hongmai Lin, Tilman Reinhardt
  • Publication number: 20150143301
    Abstract: Embodiments relate to evaluating structures located in a geographic area that is divided into divided bounding areas using a three-dimensional environment representing the structures. In an embodiment, a computer-implemented method includes a method for dividing a three-dimensional environment depicting the structures into the divided bounding areas where each divided bounding area encompasses a portion of structures. In the method, an evaluation web page for each divided bounding area is retrieved from a structure evaluation server where each evaluation web page provides an evaluation status for each divided bounding area. At least one structure encompassed by a selected divided bounding area is evaluated based on a visual representation of the structure. An updated evaluation web page for the selected divided bounding area is provided to the structure evaluation server where the updated evaluation web page provides an updated evaluation status for the selected divided bounding area.
    Type: Application
    Filed: January 11, 2013
    Publication date: May 21, 2015
    Applicant: Google Inc.
    Inventors: Tilman Reinhardt, Bradley Bossard
  • Patent number: 9025810
    Abstract: The present invention pertains to geographical image applications. A user may transition between nadir and street level imagery using unstitched oblique imagery. Oblique images offer a rich set of views of a target location and provide a smooth transition to or from other images such as nadir photographs taken by satellites or street level photographs taken by ground level users. Using unstitched oblique images avoids artifacts that may be introduced when stitching together one or more images. This allows an application to display images to a user and create the illusion of three dimensional motion.
    Type: Grant
    Filed: April 5, 2010
    Date of Patent: May 5, 2015
    Assignee: Google Inc.
    Inventors: Tilman Reinhardt, Stephane Lafon, Andrew Szybalski
  • Patent number: 8989434
    Abstract: The present invention pertains to geographical image applications. A user may transition between nadir and street level imagery using unstitched oblique imagery. Oblique images offer a rich set of views of a target location and provide a smooth transition to or from other images such as nadir photographs taken by satellites or street level photographs taken by ground level users. Using unstitched oblique images avoids artifacts that may be introduced when stitching together one or more images. This allows an application to display images to a user and create the illusion of three dimensional motion.
    Type: Grant
    Filed: April 15, 2013
    Date of Patent: March 24, 2015
    Assignee: Google Inc.
    Inventors: Tilman Reinhardt, Stephane Lafon, Andrew Szybalski
  • Publication number: 20150062287
    Abstract: Aspects of the disclosure relate generally to sharing and displaying streaming videos in panoramas. As an example, a first user may record a video using a mobile computing device. This video, or the series of frames that make up the video, may be uploaded to a server along with location information. Using the location information, the server may identify a panorama. The server may also compare frames of the video to the panorama in order to select an area of the panorama. A second user may request to view the video stream. In response, the server may send the video stream and panorama to the second user's device with instructions to display the video stream overlaid on the selected area of the corresponding panorama.
    Type: Application
    Filed: August 27, 2013
    Publication date: March 5, 2015
    Applicant: GOOGLE INC.
    Inventor: Tilman Reinhardt
  • Patent number: 8965107
    Abstract: Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, detecting features in the plurality of images where each of the images cover at least a portion of the geographic area, comparing the detected features between respective ones of the images to determine a plurality of matched features, selecting a subset of the plurality of matched features, and determining the camera parameters and the three dimensional positions of one or more of the detected features using the selected subset. The respective matched features are selected depending on a quantity of other matched features in proximity to the respective matched features.
    Type: Grant
    Filed: May 18, 2012
    Date of Patent: February 24, 2015
    Assignee: Google Inc.
    Inventors: Joshua Sam Schpok, Michael Hongmai Lin, Tilman Reinhardt
  • Publication number: 20140362082
    Abstract: A computer implemented system and method is disclosed for generating realistic three-dimensional models of roadway overpass structures. An example system comprises a segmentation module configured to identify roadway overpass regions, based on existing map data containing locations of roadway intersections, aerial imagery, and a digital surface model (DSM). A roadway overpass region is assumed to have at least a first and second road segment. A DSM provides an elevation z for each two-dimensional point (x, y). The segmentation module identifies the upper and lower roadway sections of an overpass structure and an extraction module generates a three-dimensional model of the overpass based on the segmented regions identified by the segmentation module. The extraction module combines aerial images with 3D computer models of overpass structures to generate a realistic 3D rendering of surface topography of the earth including roadway overpass structures.
    Type: Application
    Filed: May 3, 2011
    Publication date: December 11, 2014
    Applicant: Google Inc.
    Inventors: Joshua SCHPOK, Tilman Reinhardt
  • Patent number: 8902288
    Abstract: A system that runs in web browsers of mobile devices that allows mobile users to take photos of building exteriors and interiors or other real world objects, upload photos, share photos with others, and use the photo images to model the 3D models with the system's image-based modeling interface.
    Type: Grant
    Filed: June 16, 2011
    Date of Patent: December 2, 2014
    Assignee: Google Inc.
    Inventors: Zhe Fan, Mark Limber, Brian Gammon Brown, Tilman Reinhardt, Matthew Robert Simpson
  • Patent number: 8897543
    Abstract: Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, determining a correlation between a pose of a first camera and a pose of a second camera, generating one or more constraints incorporating the correlation, and determining at least one of camera parameters and three dimensional locations of features using a plurality of constraints including the generated one or more constraints. The first camera and the second camera have substantially rigid positions and poses relative to each other. A strength of the correlation is based at least upon a time interval between respective image captures by the first camera and the second camera.
    Type: Grant
    Filed: May 18, 2012
    Date of Patent: November 25, 2014
    Assignee: Google Inc.
    Inventors: Michael Hongmai Lin, Tilman Reinhardt
  • Patent number: 8884950
    Abstract: Embodiments improve pose data for images via user interaction. A user may model a building in a web browser plug in by mapping positions on two-dimensional images to a three-dimensional model of a building shown in the image. Each of the images may have associated original pose data, which includes information related to a position and orientation of a camera which took the image. Upon modeling the building, pose data may be adjusted to more accurately depict the building as a three-dimensional model. If the adjusted pose data is superior to the original pose data, the adjusted pose data may be associated with the image.
    Type: Grant
    Filed: July 29, 2011
    Date of Patent: November 11, 2014
    Assignee: Google Inc.
    Inventors: Brian Gammon Brown, Zhe Fan, Tilman Reinhardt
  • Patent number: 8866850
    Abstract: Embodiments relate to selecting textures for a user-supplied photographic image in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method includes a method for inputting a user-supplied photographic image that uses a photogrammetry algorithm to adjust a plurality of camera parameters for the user-supplied photographic image. In the method, a user-supplied photographic image inputted by a user is received. A set of geographic characteristics inputted by the user that correspond to a geographic location of a camera that took the user-supplied photographic image is received. A plurality of camera parameters that correspond to the geographic location of the camera that took the user-supplied photographic image is determined. The user-supplied photographic image to be texture mapped to the three-dimensional model is enabled.
    Type: Grant
    Filed: March 13, 2012
    Date of Patent: October 21, 2014
    Assignee: Google Inc.
    Inventors: Zhe Fan, Scott Shattuck, Mark Limber, Matt Lowrie, Brian Gammon Brown, Matthew Robert Simpson, Tilman Reinhardt