Patents by Inventor Clemens Marschner

Clemens Marschner has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11727601
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to receive a plurality of images of the geographical area, determine a ground map of the geographical area, divide the ground map into a plurality of sampling points of the geographical area; and determine a color for each of the plurality of sampling points, wherein the color of each of the sampling points is determined by determining a correlation between the sampling points of the geographical area and color of the sampling points captured in at least one of the plurality of images.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: August 15, 2023
    Assignee: Woven Planet North America, Inc.
    Inventors: Clemens Marschner, Thomas Schiwietz, Wilhelm Richert, Nikolai Morin, Holger Rapp
  • Patent number: 11688164
    Abstract: Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: June 27, 2023
    Assignee: Woven Planet North America, Inc.
    Inventors: Patrick Dubroy, Wolfgang Hess, Clemens Marschner, Emil Praun, Holger Rapp, Thomas Schiwietz, Vinay Shet
  • Patent number: 11488353
    Abstract: Examples disclosed herein may involve (i) obtaining a first layer of map data associated with sensor data capturing a geographical area, the first layer of map data comprising an aggregated overhead-view image of the geographical area, where the aggregated overhead-view image is generated from aggregated pixel values from a plurality of images associated with the geographical area, (ii) obtaining a second layer of map data, the second layer of map data comprising label data for the geographical area derived from the aggregated overhead-view image of the geographical area, and (iii) causing the first layer of map data and the second layer of map data to be presented to a user for curation of the label data.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: November 1, 2022
    Assignee: Woven Planet North America, Inc.
    Inventors: Patrick Dubroy, Clemens Marschner, Wilhelm Richert, Thomas Schiwietz
  • Patent number: 11302065
    Abstract: Examples disclosed herein may involve (i) obtaining 2D image data and 3D sensor data that is representative of an area, (ii) identifying a first set of pixels associated with ephemeral objects detected in the area and a second set of pixels associated with non-ephemeral objects detected in the area, (iii) identifying a first set of ephemeral 3D data points associated with the detected ephemeral objects and a second set of non-ephemeral 3D data points associated with the detected non-ephemeral objects, (iv) mapping the first and second sets of 3D data points to a grid of voxels associated with the area, (v) making a determination that one or more voxels in the grid each contain a threshold extent of ephemeral data points, and (vi) based at least in part on the determination, filtering the 3D sensor data to remove the 3D data points contained within the one or more voxels.
    Type: Grant
    Filed: December 17, 2019
    Date of Patent: April 12, 2022
    Assignee: Woven Planet North America, Inc.
    Inventors: Wilhelm Richert, Darko Zikic, Clemens Marschner
  • Patent number: 11295521
    Abstract: The present disclosure relates to a method of generating a ground map. For instance, the present disclosure provides a method of determining relevant point cloud data for generating a surface topology over real-world geographical areas using sensor data, which may involve (i) receiving a first dataset from a first sensor, (ii) receiving a second dataset from a second sensor, (iii) classifying the first dataset by identifying characteristics of the first dataset that correspond to a ground surface, (iv) filtering the second dataset based on the classified first dataset, and (v) generating a ground map from the filtered second dataset.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: April 5, 2022
    Assignee: Woven Planet North America, Inc.
    Inventors: Marco Caccin, Clemens Marschner, Nikolai Morin, Darko Zikic
  • Patent number: 11288522
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine a ground map of the geographical area; receiving a plurality of images of the geographical area; process the plurality of images to select a subset of images to generate the overhead view of the geographical area; divide the ground map into a plurality of sampling points of the geographical area; and determine a color of a plurality of patches of the overhead view image from the subset of images, each patch representing each sampling point of the geographical area.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: March 29, 2022
    Assignee: Woven Planet North America, Inc.
    Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
  • Patent number: 11244500
    Abstract: Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine one or more images of a generated overhead view of a geographical area. The generated overhead view is generated from aggregated pixel values determined from correlated pixel values in images of the geographical area. The disclosed approaches identify semantic map features as being present in the images of the overhead perspective of the geographic area. The disclosed approaches extract the semantic map features of the geographical area from the images of the substantially overhead perspective of the geographical area. The disclosed approaches translate the extracted semantic map features to a semantic map layer of a geometric map associated with the geographical area.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: February 8, 2022
    Assignee: Woven Planet North America, Inc.
    Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
  • Publication number: 20220020177
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to receive a plurality of images of the geographical area, determine a ground map of the geographical area, divide the ground map into a plurality of sampling points of the geographical area; and determine a color for each of the plurality of sampling points, wherein the color of each of the sampling points is determined by determining a correlation between the sampling points of the geographical area and color of the sampling points captured in at least one of the plurality of images.
    Type: Application
    Filed: March 29, 2021
    Publication date: January 20, 2022
    Applicant: Woven Planet North America, Inc.
    Inventors: Clemens Marschner, Thomas Schiwietz, Wilhelm Richert, Nikolai Morin, Holger Rapp
  • Publication number: 20210365682
    Abstract: Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.
    Type: Application
    Filed: May 18, 2021
    Publication date: November 25, 2021
    Applicant: Woven Planet North America, Inc.
    Inventors: Patrick Dubroy, Wolfgang Hess, Clemens Marschner, Emil Praun, Holger Rapp, Thomas Schiwietz, Vinay Shet
  • Patent number: 11163998
    Abstract: Systems, methods, and non-transitory computer-readable media can determine a first label at a first position in a first image captured from a vehicle, the first label indicating that a first object is depicted in the first image at the first position, wherein the first image is a two-dimensional image. The first object is identified in a three-dimensional coordinate space representative of an environment of the vehicle based on the first position of the first label within the first image. A second label is automatically generated at a second position in a second image captured from the vehicle based on simultaneous localization and mapping (SLAM) information associated with the vehicle. The second label indicates that the first object is depicted in the second image at the second position.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: November 2, 2021
    Assignee: Woven Planet North America, Inc.
    Inventors: Wolfgang Hess, Clemens Marschner, Holger Rapp
  • Publication number: 20210304491
    Abstract: The present disclosure relates to a method of generating a ground map. For instance, the present disclosure provides a method of determining relevant point cloud data for generating a surface topology over real-world geographical areas using sensor data, which may involve (i) receiving a first dataset from a first sensor, (ii) receiving a second dataset from a second sensor, (iii) classifying the first dataset by identifying characteristics of the first dataset that correspond to a ground surface, (iv) filtering the second dataset based on the classified first dataset, and (v) generating a ground map from the filtered second dataset.
    Type: Application
    Filed: March 25, 2020
    Publication date: September 30, 2021
    Inventors: Marco Caccin, Clemens Marschner, Nikolai Morin, Darko Zikic
  • Publication number: 20210303849
    Abstract: Examples disclosed herein may involve (i) obtaining a first layer of map data associated with sensor data capturing a geographical area, the first layer of map data comprising an aggregated overhead-view image of the geographical area, where the aggregated overhead-view image is generated from aggregated pixel values from a plurality of images associated with the geographical area, (ii) obtaining a second layer of map data, the second layer of map data comprising label data for the geographical area derived from the aggregated overhead-view image of the geographical area, and (iii) causing the first layer of map data and the second layer of map data to be presented to a user for curation of the label data.
    Type: Application
    Filed: March 31, 2020
    Publication date: September 30, 2021
    Inventors: Patrick Dubroy, Clemens Marschner, Wilhelm Richert, Thomas Schiwietz
  • Publication number: 20210201050
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine a ground map of the geographical area; receiving a plurality of images of the geographical area; process the plurality of images to select a subset of images to generate the overhead view of the geographical area; divide the ground map into a plurality of sampling points of the geographical area; and determine a color of a plurality of patches of the overhead view image from the subset of images, each patch representing each sampling point of the geographical area.
    Type: Application
    Filed: December 31, 2019
    Publication date: July 1, 2021
    Applicant: Lyft, Inc.
    Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
  • Publication number: 20210201569
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data.
    Type: Application
    Filed: December 31, 2019
    Publication date: July 1, 2021
    Applicant: Lyft, Inc.
    Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
  • Publication number: 20210199446
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine a ground map of the geographical area; receiving a plurality of images of the geographical area; process the plurality of images to select a subset of images to generate the overhead view of the geographical area; divide the ground map into a plurality of sampling points of the geographical area; and determine a color of a plurality of patches of the overhead view image from the subset of images, each patch representing each sampling point of the geographical area.
    Type: Application
    Filed: December 31, 2019
    Publication date: July 1, 2021
    Applicant: Lyft, Inc.
    Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz
  • Publication number: 20210183139
    Abstract: Examples disclosed herein may involve (i) obtaining 2D image data and 3D sensor data that is representative of an area, (ii) identifying a first set of pixels associated with ephemeral objects detected in the area and a second set of pixels associated with non-ephemeral objects detected in the area, (iii) identifying a first set of ephemeral 3D data points associated with the detected ephemeral objects and a second set of non-ephemeral 3D data points associated with the detected non-ephemeral objects, (iv) mapping the first and second sets of 3D data points to a grid of voxels associated with the area, (v) making a determination that one or more voxels in the grid each contain a threshold extent of ephemeral data points, and (vi) based at least in part on the determination, filtering the 3D sensor data to remove the 3D data points contained within the one or more voxels.
    Type: Application
    Filed: December 17, 2019
    Publication date: June 17, 2021
    Inventors: Wilhelm Richert, Darko Zikic, Clemens Marschner
  • Patent number: 11037328
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to receive a plurality of images of the geographical area, determine a ground map of the geographical area, divide the ground map into a plurality of sampling points of the geographical area; and determine a color for each of the plurality of sampling points, wherein the color of each of the sampling points is determined by determining a correlation between the sampling points of the geographical area and color of the sampling points captured in at least one of the plurality of images.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: June 15, 2021
    Assignee: Lyft, Inc.
    Inventors: Clemens Marschner, Thomas Schiwietz, Wilhelm Richert, Nikolai Morin, Holger Rapp
  • Patent number: 11036986
    Abstract: Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.
    Type: Grant
    Filed: February 8, 2019
    Date of Patent: June 15, 2021
    Assignee: Lyft, Inc.
    Inventors: Patrick Dubroy, Wolfgang Hess, Clemens Marschner, Emil Praun, Holger Rapp, Thomas Schiwietz, Vinay Shet
  • Patent number: 10997750
    Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to receive a plurality of images of the geographical area, determine a ground map of the geographical area, divide the ground map into a plurality of sampling points of the geographical area; and determine a color for each of the plurality of sampling points, wherein the color of each of the sampling points is determined by determining a correlation between the sampling points of the geographical area and color of the sampling points captured in at least one of the plurality of images.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: May 4, 2021
    Assignee: Lyft, Inc.
    Inventors: Clemens Marschner, Thomas Schiwietz, Wilhelm Richert, Nikolai Morin, Holger Rapp
  • Publication number: 20200257900
    Abstract: Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.
    Type: Application
    Filed: February 8, 2019
    Publication date: August 13, 2020
    Applicant: Lyft, Inc.
    Inventors: Patrick Dubroy, Wolfgang Hess, Clemens Marschner, Emil Praun, Holger Rapp, Thomas Schiwietz, Vinay Shet