Patents by Inventor Thomas Schiwietz
Thomas Schiwietz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11727601Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to receive a plurality of images of the geographical area, determine a ground map of the geographical area, divide the ground map into a plurality of sampling points of the geographical area; and determine a color for each of the plurality of sampling points, wherein the color of each of the sampling points is determined by determining a correlation between the sampling points of the geographical area and color of the sampling points captured in at least one of the plurality of images.Type: GrantFiled: March 29, 2021Date of Patent: August 15, 2023Assignee: Woven Planet North America, Inc.Inventors: Clemens Marschner, Thomas Schiwietz, Wilhelm Richert, Nikolai Morin, Holger Rapp
-
Patent number: 11688164Abstract: Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.Type: GrantFiled: May 18, 2021Date of Patent: June 27, 2023Assignee: Woven Planet North America, Inc.Inventors: Patrick Dubroy, Wolfgang Hess, Clemens Marschner, Emil Praun, Holger Rapp, Thomas Schiwietz, Vinay Shet
-
Patent number: 11488353Abstract: Examples disclosed herein may involve (i) obtaining a first layer of map data associated with sensor data capturing a geographical area, the first layer of map data comprising an aggregated overhead-view image of the geographical area, where the aggregated overhead-view image is generated from aggregated pixel values from a plurality of images associated with the geographical area, (ii) obtaining a second layer of map data, the second layer of map data comprising label data for the geographical area derived from the aggregated overhead-view image of the geographical area, and (iii) causing the first layer of map data and the second layer of map data to be presented to a user for curation of the label data.Type: GrantFiled: March 31, 2020Date of Patent: November 1, 2022Assignee: Woven Planet North America, Inc.Inventors: Patrick Dubroy, Clemens Marschner, Wilhelm Richert, Thomas Schiwietz
-
Patent number: 11288522Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine a ground map of the geographical area; receiving a plurality of images of the geographical area; process the plurality of images to select a subset of images to generate the overhead view of the geographical area; divide the ground map into a plurality of sampling points of the geographical area; and determine a color of a plurality of patches of the overhead view image from the subset of images, each patch representing each sampling point of the geographical area.Type: GrantFiled: December 31, 2019Date of Patent: March 29, 2022Assignee: Woven Planet North America, Inc.Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
-
Patent number: 11257197Abstract: Examples disclosed herein may involve (i) obtaining an aggregated overhead view image of a geographical area that has been generated by a pipeline for generating aggregated overhead view images, the geographical area comprising a plurality of regions, where the aggregated overhead view image is generated from aggregating pixel values from a plurality of source images of the geographical area, (ii) generating one or more reprojection images of one or more of the regions of the geographic area from the aggregated overhead view image, (iii) identifying, from the plurality of source images, one or more source images that capture the one or more regions of the geographical area, (iv) calculating one or more differences between the identified one or more source images and the one or more reprojection images, and (v) determining one or more error corrections to be applied to the pipeline for generating overhead view images.Type: GrantFiled: March 31, 2020Date of Patent: February 22, 2022Assignee: Woven Planet North America, Inc.Inventors: Wilhelm Richert, Thomas Schiwietz
-
Patent number: 11244500Abstract: Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine one or more images of a generated overhead view of a geographical area. The generated overhead view is generated from aggregated pixel values determined from correlated pixel values in images of the geographical area. The disclosed approaches identify semantic map features as being present in the images of the overhead perspective of the geographic area. The disclosed approaches extract the semantic map features of the geographical area from the images of the substantially overhead perspective of the geographical area. The disclosed approaches translate the extracted semantic map features to a semantic map layer of a geometric map associated with the geographical area.Type: GrantFiled: December 31, 2019Date of Patent: February 8, 2022Assignee: Woven Planet North America, Inc.Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
-
Publication number: 20220020177Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to receive a plurality of images of the geographical area, determine a ground map of the geographical area, divide the ground map into a plurality of sampling points of the geographical area; and determine a color for each of the plurality of sampling points, wherein the color of each of the sampling points is determined by determining a correlation between the sampling points of the geographical area and color of the sampling points captured in at least one of the plurality of images.Type: ApplicationFiled: March 29, 2021Publication date: January 20, 2022Applicant: Woven Planet North America, Inc.Inventors: Clemens Marschner, Thomas Schiwietz, Wilhelm Richert, Nikolai Morin, Holger Rapp
-
Publication number: 20210365682Abstract: Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.Type: ApplicationFiled: May 18, 2021Publication date: November 25, 2021Applicant: Woven Planet North America, Inc.Inventors: Patrick Dubroy, Wolfgang Hess, Clemens Marschner, Emil Praun, Holger Rapp, Thomas Schiwietz, Vinay Shet
-
Publication number: 20210303849Abstract: Examples disclosed herein may involve (i) obtaining a first layer of map data associated with sensor data capturing a geographical area, the first layer of map data comprising an aggregated overhead-view image of the geographical area, where the aggregated overhead-view image is generated from aggregated pixel values from a plurality of images associated with the geographical area, (ii) obtaining a second layer of map data, the second layer of map data comprising label data for the geographical area derived from the aggregated overhead-view image of the geographical area, and (iii) causing the first layer of map data and the second layer of map data to be presented to a user for curation of the label data.Type: ApplicationFiled: March 31, 2020Publication date: September 30, 2021Inventors: Patrick Dubroy, Clemens Marschner, Wilhelm Richert, Thomas Schiwietz
-
Publication number: 20210304380Abstract: Examples disclosed herein may involve (i) obtaining an aggregated overhead view image of a geographical area that has been generated by a pipeline for generating aggregated overhead view images, the geographical area comprising a plurality of regions, where the aggregated overhead view image is generated from aggregating pixel values from a plurality of source images of the geographical area, (ii) generating one or more reprojection images of one or more of the regions of the geographic area from the aggregated overhead view image, (iii) identifying, from the plurality of source images, one or more source images that capture the one or more regions of the geographical area, (iv) calculating one or more differences between the identified one or more source images and the one or more reprojection images, and (v) determining one or more error corrections to be applied to the pipeline for generating overhead view imagesType: ApplicationFiled: March 31, 2020Publication date: September 30, 2021Inventors: Wilhelm Richert, Thomas Schiwietz
-
Publication number: 20210199446Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine a ground map of the geographical area; receiving a plurality of images of the geographical area; process the plurality of images to select a subset of images to generate the overhead view of the geographical area; divide the ground map into a plurality of sampling points of the geographical area; and determine a color of a plurality of patches of the overhead view image from the subset of images, each patch representing each sampling point of the geographical area.Type: ApplicationFiled: December 31, 2019Publication date: July 1, 2021Applicant: Lyft, Inc.Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz
-
Publication number: 20210201569Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data.Type: ApplicationFiled: December 31, 2019Publication date: July 1, 2021Applicant: Lyft, Inc.Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
-
Publication number: 20210201050Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to determine a ground map of the geographical area; receiving a plurality of images of the geographical area; process the plurality of images to select a subset of images to generate the overhead view of the geographical area; divide the ground map into a plurality of sampling points of the geographical area; and determine a color of a plurality of patches of the overhead view image from the subset of images, each patch representing each sampling point of the geographical area.Type: ApplicationFiled: December 31, 2019Publication date: July 1, 2021Applicant: Lyft, Inc.Inventors: Clemens Marschner, Wilhelm Richert, Thomas Schiwietz, Darko Zikic
-
Patent number: 11036986Abstract: Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.Type: GrantFiled: February 8, 2019Date of Patent: June 15, 2021Assignee: Lyft, Inc.Inventors: Patrick Dubroy, Wolfgang Hess, Clemens Marschner, Emil Praun, Holger Rapp, Thomas Schiwietz, Vinay Shet
-
Patent number: 11037328Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to receive a plurality of images of the geographical area, determine a ground map of the geographical area, divide the ground map into a plurality of sampling points of the geographical area; and determine a color for each of the plurality of sampling points, wherein the color of each of the sampling points is determined by determining a correlation between the sampling points of the geographical area and color of the sampling points captured in at least one of the plurality of images.Type: GrantFiled: December 31, 2019Date of Patent: June 15, 2021Assignee: Lyft, Inc.Inventors: Clemens Marschner, Thomas Schiwietz, Wilhelm Richert, Nikolai Morin, Holger Rapp
-
Patent number: 10997750Abstract: The present invention relates to a method of generating an overhead view image of an area. More particularly, the present invention relates to a method of generating a contextual multi-image based overhead view image of an area using ground map data and field of view image data. Various embodiments of the present technology can include methods, systems and non-transitory computer readable media and computer programs configured to receive a plurality of images of the geographical area, determine a ground map of the geographical area, divide the ground map into a plurality of sampling points of the geographical area; and determine a color for each of the plurality of sampling points, wherein the color of each of the sampling points is determined by determining a correlation between the sampling points of the geographical area and color of the sampling points captured in at least one of the plurality of images.Type: GrantFiled: December 31, 2019Date of Patent: May 4, 2021Assignee: Lyft, Inc.Inventors: Clemens Marschner, Thomas Schiwietz, Wilhelm Richert, Nikolai Morin, Holger Rapp
-
Publication number: 20200257900Abstract: Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.Type: ApplicationFiled: February 8, 2019Publication date: August 13, 2020Applicant: Lyft, Inc.Inventors: Patrick Dubroy, Wolfgang Hess, Clemens Marschner, Emil Praun, Holger Rapp, Thomas Schiwietz, Vinay Shet
-
Patent number: 8125480Abstract: A GPU accelerated volume rendering method from flat textures (also known as texture atlas) is disclosed. The method is not restricted to a specific rendering technique. The method is fast as it requires no reordering or copying passes. An image processing system is also provided. Addressing of two dimensional flat textures is accomplished based on the viewing direction. A first addressing scheme is used for the x direction, a second addressing scheme is used for the y direction and a third addressing scheme is used for the z direction, where x, y, and z refer to the axes of Cartesian coordinate system.Type: GrantFiled: April 10, 2006Date of Patent: February 28, 2012Assignee: Siemens Medical Solutions USA, Inc.Inventors: Thomas Schiwietz, Shmuel Aharon
-
Patent number: 7961945Abstract: A method for on-the-fly segmentations for image deformations, includes: selecting an object in an image that is displayed on a computer screen; immediately after selecting the object, automatically segmenting the object to find a boundary of the object and marking an area inside the boundary undeformable and an area outside the boundary deformable; and dragging the object to a desired location in the image while the area inside the boundary remains stiff and the area outside the boundary deforms.Type: GrantFiled: October 17, 2007Date of Patent: June 14, 2011Assignee: Technische Universität MünchenInventors: Thomas Schiwietz, Joachim Georgii, Rudiger Westermann
-
Patent number: 7952595Abstract: A method for deforming an image using a physical model includes inputting the image, discrediting the image into a grid, applying forces to the grid upon receiving an input command for dragging the grid, updating a mesh deformation of the grid according to the forces, and wrapping the image according to a deformed mesh to produce a deformed image, wherein a wrapped image is displayed on an display device.Type: GrantFiled: October 17, 2007Date of Patent: May 31, 2011Assignee: Technische Universität MünchenInventors: Thomas Schiwietz, Joachim Georgii, Rudiger Westermann