Patents by Inventor Derik SCHROETER
Derik SCHROETER has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11927449Abstract: According to an aspect of an embodiment, operations may comprise receiving an approximate geographic location of a vehicle, accessing a map of a region within which the approximate geographic location of the vehicle is located, identifying a first region on the map within a first threshold distance of the approximate geographic location of the vehicle, identifying a second region on the map associated with one or more roads on the map, determining a search space on the map within which the vehicle is likely to be present, the search space representing an intersection of the first region and the second region, and determining a more accurate geographic location of the vehicle by performing a search within the search space.Type: GrantFiled: June 10, 2020Date of Patent: March 12, 2024Assignee: NVIDIA CORPORATIONInventors: Derik Schroeter, Di Zeng, Mark Damon Wheeler
-
Patent number: 11867515Abstract: According to an aspect of an embodiment, operations may comprise accessing a set of vehicle poses of one or more vehicles; for each of the set of vehicle poses, accessing a high definition (HD) map of a geographical region surrounding the vehicle pose, with the HD map comprising a three-dimensional (3D) representation of the geographical region, determining a measure of constrainedness for the vehicle pose, with the measure of constrainedness representing a confidence for performing localization for the vehicle pose based on 3D structures surrounding the vehicle pose, and storing the measure of constrainedness for the vehicle pose; and for each of the geographical regions surrounding each of the set of vehicle poses, determining a measure of constrainedness for the geographical region based on measures of constrainedness of vehicle poses within the geographical region, and storing the measure of constrainedness for the geographical region.Type: GrantFiled: July 19, 2022Date of Patent: January 9, 2024Assignee: NVIDIA CORPORATIONInventors: Di Zeng, Mengxi Wu, Derik Schroeter
-
Publication number: 20230204784Abstract: According to an aspect of an embodiment, operations may comprise receiving, from a LIDAR mounted on a vehicle, a first 3D point cloud comprising points of a region around the vehicle as observed by the LIDAR. The operations may also comprise accessing an HD map comprising a second 3D point cloud comprising points of the region around the vehicle. The operations may also comprise segmenting LIDAR ground points from LIDAR non-ground points in the first 3D point cloud. The operations may also comprise segmenting map ground points from map non-ground points in the second 3D point cloud. The operations may also comprise determining a pose of the vehicle by matching the LIDAR ground points to the map ground points and by matching the LIDAR non-ground points to the map non-ground points.Type: ApplicationFiled: February 28, 2023Publication date: June 29, 2023Inventors: Di Zeng, Derik Schroeter, Mengxi Wu
-
Patent number: 11675083Abstract: An autonomous vehicle system removes ephemeral points from lidar samples. The system receives a plurality of light detection and ranging (lidar) samples captured by a lidar sensor. Along with the lidar samples, the system receives an aligned pose and an unwinding transform for each of the lidar samples. The system determines one or more occupied voxel cells in a three-dimensional (3D) space using the lidar samples, their aligned poses, and their unwinding transforms. The system identifies occupied voxel cells representative of noise associated with motion of an object relative to the lidar sensor. The system filters the occupied voxel cells by removing the cells representative of noise. The system inputs the filtered occupied voxel cells in a 3D map comprising voxel cells, e.g., during the map generation and/or a map update.Type: GrantFiled: January 2, 2020Date of Patent: June 13, 2023Assignee: NVIDIA CORPORATIONInventors: Chen Chen, Liang Zou, Derik Schroeter, Mark Damon Wheeler
-
Publication number: 20230121226Abstract: According to one or more embodiments, operations may comprise obtaining a first point cloud. The operations also comprise performing segmentation of the first point cloud, the segmentation generating one or more clusters of points of the point cloud. The operations also comprise determining, for each respective cluster of the plurality of clusters, a respective geometric feature of a corresponding object that corresponds to the respective cluster. The operations also comprise obtaining a second point cloud. The operations also comprise assigning a plurality of weights that comprises assigning a respective weight to each respective cluster based on the respective geometric feature that corresponds to the respective cluster. The operations also comprise obtaining a second point cloud and aligning the first point cloud with the second point cloud based on the plurality of weights.Type: ApplicationFiled: November 21, 2022Publication date: April 20, 2023Inventor: Derik Schroeter
-
Patent number: 11598876Abstract: According to an aspect of an embodiment, operations may comprise receiving, from a LIDAR mounted on a vehicle, a first 3D point cloud comprising points of a region around the vehicle as observed by the LIDAR. The operations may also comprise accessing an HD map comprising a second 3D point cloud comprising points of the region around the vehicle. The operations may also comprise segmenting LIDAR ground points from LIDAR non-ground points in the first 3D point cloud. The operations may also comprise segmenting map ground points from map non-ground points in the second 3D point cloud. The operations may also comprise determining a pose of the vehicle by matching the LIDAR ground points to the map ground points and by matching the LIDAR non-ground points to the map non-ground points.Type: GrantFiled: June 15, 2020Date of Patent: March 7, 2023Assignee: NVIDIA CORPORATIONInventors: Di Zeng, Derik Schroeter, Mengxi Wu
-
Publication number: 20230043182Abstract: According to an aspect of an embodiment, operations may comprise receiving a search query for points near a query-point, accessing a compressed octree representation of a point cloud comprising 3D points of a region, and traversing the compressed octree representation to identify regions that overlap a search space by, marking a current node as overlapping the search space responsive to determining that the current node is a leaf node, identifying a child node of the current node and performing a nearest neighbor search in the child node responsive to determining that a region represented by the current node overlaps the search space, and identifying a sibling node of the current node and performing the nearest neighbor search in the sibling node responsive to determining that a region represented by the current node does not overlap the search space.Type: ApplicationFiled: October 3, 2022Publication date: February 9, 2023Inventor: Derik Schroeter
-
Publication number: 20230018923Abstract: Operations may comprise obtaining a plurality of light detection and ranging (LIDAR) scans of a region. The operations may also comprise identifying a plurality of LIDAR poses that correspond to the plurality of LIDAR scans. In addition, the operations may comprise identifying, as a plurality of keyframes, a plurality of images of the region that are captured during capturing of the plurality of LIDAR scans. The operations may also comprise determining, based on the plurality of LIDAR poses, a plurality of camera poses that correspond to the keyframes. Further, the operations may comprise identifying a plurality of two-dimensional (2D) keypoints in the keyframes. The operations also may comprise generating one or more three-dimensional (3D) keypoints based on the plurality of 2D keypoints and the respective camera poses of the plurality of keyframes.Type: ApplicationFiled: June 21, 2022Publication date: January 19, 2023Inventors: Ronghua Zhang, Derik Schroeter, Mengxi Wu, Di Zeng
-
Publication number: 20230017502Abstract: According to an aspect of an embodiment, operations may comprise for each of the set of geographic X-positions, accessing an HD map of a geographical region surrounding the geographic X-position, determining a convergence range for the geographic X-position, and storing the convergence range for the geographic X-position in the HD map. The operations may also comprise accessing the HD map, predicting a next geographic X-position of a target vehicle, predicting a covariance of the predicted next geographic X-position, accessing the convergence range for the geographic X-position in the HD map closest to the predicted next geographic X-position, estimating a current geographic X-position of the target vehicle by performing a localization algorithm, and determining a confidence value for the estimated current geographic X-position of the target vehicle based on the predicted next geographic X-position, the predicted covariance, and the accessed convergence range.Type: ApplicationFiled: May 23, 2022Publication date: January 19, 2023Inventors: Mark Wheeler, Derik Schroeter
-
Patent number: 11514682Abstract: According to one or more embodiments, operations may comprise obtaining a first point cloud. The operations also comprise performing segmentation of the first point cloud, the segmentation generating one or more clusters of points of the point cloud. The operations also comprise determining, for each respective cluster of the plurality of clusters, a respective geometric feature of a corresponding object that corresponds to the respective cluster. The operations also comprise obtaining a second point cloud. The operations also comprise assigning a plurality of weights that comprises assigning a respective weight to each respective cluster based on the respective geometric feature that corresponds to the respective cluster. The operations also comprise obtaining a second point cloud and aligning the first point cloud with the second point cloud based on the plurality of weights.Type: GrantFiled: June 24, 2020Date of Patent: November 29, 2022Assignee: NVIDIA CORPORATIONInventor: Derik Schroeter
-
Publication number: 20220373337Abstract: According to an aspect of an embodiment, operations may comprise accessing a set of vehicle poses of one or more vehicles; for each of the set of vehicle poses, accessing a high definition (HD) map of a geographical region surrounding the vehicle pose, with the HD map comprising a three-dimensional (3D) representation of the geographical region, determining a measure of constrainedness for the vehicle pose, with the measure of constrainedness representing a confidence for performing localization for the vehicle pose based on 3D structures surrounding the vehicle pose, and storing the measure of constrainedness for the vehicle pose; and for each of the geographical regions surrounding each of the set of vehicle poses, determining a measure of constrainedness for the geographical region based on measures of constrainedness of vehicle poses within the geographical region, and storing the measure of constrainedness for the geographical region.Type: ApplicationFiled: July 19, 2022Publication date: November 24, 2022Inventors: Di Zeng, Mengxi Wu, Derik Schroeter
-
Patent number: 11460580Abstract: According to an aspect of an embodiment, operations may comprise receiving a search query for points near a query-point, accessing a compressed octree representation of a point cloud comprising 3D points of a region, and traversing the compressed octree representation to identify regions that overlap a search space by, marking a current node as overlapping the search space responsive to determining that the current node is a leaf node, identifying a child node of the current node and performing a nearest neighbor search in the child node responsive to determining that a region represented by the current node overlaps the search space, and identifying a sibling node of the current node and performing the nearest neighbor search in the sibling node responsive to determining that a region represented by the current node does not overlap the search space.Type: GrantFiled: June 17, 2020Date of Patent: October 4, 2022Assignee: NVIDIA CORPORATIONInventor: Derik Schroeter
-
Patent number: 11391578Abstract: According to an aspect of an embodiment, operations may comprise accessing a set of vehicle poses of one or more vehicles; for each of the set of vehicle poses, accessing a high definition (HD) map of a geographical region surrounding the vehicle pose, with the HD map comprising a three-dimensional (3D) representation of the geographical region, determining a measure of constrainedness for the vehicle pose, with the measure of constrainedness representing a confidence for performing localization for the vehicle pose based on 3D structures surrounding the vehicle pose, and storing the measure of constrainedness for the vehicle pose; and for each of the geographical regions surrounding each of the set of vehicle poses, determining a measure of constrainedness for the geographical region based on measures of constrainedness of vehicle poses within the geographical region, and storing the measure of constrainedness for the geographical region.Type: GrantFiled: July 2, 2020Date of Patent: July 19, 2022Assignee: NVIDIA CORPORATIONInventors: Di Zeng, Mengxi Wu, Derik Schroeter
-
Patent number: 11367208Abstract: Operations may comprise obtaining a plurality of light detection and ranging (LIDAR) scans of a region. The operations may also comprise identifying a plurality of LIDAR poses that correspond to the plurality of LIDAR scans. In addition, the operations may comprise identifying, as a plurality of keyframes, a plurality of images of the region that are captured during capturing of the plurality of LIDAR scans. The operations may also comprise determining, based on the plurality of LIDAR poses, a plurality of camera poses that correspond to the keyframes. Further, the operations may comprise identifying a plurality of two-dimensional (2D) keypoints in the keyframes. The operations also may comprise generating one or more three-dimensional (3D) keypoints based on the plurality of 2D keypoints and the respective camera poses of the plurality of keyframes.Type: GrantFiled: June 25, 2020Date of Patent: June 21, 2022Assignee: NVIDIA CORPORATIONInventors: Ronghua Zhang, Derik Schroeter, Mengxi Wu, Di Zeng
-
Patent number: 11353589Abstract: A system align point clouds obtained by sensors of a vehicle using kinematic iterative closest point with integrated motions estimates. The system receives lidar scans from a lidar mounted on the vehicle. The system derives point clouds from the lidar scan data. The system iteratively determines velocity parameters that minimize an aggregate measure of distance between corresponding points of the plurality of pairs of points. The system iteratively improves the velocity parameters. The system uses the velocity parameters for various purposes including for building high definition maps used for navigating the vehicle.Type: GrantFiled: November 16, 2018Date of Patent: June 7, 2022Assignee: NVIDIA CORPORATIONInventors: Gregory William Coombe, Chen Chen, Derik Schroeter, Jeffrey Minoru Adachi, Mark Damon Wheeler
-
Patent number: 11340082Abstract: According to an aspect of an embodiment, operations may comprise for each of the set of geographic X-positions, accessing an HD map of a geographical region surrounding the geographic X-position, determining a convergence range for the geographic X-position, and storing the convergence range for the geographic X-position in the HD map. The operations may also comprise accessing the HD map, predicting a next geographic X-position of a target vehicle, predicting a covariance of the predicted next geographic X-position, accessing the convergence range for the geographic X-position in the HD map closest to the predicted next geographic X-position, estimating a current geographic X-position of the target vehicle by performing a localization algorithm, and determining a confidence value for the estimated current geographic X-position of the target vehicle based on the predicted next geographic X-position, the predicted covariance, and the accessed convergence range.Type: GrantFiled: July 2, 2020Date of Patent: May 24, 2022Assignee: NVIDIA CORPORATIONInventors: Mark Wheeler, Derik Schroeter
-
Patent number: 11151394Abstract: Operations may comprise obtaining a first point cloud from a map representing a region. The operations may also include obtaining a second point cloud from one or more sensors of a vehicle traveling through the region. In addition, the operations may include identifying one or more subsets of clusters of second points of the second point cloud. The operations may also include determining correspondences between first points of the first point cloud and cluster points of the one or more subsets of clusters of the second point cloud. Moreover, the operations may include identifying at least a cluster of the one or more subsets of clusters, the identified cluster having, with respect to first points of the first point cloud, a correspondence percentage that is less than a threshold value. The operations may also include adjusting the second point cloud based on the identified cluster.Type: GrantFiled: June 24, 2020Date of Patent: October 19, 2021Assignee: NVIDIA CORPORATIONInventor: Derik Schroeter
-
Publication number: 20210003403Abstract: According to an aspect of an embodiment, operations may comprise for each of the set of geographic X-positions, accessing an HD map of a geographical region surrounding the geographic X-position, determining a convergence range for the geographic X-position, and storing the convergence range for the geographic X-position in the HD map. The operations may also comprise accessing the HD map, predicting a next geographic X-position of a target vehicle, predicting a covariance of the predicted next geographic X-position, accessing the convergence range for the geographic X-position in the HD map closest to the predicted next geographic X-position, estimating a current geographic X-position of the target vehicle by performing a localization algorithm, and determining a confidence value for the estimated current geographic X-position of the target vehicle based on the predicted next geographic X-position, the predicted covariance, and the accessed convergence range.Type: ApplicationFiled: July 2, 2020Publication date: January 7, 2021Inventors: Mark Wheeler, Derik Schroeter
-
Publication number: 20210003404Abstract: According to an aspect of an embodiment, operations may comprise accessing a set of vehicle poses of one or more vehicles; for each of the set of vehicle poses, accessing a high definition (HD) map of a geographical region surrounding the vehicle pose, with the HD map comprising a three-dimensional (3D) representation of the geographical region, determining a measure of constrainedness for the vehicle pose, with the measure of constrainedness representing a confidence for performing localization for the vehicle pose based on 3D structures surrounding the vehicle pose, and storing the measure of constrainedness for the vehicle pose; and for each of the geographical regions surrounding each of the set of vehicle poses, determining a measure of constrainedness for the geographical region based on measures of constrainedness of vehicle poses within the geographical region, and storing the measure of constrainedness for the geographical region.Type: ApplicationFiled: July 2, 2020Publication date: January 7, 2021Inventors: Di Zeng, Mengxi Wu, Derik Schroeter
-
Publication number: 20200410702Abstract: Operations may comprise obtaining a plurality of light detection and ranging (LIDAR) scans of a region. The operations may also comprise identifying a plurality of LIDAR poses that correspond to the plurality of LIDAR scans. In addition, the operations may comprise identifying, as a plurality of keyframes, a plurality of images of the region that are captured during capturing of the plurality of LIDAR scans. The operations may also comprise determining, based on the plurality of LIDAR poses, a plurality of camera poses that correspond to the keyframes. Further, the operations may comprise identifying a plurality of two-dimensional (2D) keypoints in the keyframes. The operations also may comprise generating one or more three-dimensional (3D) keypoints based on the plurality of 2D keypoints and the respective camera poses of the plurality of keyframes.Type: ApplicationFiled: June 25, 2020Publication date: December 31, 2020Inventors: Ronghua Zhang, Derik Schroeter, Mengxi Wu, Di Zeng