Patents by Inventor Michael Happold
Michael Happold has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230289999Abstract: Methods and systems for jointly estimating a pose and a shape of an object perceived by an autonomous vehicle are described. The system includes data and program code collectively defining a neural network which has been trained to jointly estimate a pose and a shape of a plurality of objects from incomplete point cloud data. The neural network includes a trained shared encoder neural network, a trained pose decoder neural network, and a trained shape decoder neural network. The method includes receiving an incomplete point cloud representation of an object, inputting the point cloud data into the trained shared encoder, outputting a code representative of the point cloud data. The method also includes generating an estimated pose and shape of the object based on the code. The pose includes at least a heading or a translation and the shape includes a denser point cloud representation of the object.Type: ApplicationFiled: May 17, 2023Publication date: September 14, 2023Inventors: Hunter Goforth, Xiaoyan Hu, Michael Happold
-
Publication number: 20230273976Abstract: Systems and methods for object detection. The methods include, by a computing device: obtaining a plurality of intensity values denoting at least a difference in a first location of at least one object in a first image and a second location of the at least one object in a second image; converting the intensity values to 3D position values; inputting the 3D position values into a classifier algorithm to obtain classifications for data points of a 3D point cloud (each of the classifications comprising a foreground classification or a background classification); and using the classifications to detect at least one object which is located in a foreground or a background.Type: ApplicationFiled: May 3, 2023Publication date: August 31, 2023Inventors: Xiaoyan Hu, Lingyuan Wang, Michael Happold, Jason Ziglar
-
Patent number: 11694356Abstract: Methods and systems for jointly estimating a pose and a shape of an object perceived by an autonomous vehicle are described. The system includes data and program code collectively defining a neural network which has been trained to jointly estimate a pose and a shape of a plurality of objects from incomplete point cloud data. The neural network includes a trained shared encoder neural network, a trained pose decoder neural network, and a trained shape decoder neural network. The method includes receiving an incomplete point cloud representation of an object, inputting the point cloud data into the trained shared encoder, outputting a code representative of the point cloud data. The method also includes generating an estimated pose and shape of the object based on the code. The pose includes at least a heading or a translation and the shape includes a denser point cloud representation of the object.Type: GrantFiled: May 28, 2020Date of Patent: July 4, 2023Assignee: ARGO AI, LLCInventors: Hunter Goforth, Xiaoyan Hu, Michael Happold
-
Patent number: 11669972Abstract: A system detects multiple instances of an object in a digital image by receiving a two-dimensional (2D) image that includes a plurality of instances of an object in an environment. For example, the system may receive the 2D image from a camera or other sensing modality of an autonomous vehicle (AV). The system uses a first object detection network to generate a plurality of predicted object instances in the image. The system then receives a data set that comprises depth information corresponding to the plurality of instances of the object in the environment. The data set may be received, for example, from a stereo camera of an AV, and the depth information may be in the form of a disparity map. The system may use the depth information to identify an individual instance from the plurality of predicted object instances in the image.Type: GrantFiled: August 9, 2021Date of Patent: June 6, 2023Assignee: Argo AI, LLCInventors: Xiaoyan Hu, Michael Happold, Cho-Ying Wu
-
Patent number: 11651553Abstract: A method and a system for generating a mesh representation of a surface. The method includes receiving a three-dimensional (3D) point cloud representing the surface, generating a reconstruction dataset having a higher resolution than the 3D point cloud in one or more regions corresponding to the surface from the 3D point cloud, and generate a polygon mesh representation of the surface by using a fine-to-coarse hash map for building polygons at a highest resolution first followed by progressively coarser resolution polygons, using the reconstruction dataset.Type: GrantFiled: September 24, 2021Date of Patent: May 16, 2023Assignee: argo ai, llcInventors: Xiaoyan Hu, Michael Happold, Joshua Max Manela, Guy Hotson
-
Patent number: 11645364Abstract: Systems and methods for object detection. The methods comprise, by a computing device: obtaining a plurality of intensity values denoting at least a difference in a first location of at least one object in a first image and a second location of the at least one object in a second image; converting the intensity values to 3D position values; inputting the 3D position values into a classifier algorithm to obtain classifications for data points of a 3D point cloud (each of the classifications comprising a foreground classification or a background classification); and using the classifications to detect at least one object which is located in a foreground or a background.Type: GrantFiled: August 2, 2022Date of Patent: May 9, 2023Inventors: Xiaoyan Hu, Lingyuan Wang, Michael Happold, Jason Ziglar
-
Publication number: 20230030815Abstract: Systems and methods for complementary control of an autonomous vehicle are disclosed. A primary controller provides a first plurality of instructions to an AV platform for operating the AV in an autonomous mode along a planned path based on sensor data from a primary sensor system and a secondary sensor system, and provides information that includes a fallback monitoring region to a complementary controller. The complementary controller receives sensor data from the secondary sensor system that includes sensed data for a fallback monitoring region, analyzes the received sensor data to determine whether a collision is imminent with an object detected in the fallback monitoring region, and cause the AV platform to initiate a collision mitigation action if a collision is determined to be imminent.Type: ApplicationFiled: July 29, 2021Publication date: February 2, 2023Inventors: Michael Happold, Ryan Skaff, Derek Hartl
-
Publication number: 20220374659Abstract: Systems and methods for object detection. The methods comprise, by a computing device: obtaining a plurality of intensity values denoting at least a difference in a first location of at least one object in a first image and a second location of the at least one object in a second image; converting the intensity values to 3D position values; inputting the 3D position values into a classifier algorithm to obtain classifications for data points of a 3D point cloud (each of the classifications comprising a foreground classification or a background classification); and using the classifications to detect at least one object which is located in a foreground or a background.Type: ApplicationFiled: August 2, 2022Publication date: November 24, 2022Inventors: Xiaoyan Hu, Lingyuan Wang, Michael Happold, Jason Ziglar
-
Patent number: 11443147Abstract: Systems and methods for operating a vehicle. The methods comprise, by a processor: obtaining a pair of stereo images captured by a stereo camera; processing the pair of stereo images to generate a disparity map comprising a plurality of pixels defined by intensity values; converting each intensity value to a 3D position in a map (each 3D position defining a location of a data point in a point cloud); performing a hierarchical decision tree classification to determine a classification for each data point in the point cloud (the classification being a foreground classification or a background classification); and using the classifications to facilitate autonomous control of the vehicle.Type: GrantFiled: December 11, 2020Date of Patent: September 13, 2022Assignee: Argo AI, LLCInventors: Xiaoyan Hu, Lingyuan Wang, Michael Happold, Jason Ziglar
-
Publication number: 20220188578Abstract: Systems and methods for operating a vehicle. The methods comprise, by a processor: obtaining a pair of stereo images captured by a stereo camera; processing the pair of stereo images to generate a disparity map comprising a plurality of pixels defined by intensity values; converting each intensity value to a 3D position in a map (each 3D position defining a location of a data point in a point cloud); performing a hierarchical decision tree classification to determine a classification for each data point in the point cloud (the classification being a foreground classification or a background classification); and using the classifications to facilitate autonomous control of the vehicle.Type: ApplicationFiled: December 11, 2020Publication date: June 16, 2022Inventors: Xiaoyan Hu, Lingyuan Wang, Michael Happold, Jason Ziglar
-
Publication number: 20220012942Abstract: A method and a system for generating a mesh representation of a surface. The method includes receiving a three-dimensional (3D) point cloud representing the surface, generating a reconstruction dataset having a higher resolution than the 3D point cloud in one or more regions corresponding to the surface from the 3D point cloud, and generate a polygon mesh representation of the surface by using a fine-to-coarse hash map for building polygons at a highest resolution first followed by progressively coarser resolution polygons, using the reconstruction dataset.Type: ApplicationFiled: September 24, 2021Publication date: January 13, 2022Inventors: Xiaoyan Hu, Michael Happold, Joshua Max Manela, Guy Hotson
-
Publication number: 20210365699Abstract: A system detects multiple instances of an object in a digital image by receiving a two-dimensional (2D) image that includes a plurality of instances of an object in an environment. For example, the system may receive the 2D image from a camera or other sensing modality of an autonomous vehicle (AV). The system uses a first object detection network to generate a plurality of predicted object instances in the image. The system then receives a data set that comprises depth information corresponding to the plurality of instances of the object in the environment. The data set may be received, for example, from a stereo camera of an AV, and the depth information may be in the form of a disparity map. The system may use the depth information to identify an individual instance from the plurality of predicted object instances in the image.Type: ApplicationFiled: August 9, 2021Publication date: November 25, 2021Applicant: Argo AI, LLCInventors: Xiaoyan Hu, Michael Happold, Cho-Ying Wu
-
Patent number: 11164369Abstract: A method and a system for generating a mesh representation of a surface. The method includes receiving a three-dimensional (3D) point cloud representing the surface, identifying and discarding one or more outliers in the 3D point cloud to generate a filtered point cloud using a Gaussian process, adding one or more additional points to the filtered point cloud to generate a reconstruction dataset, and using Poisson surface reconstruction to generate an implicit surface corresponding to the surface from the reconstruction dataset.Type: GrantFiled: December 20, 2019Date of Patent: November 2, 2021Assignee: Argo AI, LLCInventors: Xiaoyan Hu, Michael Happold, Joshua Max Manela, Guy Hotson
-
Patent number: 11120280Abstract: A system detects multiple instances of an object in a digital image by receiving a two-dimensional (2D) image that includes a plurality of instances of an object in an environment. For example, the system may receive the 2D image from a camera or other sensing modality of an autonomous vehicle (AV). The system uses a first object detection network to generate a plurality of predicted object instances in the image. The system then receives a data set that comprises depth information corresponding to the plurality of instances of the object in the environment. The data set may be received, for example, from a stereo camera of an AV, and the depth information may be in the form of a disparity map. The system may use the depth information to identify an individual instance from the plurality of predicted object instances in the image.Type: GrantFiled: February 27, 2020Date of Patent: September 14, 2021Assignee: Argo AI, LLCInventors: Xiaoyan Hu, Michael Happold, Cho-Ying Wu
-
Publication number: 20210192841Abstract: A method and a system for generating a mesh representation of a surface. The method includes receiving a three-dimensional (3D) point cloud representing the surface, identifying and discarding one or more outliers in the 3D point cloud to generate a filtered point cloud using a Gaussian process, adding one or more additional points to the filtered point cloud to generate a reconstruction dataset, and using Poisson surface reconstruction to generate an implicit surface corresponding to the surface from the reconstruction dataset.Type: ApplicationFiled: December 20, 2019Publication date: June 24, 2021Inventors: Xiaoyan Hu, Michael Happold, Joshua Max Manela, Guy Hotson
-
Publication number: 20210150228Abstract: Methods and systems for jointly estimating a pose and a shape of an object perceived by an autonomous vehicle are described. The system includes data and program code collectively defining a neural network which has been trained to jointly estimate a pose and a shape of a plurality of objects from incomplete point cloud data. The neural network includes a trained shared encoder neural network, a trained pose decoder neural network, and a trained shape decoder neural network. The method includes receiving an incomplete point cloud representation of an object, inputting the point cloud data into the trained shared encoder, outputting a code representative of the point cloud data. The method also includes generating an estimated pose and shape of the object based on the code. The pose includes at least a heading or a translation and the shape includes a denser point cloud representation of the object.Type: ApplicationFiled: May 28, 2020Publication date: May 20, 2021Inventors: Hunter Goforth, Xiaoyan Hu, Michael Happold
-
Publication number: 20210150227Abstract: A system detects multiple instances of an object in a digital image by receiving a two-dimensional (2D) image that includes a plurality of instances of an object in an environment. For example, the system may receive the 2D image from a camera or other sensing modality of an autonomous vehicle (AV). The system uses a first object detection network to generate a plurality of predicted object instances in the image. The system then receives a data set that comprises depth information corresponding to the plurality of instances of the object in the environment. The data set may be received, for example, from a stereo camera of an AV, and the depth information may be in the form of a disparity map. The system may use the depth information to identify an individual instance from the plurality of predicted object instances in the image.Type: ApplicationFiled: February 27, 2020Publication date: May 20, 2021Inventors: Xiaoyan Hu, Michael Happold, Cho-Ying Wu
-
Patent number: 10264431Abstract: A short range peer-to-peer communications system includes a first perception sensor and a first peer-to-peer communications system on a first machine and a second perception sensor and a second peer-to-peer communications system on a second machine. A first controller generates a first electronic map of a first perceived work environment associated with the first machine and transmits first data associated with first electronic map to the second machine through the first peer-to-peer communications system. A second controller generates a second electronic map of the second perceived work environment associated with the second machine based upon the plurality of second raw data points, receives the first data from the first machine through the second peer-to-peer communications system, and supplements the second electronic map based upon the first data.Type: GrantFiled: February 1, 2016Date of Patent: April 16, 2019Assignee: Caterpillar Inc.Inventors: Nicolas Vandapel, Michael Happold
-
Publication number: 20170220009Abstract: A short range peer-to-peer communications system includes a first perception sensor and a first peer-to-peer communications system on a first machine and a second perception sensor and a second peer-to-peer communications system on a second machine. A first controller generates a first electronic map of a first perceived work environment associated with the first machine and transmits first data associated with first electronic map to the second machine through the first peer-to-peer communications system. A second controller generates a second electronic map of the second perceived work environment associated with the second machine based upon the plurality of second raw data points, receives the first data from the first machine through the second peer-to-peer communications system, and supplements the second electronic map based upon the first data.Type: ApplicationFiled: February 1, 2016Publication date: August 3, 2017Applicant: Caterpillar Inc.Inventors: Nicolas Vandapel, Michael Happold
-
Patent number: 6336051Abstract: An agricultural harvesting machine (harvester) is automatically controlled and steered so as to completely harvest all crop in a field. A Global Positioning System (GPS) and an Inertial Navigation System provide data regarding the position and orientation of the harvester in a field. A Field Coverage Planner constructs a field coverage plan which defines a path for the harvester to follow in cutting crop from a field. Video images of the field in front of the harvester are derived alternately from two video cameras mounted on opposite sides of the harvester. The video images are processed in a Video Processing Computer to detect the crop line between cut and uncut crop and generate steering signals for steering the harvester along the crop line. Video images are also processed to detect the end of a row at the end of a field and supply a measure of the distance to the end of the row.Type: GrantFiled: August 28, 2000Date of Patent: January 1, 2002Assignee: Carnegie Mellon UniversityInventors: Henning Pangels, Thomas Pilarski, Kerien Fitzpatrick, Michael Happold, Mark Ollis, William Whittaker, Anthony Stentz