Patents by Inventor Zhaoyin Jia
Zhaoyin Jia has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11880758Abstract: Disclosed herein are neural networks for generating target classifications for an object from a set of input sequences. Each input sequence includes a respective input at each of multiple time steps, and each input sequence corresponds to a different sensing subsystem of multiple sensing subsystems. For each time step in the multiple time steps and for each input sequence in the set of input sequences, a respective feature representation is generated for the input sequence by processing the respective input from the input sequence at the time step using a respective encoder recurrent neural network (RNN) subsystem for the sensing subsystem that corresponds to the input sequence. For each time step in at least a subset of the multiple time steps, the respective feature representations are processed using a classification neural network subsystem to select a respective target classification for the object at the time step.Type: GrantFiled: August 2, 2021Date of Patent: January 23, 2024Assignee: Waymo LLCInventors: Congcong Li, Ury Zhilinsky, Yun Jiang, Zhaoyin Jia
-
Patent number: 11720799Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating object detection predictions from a neural network. In some implementations, an input characterizing a first region of an environment is obtained. The input includes a projected laser image generated from a three-dimensional laser sensor reading of the first region, a camera image patch generated from a camera image of the first region, and a feature vector of features characterizing the first region. The input is processed using a high precision object detection neural network to generate a respective object score for each object category in a first set of one or more object categories. Each object score represents a respective likelihood that an object belonging to the object category is located in the first region of the environment.Type: GrantFiled: August 19, 2021Date of Patent: August 8, 2023Assignee: Waymo LLCInventors: Zhaoyin Jia, Ury Zhilinsky, Yun Jiang, Yimeng Zhang
-
Publication number: 20230204738Abstract: Autonomous Vehicles (AVs) can navigate roadways without a human driver by using sensors, such as Lidar sensors, positioned around the AV. Systems, apparatuses, methods, computer readable medium, and circuits are provided for emulating a Lidar point cloud of an evaluation Lidar to be evaluated by transforming historical data received from a reference Lidar in order to determine a performance difference between the evaluation Lidar and the reference Lidar.Type: ApplicationFiled: December 27, 2021Publication date: June 29, 2023Inventors: Sandeep Gangundi, Pulkit Budhiraja, Zhaoyin Jia
-
Publication number: 20210383139Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating object detection predictions from a neural network. In some implementations, an input characterizing a first region of an environment is obtained. The input includes a projected laser image generated from a three-dimensional laser sensor reading of the first region, a camera image patch generated from a camera image of the first region, and a feature vector of features characterizing the first region. The input is processed using a high precision object detection neural network to generate a respective object score for each object category in a first set of one or more object categories. Each object score represents a respective likelihood that an object belonging to the object category is located in the first region of the environment.Type: ApplicationFiled: August 19, 2021Publication date: December 9, 2021Inventors: Zhaoyin Jia, Ury Zhilinsky, Yun Jiang, Yimeng Zhang
-
Patent number: 11113548Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating object detection predictions from a neural network. In some implementations, an input characterizing a first region of an environment is obtained. The input includes a projected laser image generated from a three-dimensional laser sensor reading of the first region, a camera image patch generated from a camera image of the first region, and a feature vector of features characterizing the first region. The input is processed using a high precision object detection neural network to generate a respective object score for each object category in a first set of one or more object categories. Each object score represents a respective likelihood that an object belonging to the object category is located in the first region of the environment.Type: GrantFiled: June 10, 2019Date of Patent: September 7, 2021Assignee: Waymo LLCInventors: Zhaoyin Jia, Ury Zhilinsky, Yun Jiang, Yimeng Zhang
-
Patent number: 11093819Abstract: Disclosed herein are neural networks for generating target classifications for an object from a set of input sequences. Each input sequence includes a respective input at each of multiple time steps, and each input sequence corresponds to a different sensing subsystem of multiple sensing subsystems. For each time step in the multiple time steps and for each input sequence in the set of input sequences, a respective feature representation is generated for the input sequence by processing the respective input from the input sequence at the time step using a respective encoder recurrent neural network (RNN) subsystem for the sensing subsystem that corresponds to the input sequence. For each time step in at least a subset of the multiple time steps, the respective feature representations are processed using a classification neural network subsystem to select a respective target classification for the object at the time step.Type: GrantFiled: December 16, 2016Date of Patent: August 17, 2021Assignee: Waymo LLCInventors: Congcong Li, Ury Zhilinsky, Yun Jiang, Zhaoyin Jia
-
Publication number: 20190294896Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating object detection predictions from a neural network. In some implementations, an input characterizing a first region of an environment is obtained. The input includes a projected laser image generated from a three-dimensional laser sensor reading of the first region, a camera image patch generated from a camera image of the first region, and a feature vector of features characterizing the first region. The input is processed using a high precision object detection neural network to generate a respective object score for each object category in a first set of one or more object categories. Each object score represents a respective likelihood that an object belonging to the object category is located in the first region of the environment.Type: ApplicationFiled: June 10, 2019Publication date: September 26, 2019Inventors: Zhaoyin Jia, Ury Zhilinsky, Yun Jiang, Yimeng Zhang
-
Patent number: 10318827Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating object detection predictions from a neural network. In some implementations, an input characterizing a first region of an environment is obtained. The input includes a projected laser image generated from a three-dimensional laser sensor reading of the first region, a camera image patch generated from a camera image of the first region, and a feature vector of features characterizing the first region. The input is processed using a high precision object detection neural network to generate a respective object score for each object category in a first set of one or more object categories. Each object score represents a respective likelihood that an object belonging to the object category is located in the first region of the environment.Type: GrantFiled: December 19, 2016Date of Patent: June 11, 2019Assignee: Waymo LLCInventors: Zhaoyin Jia, Ury Zhilinsky, Yun Jiang, Yimeng Zhang
-
Publication number: 20180173971Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating object detection predictions from a neural network. In some implementations, an input characterizing a first region of an environment is obtained. The input includes a projected laser image generated from a three-dimensional laser sensor reading of the first region, a camera image patch generated from a camera image of the first region, and a feature vector of features characterizing the first region. The input is processed using a high precision object detection neural network to generate a respective object score for each object category in a first set of one or more object categories. Each object score represents a respective likelihood that an object belonging to the object category is located in the first region of the environment.Type: ApplicationFiled: December 19, 2016Publication date: June 21, 2018Inventors: Zhaoyin Jia, Ury Zhilinsky, Yun Jiang, Yimeng Zhang