Patents by Inventor Benjamin Isaac Zwiebel
Benjamin Isaac Zwiebel has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11802969Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.Type: GrantFiled: May 26, 2022Date of Patent: October 31, 2023Assignee: Zoox, Inc.Inventors: William Anthony Silva, Dragomir Dimitrov Anguelov, Benjamin Isaac Zwiebel, Juhana Kangaspunta
-
Patent number: 11710296Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.Type: GrantFiled: December 3, 2021Date of Patent: July 25, 2023Assignee: Zoox, Inc.Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
-
Publication number: 20230177804Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.Type: ApplicationFiled: December 3, 2021Publication date: June 8, 2023Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
-
Publication number: 20230174110Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.Type: ApplicationFiled: December 3, 2021Publication date: June 8, 2023Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
-
Publication number: 20230169777Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.Type: ApplicationFiled: November 30, 2021Publication date: June 1, 2023Inventors: Qian Song, Benjamin Isaac Zwiebel
-
Patent number: 11663726Abstract: Tracking a current and/or previous position, velocity, acceleration, and/or heading of an object using sensor data may comprise determining whether to associate a current object detection generated from recently received (e.g., current) sensor data with a previous object detection generated from formerly received sensor data. In other words, a track may identify that an object detected in former sensor data is the same object detected in current sensor data. However, multiple types of sensor data may be used to detect objects and some objects may not be detected by different sensor types or may be detected differently, which may confound attempts to track an object. An ML model may be trained to receive outputs associated with different sensor types and/or a track associated with an object, and determine a data structure comprising a region of interest, object classification, and/or a pose associated with the object.Type: GrantFiled: May 5, 2020Date of Patent: May 30, 2023Assignee: Zoox, Inc.Inventors: Subhasis Das, Kai Yu, Benjamin Isaac Zwiebel
-
Patent number: 11625041Abstract: Techniques are disclosed for a combined machine learned (ML) model that may generate a track confidence metric associated with a track and/or a classification of an object. Techniques may include obtaining a track. The track, which may include object detections from one or more sensor data types and/or pipelines, may be input into a machine-learning (ML) model. The model may output a track confidence metric and a classification. In some examples, if the track confidence metric does not satisfy a threshold, the ML model may cause the suppression of the output of the track to a planning component of an autonomous vehicle.Type: GrantFiled: February 21, 2020Date of Patent: April 11, 2023Assignee: Zoox, Inc.Inventors: Subhasis Das, Shida Shen, Kai Yu, Benjamin Isaac Zwiebel
-
Publication number: 20220350337Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.Type: ApplicationFiled: May 26, 2022Publication date: November 3, 2022Inventors: William Anthony Silva, Dragomir Dimitrov Anguelov, Benjamin Isaac Zwiebel, Juhana Kangaspunta
-
Patent number: 11347228Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.Type: GrantFiled: March 26, 2020Date of Patent: May 31, 2022Assignee: Zoox, Inc.Inventors: William Anthony Silva, Dragomir Dimitrov Anguelov, Benjamin Isaac Zwiebel, Juhana Kangaspunta
-
Publication number: 20210263525Abstract: Techniques are disclosed for a combined machine learned (ML) model that may generate a track confidence metric associated with a track and/or a classification of an object. Techniques may include obtaining a track. The track, which may include object detections from one or more sensor data types and/or pipelines, may be input into a machine-learning (ML) model. The model may output a track confidence metric and a classification. In some examples, if the track confidence metric does not satisfy a threshold, the ML model may cause the suppression of the output of the track to a planning component of an autonomous vehicle.Type: ApplicationFiled: February 21, 2020Publication date: August 26, 2021Inventors: Subhasis Das, Shida Shen, Kai Yu, Benjamin Isaac Zwiebel
-
Publication number: 20210237761Abstract: Tracking a current and/or previous position, velocity, acceleration, and/or heading of an object using sensor data may comprise determining whether to associate a current object detection generated from recently received (e.g., current) sensor data with a previous object detection generated from formerly received sensor data. In other words, a track may identify that an object detected in former sensor data is the same object detected in current sensor data. However, multiple types of sensor data may be used to detect objects and some objects may not be detected by different sensor types or may be detected differently, which may confound attempts to track an object. An ML model may be trained to receive outputs associated with different sensor types and/or a track associated with an object, and determine a data structure comprising a region of interest, object classification, and/or a pose associated with the object.Type: ApplicationFiled: May 5, 2020Publication date: August 5, 2021Inventors: Subhasis Das, Kai Yu, Benjamin Isaac Zwiebel
-
Patent number: 11048265Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.Type: GrantFiled: June 18, 2018Date of Patent: June 29, 2021Assignee: Zoox, Inc.Inventors: William Anthony Silva, Dragomir Dimitrov Anguelov, Benjamin Isaac Zwiebel, Juhana Kangaspunta
-
Publication number: 20210181758Abstract: Tracking a current and/or previous position, velocity, acceleration, and/or heading of an object using sensor data may comprise determining whether to associate a current object detection generated from recently received (e.g., current) sensor data with a previous object detection generated from formerly received sensor data. In other words, a track may identify that an object detected in former sensor data is the same object detected in current sensor data. However, multiple types of sensor data may be used to detect objects and some objects may not be detected by different sensor types or may be detected differently, which may confound attempts to track an object. An ML model may be trained to receive outputs associated with different sensor types and/or a track associated with an object, and determine a data structure comprising a region of interest, object classification, and/or a pose associated with the object.Type: ApplicationFiled: January 31, 2020Publication date: June 17, 2021Inventors: Subhasis Das, Benjamin Isaac Zwiebel, Kai Yu, James William Vaisey Philbin
-
Publication number: 20200225672Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.Type: ApplicationFiled: March 26, 2020Publication date: July 16, 2020Inventors: William Anthony Silva, Dragomir Dimitrov Anguelov, Benjamin Isaac Zwiebel, Juhana Kangaspunta
-
Patent number: 10642275Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.Type: GrantFiled: June 18, 2018Date of Patent: May 5, 2020Assignee: Zoox, Inc.Inventors: William Anthony Silva, Dragomir Dimitrov Anguelov, Benjamin Isaac Zwiebel, Juhana Kangaspunta
-
Publication number: 20190384302Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.Type: ApplicationFiled: June 18, 2018Publication date: December 19, 2019Inventors: William Anthony Silva, Dragomir Dimitrov Anguelov, Benjamin Isaac Zwiebel, Juhana Kangaspunta
-
Publication number: 20190384309Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.Type: ApplicationFiled: June 18, 2018Publication date: December 19, 2019Inventors: William Anthony Silva, Dragomir Dimitrov Anguelov, Benjamin Isaac Zwiebel, Juhana Kangaspunta