Abstract: In one embodiment, a lidar system includes a light source configured to emit pulses of light and a scanner configured to scan the emitted pulses of light along a high-resolution scan pattern located within a field of regard of the lidar system. The scanner includes one or more scan mirrors configured to (i) scan the emitted pulses of light along a first scan axis to produce multiple scan lines of the high-resolution scan pattern, where each scan line is associated with multiple pixels, each pixel corresponding to one of the emitted pulses of light and (ii) distribute the scan lines of the high-resolution scan pattern along a second scan axis. The high-resolution scan pattern includes one or more of: interlaced scan lines and interlaced pixels.

Abstract: First training sensor data detected by a plurality of real-world sensors are obtained. The first training sensor data is associated with physical environment conditions. Second training sensor data detected by a plurality of virtual sensors are obtained. The second training sensor data is associated with simulated physical conditions of a virtual environment. A machine learning model is trained using both real-world and virtual training datasets including the first training sensor data, the second training sensor data, and respective sensor setting parameters of the plurality of real-world sensors and the plurality of virtual sensors. The real-world and virtual training datasets used to train the machine learning model include indications associated with the respective sensor parameter settings including one or more of the following: different scan line settings or different exposure settings.

Abstract: To generate a machine learning model for controlling autonomous vehicles, training sensor data is obtained from sensors associated with one or more vehicles, the sensor data indicative of physical conditions of an environment in which the one or more vehicles operate, and a machine learning (ML) model is trained using the training sensor data. The ML model generates parameters of the environment in response to input sensor data. A controller in an autonomous vehicle receives sensor data from one or more sensors operating in the autonomous vehicle, applies the received sensor data to the ML model to obtain parameters of an environment in which the autonomous vehicle operates, provides the generated parameters to a motion planner component to generate decisions for controlling the autonomous vehicle, and causes the autonomous vehicle to maneuver in accordance with the generated decisions.

Abstract: An imaging sensor is configured to sense an environment through which a vehicle is moving. A method for controlling the imaging sensor includes receiving sensor data generated by the imaging sensor of the vehicle as the vehicle moves through the environment, determining (i) a lower bound for a vertical region of interest (VROI) within a vertical field of regard of the imaging sensor, the VROI comprising a virtual horizon, using a first subset of the sensor data, and (ii) an upper bound for the VROI within the vertical field of regard of the imaging sensor, using at least a second subset of the sensor data, where the first subset is smaller than the second subset. The method also includes causing the imaging sensor to be adjusted in accordance with the determined lower bound of the VROI and the determined upper bound of the VROI.

Abstract: In one embodiment, a lidar system includes a light source configured to emit pulses of light and a scanner configured to scan the emitted pulses of light along a high-resolution scan pattern located within a field of regard of the lidar system. The scanner includes one or more scan mirrors configured to (i) scan the emitted pulses of light along a first scan axis to produce multiple scan lines of the high-resolution scan pattern, where each scan line is associated with multiple pixels, each pixel corresponding to one of the emitted pulses of light and (ii) distribute the scan lines of the high-resolution scan pattern along a second scan axis. The high-resolution scan pattern includes one or more of: interlaced scan lines and interlaced pixels.

Abstract: In one embodiment, a lidar system includes a light source configured to emit pulses of light and a scanner configured to scan the emitted pulses of light along a high-resolution scan pattern located within a field of regard of the lidar system. The scanner includes one or more scan mirrors configured to (i) scan the emitted pulses of light along a first scan axis to produce multiple scan lines of the high-resolution scan pattern, where each scan line is associated with multiple pixels, each pixel corresponding to one of the emitted pulses of light and (ii) distribute the scan lines of the high-resolution scan pattern along a second scan axis. The high-resolution scan pattern includes one or more of: interlaced scan lines and interlaced pixels.

Abstract: In one embodiment, a lidar system includes a light source configured to emit pulses of light and a scanner configured to scan the emitted pulses of light along a high-resolution scan pattern located within a field of regard of the lidar system. The scanner includes one or more scan mirrors configured to (i) scan the emitted pulses of light along a first scan axis to produce multiple scan lines of the high-resolution scan pattern, where each scan line is associated with multiple pixels, each pixel corresponding to one of the emitted pulses of light and (ii) distribute the scan lines of the high-resolution scan pattern along a second scan axis. The high-resolution scan pattern includes one or more of: interlaced scan lines and interlaced pixels.

Abstract: An imaging sensor is configured to sense an environment through which a vehicle is moving. A method for controlling the imaging sensor includes receiving sensor data generated by the imaging sensor of the vehicle as the vehicle moves through the environment, determining (i) a lower bound for a vertical region of interest (VROI) within a vertical field of regard of the imaging sensor, the VROI comprising a virtual horizon, using a first subset of the sensor data, and (ii) an upper bound for the VROI within the vertical field of regard of the imaging sensor, using at least a second subset of the sensor data, where the first subset is smaller than the second subset. The method also includes causing the imaging sensor to be adjusted in accordance with the determined lower bound of the VROI and the determined upper bound of the VROI.

Abstract: To generate a machine learning model for controlling autonomous vehicles, training sensor data is obtained from sensors associated with one or more vehicles, the sensor data indicative of physical conditions of an environment in which the one or more vehicles operate, and a machine learning (ML) model is trained using the training sensor data. The ML model generates parameters of the environment in response to input sensor data. A controller in an autonomous vehicle receives sensor data from one or more sensors operating in the autonomous vehicle, applies the received sensor data to the ML model to obtain parameters of an environment in which the autonomous vehicle operates, provides the generated parameters to a motion planner component to generate decisions for controlling the autonomous vehicle, and causes the autonomous vehicle to maneuver in accordance with the generated decisions.

Abstract: Techniques for identifying and labeling distinct objects within 3-D images of environments in which vehicles operate, to thereby generate training data used to train models that autonomously control and/or operate vehicles, are disclosed. A 3-D image may be presented from various perspective views (in some cases, dynamically), and/or may be presented with a corresponding 2-D environment image in a side-by-side and/or a layered manner, thereby allowing a user to more accurately identify groups/clusters of data points within the 3-D image that represent distinct objects. Automatic identification/delineation of various types of objects depicted within 3-D images, automatic labeling of identified/delineated objects, and automatic tracking of objects across various frames of a 3-D video are disclosed. A user may modify and/or refine any automatically generated information. Further, at least some of the techniques described herein are equally applicable to 2-D images.

Abstract: Techniques for identifying and labeling distinct objects within 3-D images of environments in which vehicles operate, to thereby generate training data used to train models that autonomously control and/or operate vehicles, are disclosed. A 3-D image may be presented from various perspective views (in some cases, dynamically), and/or may be presented with a corresponding 2-D environment image in a side-by-side and/or a layered manner, thereby allowing a user to more accurately identify groups/clusters of data points within the 3-D image that represent distinct objects. Automatic identification/delineation of various types of objects depicted within 3-D images, automatic labeling of identified/delineated objects, and automatic tracking of objects across various frames of a 3-D video are disclosed. A user may modify and/or refine any automatically generated information. Further, at least some of the techniques described herein are equally applicable to 2-D images.

Abstract: Techniques for identifying and labeling distinct objects within 3-D images of environments in which vehicles operate, to thereby generate training data used to train models that autonomously control and/or operate vehicles, are disclosed. A 3-D image may be presented from various perspective views (in some cases, dynamically), and/or may be presented with a corresponding 2-D environment image in a side-by-side and/or a layered manner, thereby allowing a user to more accurately identify groups/clusters of data points within the 3-D image that represent distinct objects. Automatic identification/delineation of various types of objects depicted within 3-D images, automatic labeling of identified/delineated objects, and automatic tracking of objects across various frames of a 3-D video are disclosed. A user may modify and/or refine any automatically generated information. Further, at least some of the techniques described herein are equally applicable to 2-D images.

Abstract: Techniques for identifying and labeling distinct objects within 3-D images of environments in which vehicles operate, to thereby generate training data used to train models that autonomously control and/or operate vehicles, are disclosed. A 3-D image may be presented from various perspective views (in some cases, dynamically), and/or may be presented with a corresponding 2-D environment image in a side-by-side and/or a layered manner, thereby allowing a user to more accurately identify groups/clusters of data points within the 3-D image that represent distinct objects. Automatic identification/delineation of various types of objects depicted within 3-D images, automatic labeling of identified/delineated objects, and automatic tracking of objects across various frames of a 3-D video are disclosed. A user may modify and/or refine any automatically generated information. Further, at least some of the techniques described herein are equally applicable to 2-D images.

Abstract: Techniques for identifying and labeling distinct objects within 3-D images of environments in which vehicles operate, to thereby generate training data used to train models that autonomously control and/or operate vehicles, are disclosed. A 3-D image may be presented from various perspective views (in some cases, dynamically), and/or may be presented with a corresponding 2-D environment image in a side-by-side and/or a layered manner, thereby allowing a user to more accurately identify groups/clusters of data points within the 3-D image that represent distinct objects. Automatic identification/delineation of various types of objects depicted within 3-D images, automatic labeling of identified/delineated objects, and automatic tracking of objects across various frames of a 3-D video are disclosed. A user may modify and/or refine any automatically generated information. Further, at least some of the techniques described herein are equally applicable to 2-D images.

Abstract: Techniques for identifying and labeling distinct objects within 3-D images of environments in which vehicles operate, to thereby generate training data used to train models that autonomously control and/or operate vehicles, are disclosed. A 3-D image may be presented from various perspective views (in some cases, dynamically), and/or may be presented with a corresponding 2-D environment image in a side-by-side and/or a layered manner, thereby allowing a user to more accurately identify groups/clusters of data points within the 3-D image that represent distinct objects. Automatic identification/delineation of various types of objects depicted within 3-D images, automatic labeling of identified/delineated objects, and automatic tracking of objects across various frames of a 3-D video are disclosed. A user may modify and/or refine any automatically generated information. Further, at least some of the techniques described herein are equally applicable to 2-D images.