Abstract: A system for detecting boundaries of lanes on a road is presented. The system includes an imaging system configured to produce a set of pixels associated with lane markings on a road. The system also includes one or more processors configured to detect boundaries of lanes on the road, including: receive, from the imaging system, the set of pixels associated with lane markings; partition the set of pixels into a plurality of groups, each of the plurality of groups associated with one or more control points; and generate a first spline that traverses the control points of the plurality of groups, the first spline describing a boundary of a lane on the road.

Abstract: A method for determining a scan pattern according to which a sensor equipped with a scanner scans a field of regard (FOR) is presented. The method comprises obtaining, by processing hardware, a plurality of objective functions, each of the objective functions specifying a cost for a respective property of the scan pattern, expressed in terms of one or more operational parameters of the scanner. The method further includes applying, by the processing hardware, an optimization scheme to the plurality of objective functions to generate the scan pattern. The method further includes scanning the FOR according to the generated scan pattern.

Abstract: A scanning imaging sensor is configured to sense an environment through which a vehicle is moving. A method for determining one or velocities associated with objects in the environment includes generating features from the first set of scan lines and the second set of scan lines, the two sets corresponding to two instances in time. The method further includes generating a collection of candidate velocities based on feature locations and time differences, the features selected pairwise with one from the first set and another from the second set. Furthermore, the method includes analyzing the distribution of candidate velocities, for example, by identifying one or more modes from the collection of the candidate velocities.

Abstract: A system includes one or more processors configured to receive data point information captured using a lidar device, project the data point information onto a horizontal plane perspective, filter the projected data point information, determine a ground plane among one or more planes identified using the filtered projected data point information, and provide a parameter associated with the determined ground plane for configuring the lidar device. The system also includes a memory coupled with at least a portion of the one or more processors.

Abstract: A sequence of images generated at respective times by one or more sensors configured to sense an environment through which objects are moving relative to the one or more sensors is received. A message passing graph having a multiplicity of layers associated with the sequence of images is constructed. A neural network supported by the message passing graph is trained. The training includes performing a pass through the message passing graph in a forward direction including by adding a new feature node based on a feature detection and a new edge node and performing a pass through the message passing graph in a backward direction, including by updating at least one edge node of the message passing graph. Multiple features are tracked through the sequence of images, including passing messages through the message passing graph.

Abstract: A system for detecting boundaries of lanes on a road is presented. The system includes an imaging system configured to produce a set of pixels associated with lane markings on a road. The system also includes one or more processors configured to detect boundaries of lanes on the road, including: receive, from the imaging system, the set of pixels associated with lane markings; partition the set of pixels into a plurality of groups, each of the plurality of groups associated with one or more control points; and generate a first spline that traverses the control points of the plurality of groups, the first spline describing a boundary of a lane on the road.

Abstract: First training sensor data detected by a plurality of real-world sensors are obtained. The first training sensor data is associated with physical environment conditions. Second training sensor data detected by a plurality of virtual sensors are obtained. The second training sensor data is associated with simulated physical conditions of a virtual environment. A machine learning model is trained using both real-world and virtual training datasets including the first training sensor data, the second training sensor data, and respective sensor setting parameters of the plurality of real-world sensors and the plurality of virtual sensors. The real-world and virtual training datasets used to train the machine learning model include indications associated with the respective sensor parameter settings including one or more of the following: different scan line settings or different exposure settings.

Abstract: A method for detecting boundaries of lanes on a road is presented. The method comprises receiving, by one or more processors from an imaging system, a set of pixels associated with lane markings. The method further includes partitioning, by the one or more processors, the set of pixels into a plurality of groups. Each of the plurality of groups is associated with one or more control points. The method further includes generating, by the one or more processors, a spline that traverses the control points of the plurality of groups. The spline traversing the control points describes a boundary of a lane.

Abstract: To generate a machine learning model for controlling autonomous vehicles, training sensor data is obtained from sensors associated with one or more vehicles, the sensor data indicative of physical conditions of an environment in which the one or more vehicles operate, and a machine learning (ML) model is trained using the training sensor data. The ML model generates parameters of the environment in response to input sensor data. A controller in an autonomous vehicle receives sensor data from one or more sensors operating in the autonomous vehicle, applies the received sensor data to the ML model to obtain parameters of an environment in which the autonomous vehicle operates, provides the generated parameters to a motion planner component to generate decisions for controlling the autonomous vehicle, and causes the autonomous vehicle to maneuver in accordance with the generated decisions.

Abstract: An imaging system is described for generating an estimate for the virtual horizon for a moving vehicle. The estimate of the virtual horizon can correspond to lower and higher boundaries of a region within the field of regard, such that the virtual horizon is between the lower and the higher boundaries, in cases where determination of the virtual horizon may be unreliable due to traffic, weather or other road conditions that obscure the visibility in front of the vehicle the imaging system may switch to a static vertical scan density pattern having a broad central focus, which can mitigate the possibility that the system focuses on an incorrect virtual horizon and fails to capture significant objects or conditions in the roadway.

Abstract: A method for tracking a lane on a road is presented. The method comprises receiving, by one or more processors from an imaging system, a set of pixels associated with lane markings. The method further includes generating, by the one or more processors, a predicted spline comprising (i) a first spline and (ii) a predicted extension of the first spline in a direction in which the imaging system is moving. The first spline describes a boundary of a lane and is generated based on the set of pixels. The predicted extension of the first spline is generated based at least in part on a curvature of at least a portion of the first spline.

Abstract: A method for multi-object tracking includes receiving a sequence of images generated at respective times by one or more sensors configured to sense an environment through which objects are moving relative to the one or more sensors, and constructing a message passing graph in which each of a multiplicity of layers corresponds to a respective one in the sequence of images.

Abstract: A method for determining a scan pattern according to which a sensor equipped with a scanner scans a field of regard (FOR) is presented. The method comprises obtaining, by processing hardware, a plurality of objective functions, each of the objective functions specifying a cost for a respective property of the scan pattern, expressed in terms of one or more operational parameters of the scanner. The method further includes applying, by the processing hardware, an optimization scheme to the plurality of objective functions to generate the scan pattern. The method further includes scanning the FOR according to the generated scan pattern.

Abstract: A method for multi-object tracking includes receiving a sequence of images generated at respective times by one or more sensors configured to sense an environment through which objects are moving relative to the one or more sensors, and constructing a message passing graph in which each of a multiplicity of layers corresponds to a respective one in the sequence of images. The method also includes tracking multiple features through the sequence of images, including passing messages in a forward direction and a backward direction through the message passing graph to share information across time.

Abstract: A scanning imaging sensor is configured to sense an environment through which a vehicle is moving. A method for determining one or velocities associated with objects in the environment includes generating features from the first set of scan lines and the second set of scan lines, the two sets corresponding to two instances in time. The method further includes generating a collection of candidate velocities based on feature locations and time differences, the features selected pairwise with one from the first set and another from the second set. Furthermore, the method includes analyzing the distribution of candidate velocities, for example, by identifying one or more modes from the collection of the candidate velocities.

Abstract: A method for multi-object tracking includes receiving a sequence of images generated at respective times by one or more sensors configured to sense an environment through which objects are moving relative to the one or more sensors, and constructing a message passing graph in which each of a multiplicity of layers corresponds to a respective one in the sequence of images.

Abstract: A method for tracking a lane on a road is presented. The method comprises receiving, by one or more processors from an imaging system, a set of pixels associated with lane markings. The method further includes generating, by the one or more processors, a predicted spline comprising (i) a first spline and (ii) a predicted extension of the first spline in a direction in which the imaging system is moving. The first spline describes a boundary of a lane and is generated based on the set of pixels. The predicted extension of the first spline is generated based at least in part on a curvature of at least a portion of the first spline.

Abstract: A method for detecting boundaries of lanes on a road is presented. The method comprises receiving, by one or more processors from an imaging system, a set of pixels associated with lane markings. The method further includes partitioning, by the one or more processors, the set of pixels into a plurality of groups. Each of the plurality of groups is associated with one or more control points. The method further includes generating, by the one or more processors, a spline that traverses the control points of the plurality of groups. The spline traversing the control points describes a boundary of a lane.

Abstract: A computer-implemented method of determining relative velocity between a vehicle and an object. The method includes receiving sensor data generated by one or more sensors of the vehicle configured to sense an environment by following a scan pattern comprising component scan lines. The method includes obtaining, based on the sensor data, a point cloud frame. Additionally, the method includes identifying a first pixel and a second pixel that are co-located within a field of regard and overlap a point cloud object within the point cloud frame and calculating a difference between a depth associated with the first pixel and a depth associated with the second pixel. The method includes determining a relative velocity of the point cloud object by dividing the difference in depth data by a time difference between when the depth associated with the first pixel was sensed and the depth associated with the second pixel was sensed.

Abstract: To generate a machine learning model for controlling autonomous vehicles, training sensor data is obtained from sensors associated with one or more vehicles, the sensor data indicative of physical conditions of an environment in which the one or more vehicles operate, and a machine learning (ML) model is trained using the training sensor data. The ML model generates parameters of the environment in response to input sensor data. A controller in an autonomous vehicle receives sensor data from one or more sensors operating in the autonomous vehicle, applies the received sensor data to the ML model to obtain parameters of an environment in which the autonomous vehicle operates, provides the generated parameters to a motion planner component to generate decisions for controlling the autonomous vehicle, and causes the autonomous vehicle to maneuver in accordance with the generated decisions.