Abstract: In various examples, live perception from sensors of a vehicle may be leveraged to detect and classify intersections in an environment of a vehicle in real-time or near real-time. For example, a deep neural network (DNN) may be trained to compute various outputs—such as bounding box coordinates for intersections, intersection coverage maps corresponding to the bounding boxes, intersection attributes, distances to intersections, and/or distance coverage maps associated with the intersections. The outputs may be decoded and/or post-processed to determine final locations of, distances to, and/or attributes of the detected intersections.

Abstract: In various examples, live perception from sensors of a vehicle may be leveraged to detect and classify intersections in an environment of a vehicle in real-time or near real-time. For example, a deep neural network (DNN) may be trained to compute various outputs—such as bounding box coordinates for intersections, intersection coverage maps corresponding to the bounding boxes, intersection attributes, distances to intersections, and/or distance coverage maps associated with the intersections. The outputs may be decoded and/or post-processed to determine final locations of, distances to, and/or attributes of the detected intersections.

Abstract: In various examples, techniques for multi-dimensional tracking of objects using two-dimensional (2D) sensor data are described. Systems and methods may use first image data to determine a first 2D detected location and a first three-dimensional (3D) detected location of an object. The systems and methods may then determine a 2D estimated location using the first 2D detected location and a 3D estimated location using the first 3D detected location. The systems and methods may use second image data to determine a second 2D detected location and a second 3D detected location of a detected object, and may then determine that the object corresponds to the detected object using the 2D estimated location, the 3D estimated location, the second 2D detected location, and the second 3D detected location. The systems and method then generate, modify, delete, or otherwise update an object track that includes 2D state information and 3D state information.

Abstract: In various examples, techniques for multi-dimensional tracking of objects using two-dimensional (2D) sensor data are described. Systems and methods may use first image data to determine a first 2D detected location and a first three-dimensional (3D) detected location of an object. The systems and methods may then determine a 2D estimated location using the first 2D detected location and a 3D estimated location using the first 3D detected location. The systems and methods may use second image data to determine a second 2D detected location and a second 3D detected location of a detected object, and may then determine that the object corresponds to the detected object using the 2D estimated location, the 3D estimated location, the second 2D detected location, and the second 3D detected location. The systems and method then generate, modify, delete, or otherwise update an object track that includes 2D state information and 3D state information.

Abstract: In various examples, perception-based parking assistance systems and methods for an ego-machine are presented. Example embodiments may determine a location of a real-world parking strip relative to an ego-machine and an associated parking rule for the parking strip. A virtual parking strip and one or more virtual parking signs may be generated based at least in part on one or more detected features in an environment of the ego-machine and a tracked motion of the ego machine, and the virtual parking strip may be used to track parking strip locations and associated parking rules. The virtual parking strips and associated rules may be relied upon by an ego-machine to determine parking locations and/or to navigate into a suitable parking spot.

Abstract: In various examples, live perception from sensors of a vehicle may be leveraged to detect and classify intersections in an environment of a vehicle in real-time or near real-time. For example, a deep neural network (DNN) may be trained to compute various outputs—such as bounding box coordinates for intersections, intersection coverage maps corresponding to the bounding boxes, intersection attributes, distances to intersections, and/or distance coverage maps associated with the intersections. The outputs may be decoded and/or post-processed to determine final locations of, distances to, and/or attributes of the detected intersections.

Abstract: In various examples, live perception from sensors of a vehicle may be leveraged to detect and classify intersections in an environment of a vehicle in real-time or near real-time. For example, a deep neural network (DNN) may be trained to compute various outputs—such as bounding box coordinates for intersections, intersection coverage maps corresponding to the bounding boxes, intersection attributes, distances to intersections, and/or distance coverage maps associated with the intersections. The outputs may be decoded and/or post-processed to determine final locations of, distances to, and/or attributes of the detected intersections.

Abstract: In various examples, lanes may be grouped and a sign may be assigned to a lane in a group, then propagated to another lane in the group to associate semantic meaning corresponding to the sign with the lanes. The sign may be assigned to the most similar lane as quantified by a matching score subject to the lane meeting any hard constraints. Propagation of an assignment of the sign to a different lane may be based on lane attributes and/or sign attributes. Lane attributes may be evaluated and assignments of signs may occur for a lane as a whole, and/or for particular segments of a lane (e.g., of multiple segments perceived by the system). A sign may be a compound sign that is identified as individual signs, which are associated with one another. Attributes of the compound sign may provide semantic meaning used to operate a machine.

Abstract: In various examples, live perception from sensors of a vehicle may be leveraged to generate potential paths for the vehicle to navigate an intersection in real-time or near real-time. For example, a deep neural network (DNN) may be trained to compute various outputs—such as heat maps corresponding to key points associated with the intersection, vector fields corresponding to directionality, heading, and offsets with respect to lanes, intensity maps corresponding to widths of lanes, and/or classifications corresponding to line segments of the intersection. The outputs may be decoded and/or otherwise post-processed to reconstruct an intersection—or key points corresponding thereto—and to determine proposed or potential paths for navigating the vehicle through the intersection.

Abstract: In various examples, live perception from sensors of a vehicle may be leveraged to detect and classify intersections in an environment of a vehicle in real-time or near real-time. For example, a deep neural network (DNN) may be trained to compute various outputs—such as bounding box coordinates for intersections, intersection coverage maps corresponding to the bounding boxes, intersection attributes, distances to intersections, and/or distance coverage maps associated with the intersections. The outputs may be decoded and/or post-processed to determine final locations of, distances to, and/or attributes of the detected intersections.

Abstract: Methods for rendering three-dimensional photo meshes having dynamic content include: (a) detecting a shadow in a three-dimensional photo mesh; (b) removing the shadow from the three-dimensional photo mesh to form a modified photo mesh having a shadow-free texture; (c) simulating a real-time condition in the modified photo mesh; and (d) rendering an image that shows an effect of the real-time condition. Systems for rendering three-dimensional photo meshes having dynamic content are described.

Abstract: Constructing a three dimensional (3D) model of a structure may involve receiving a 3D surface representing a geographic area, the surface having elevation values associated with points of the surface and the geographic area comprises a structure having a geographic footprint smaller than the geographic area. Constructing a 3D model may also involve projecting the elevation values into a two dimensional (2D) plane. Further, a 3D model may be constructed of the structure by assigning model heights based on the elevation values projected into points of the 2D plane.

Abstract: Constructing a three dimensional (3D) model of a structure may involve receiving a 3D surface representing a geographic area, the surface having elevation values associated with points of the surface and the geographic area comprises a structure having a geographic footprint smaller than the geographic area. Constructing a 3D model may also involve projecting the elevation values into a two dimensional (2D) plane. Further, a 3D model may be constructed of the structure by assigning model heights based on the elevation values projected into points of the 2D plane.

Abstract: Methods for rendering three-dimensional photo meshes having dynamic content include: (a) detecting a shadow in a three-dimensional photo mesh; (b) removing the shadow from the three-dimensional photo mesh to form a modified photo mesh having a shadow-free texture; (c) simulating a real-time condition in the modified photo mesh; and (d) rendering an image that shows an effect of the real-time condition. Systems for rendering three-dimensional photo meshes having dynamic content are described.