Abstract: Systems and methods for dynamic predictive control of autonomous vehicles are disclosed. In one aspect, an in-vehicle control system for a semi-truck includes one or more control mechanisms configured to control movement of the semi-truck and a processor. The system further includes computer-readable memory in communication with the processor and having stored thereon computer-executable instructions to cause the processor to receive a desired trajectory and a vehicle status of the semi-truck, determine a dynamic model of the semi-truck based on the desired trajectory and the vehicle status, determine at least one quadratic program (QP) problem based on the dynamic model, generate at least one control command for controlling the semi-truck by solving the at least one QP problem, and provide the at least one control command to the one or more control mechanisms.

Abstract: Image processing techniques are described to select and crop a region of interest from an image obtained from a camera located on or in a vehicle, such as an autonomous semi-trailer truck. The region of interest can be identified by selecting one or more reference points and determining one or more positions of the one or more reference points on the image obtained from the camera. As an example, a location of two reference points may be 500 meters and 1000 meters in front of a location of autonomous vehicle, where the front of the autonomous vehicle is an area towards which the autonomous vehicle is being driven.

Abstract: A system and method for autonomous vehicle control to minimize energy cost are disclosed. A particular embodiment includes: generating a plurality of potential routings and related vehicle motion control operations for an autonomous vehicle to cause the autonomous vehicle to transit from a current position to a desired destination; generating predicted energy consumption rates for each of the potential routings and related vehicle motion control operations using a vehicle energy consumption model; scoring each of the plurality of potential routings and related vehicle motion control operations based on the corresponding predicted energy consumption rates; selecting one of the plurality of potential routings and related vehicle motion control operations having a score within an acceptable range; and outputting a vehicle motion control output representing the selected one of the plurality of potential routings and related vehicle motion control operations.

Abstract: Technique for performing camera calibration on a vehicle is disclosed. A method of performing camera calibration includes emitting, by a laser emitter located on a vehicle and pointed towards a road, a first laser pulse group towards a first location on a road and a second laser pulse group towards a second location on the road, where each laser pulse group includes one or more laser spots. For each laser pulse group: a first set of distances are calculated from a location of a laser receiver to the one or more laser spots, and a second set of distances are determined from an image obtained from a camera, where the second set of distances are from a location of the camera to the one or more laser spots. The method also includes determining two camera calibration parameters of the camera by solving two equations.

Abstract: Techniques are described for compensating for movements of sensors. A method includes receiving two sets of sensor data from two sets of sensors, where a first set of sensors are located on a roof of a cab of a semi-trailer truck and a second set of sensor data are located on a hood of the semi-trailer truck. The method also receives from a height sensor a measured value indicative of a height of the rear of a rear portion of the cab of the semi-trailer truck relative to a chassis of the semi-trailer truck, determines two correction values, one for each of the two sets of sensor data, and compensates for the movement of the two sets of sensors by generating two sets of compensated sensor data. The two sets of compensated sensor data are generated by adjusting the two sets of sensor data based on the two correction values.

Abstract: Power distribution system architectures are described that can safely and effectively support the power needs of automotive original equipment manufacturer (OEM) systems and state-of-the-art autonomous systems and devices. In some implementations, a power distribution system may include: vehicle power sources that produce an output voltage to operate one or more devices in the vehicle, and power bridge devices that electrically couple a vehicle power source to the multiple banks of battery bridge devices and to power distribution units (PDUs). Various electrical loads in the vehicle can be electrically coupled to the battery bridge devices and to the PDUs.

Abstract: A system and method for taillight signal recognition using a convolutional neural network is disclosed. An example embodiment includes: receiving a plurality of image frames from one or more image-generating devices of an autonomous vehicle; using a single-frame taillight illumination status annotation dataset and a single-frame taillight mask dataset to recognize a taillight illumination status of a proximate vehicle identified in an image frame of the plurality of image frames, the single-frame taillight illumination status annotation dataset including one or more taillight illumination status conditions of a right or left vehicle taillight signal, the single-frame taillight mask dataset including annotations to isolate a taillight region of a vehicle; and using a multi-frame taillight illumination status dataset to recognize a taillight illumination status of the proximate vehicle in multiple image frames of the plurality of image frames, the multiple image frames being in temporal succession.

Abstract: Described are devices, systems and methods for real-time remote control of vehicles with high redundancy. In some embodiments, two copies of at least one control command are received using two different wireless communication protocols, and are compared. The at least one control command is executed when the two copies are in agreement, but is rejected when the two copies differ. In other embodiments, additional wireless communication protocols may exist to provide a redundant mode of communication when one of the two different wireless communication protocols are unavailable. In yet other embodiments, redundant GPS units may be used to determine availability of any of the communication protocols, and relevant control commands may be downloaded in advance to circumvent the lack of coverage.

Abstract: Disclosed are devices, systems and methods for a monitoring system for autonomous vehicle operation. In some embodiments, a vehicle may perform self-tests, generate a report based on the results, and transmit it to a remote monitor center over one or both of a high-speed channel for regular data transfers or a reliable channel for emergency situations. In other embodiments, the remote monitor center may determine that immediate intervention is required, and may transmit a control command with high priority, which when received by the vehicle, is implemented and overrides any local commands being processed. In yet other embodiments, the control command with high priority is selected from a small group of predetermined control commands the remote monitor center may issue.

Abstract: A system and method for online real-time multi-object tracking is disclosed. A particular embodiment can be configured to: receive image frame data from at least one camera associated with an autonomous vehicle; generate similarity data corresponding to a similarity between object data in a previous image frame compared with object detection results from a current image frame; use the similarity data to generate data association results corresponding to a best matching between the object data in the previous image frame and the object detection results from the current image frame; cause state transitions in finite state machines for each object according to the data association results; and provide as an output object tracking output data corresponding to the states of the finite state machines for each object.

Abstract: A system and method for using human driving patterns to manage speed control for autonomous vehicles are disclosed. A particular embodiment includes: generating data corresponding to desired human driving behaviors; training a human driving model module using a reinforcement learning process and the desired human driving behaviors; receiving a proposed vehicle speed control command; determining if the proposed vehicle speed control command conforms to the desired human driving behaviors by use of the human driving model module; and validating or modifying the proposed vehicle speed control command based on the determination.

Abstract: Disclosed are devices, systems and methods for remote safe driving. One exemplary method includes detecting an emergency situation, and in response to the detecting the emergency situation, switching operation of the vehicle to a low-power operation mode that comprises shutting down a subset of vehicular components, and periodically transmitting a location of the vehicle to a remote monitoring center. Another exemplary method includes selecting at least one of a set of vehicular driving actions, and transmitting, over a secure connection, the at least one of the set of vehicular driving actions to the vehicle, wherein the set of vehicular driving actions is generated based on a classification of driver behavior.

Abstract: Techniques for analysis of autonomous vehicle operations are described. As an example, a method of autonomous vehicle operation includes storing sensor data from one or more sensors located on the autonomous vehicle into a storage medium, performing, based on at least some of the sensor data, a simulated execution of one or more programs associated with the operations of the autonomous vehicle, generating, based on the simulated execution of the one or more programs and as part of a simulation, one or more control signal values that control a simulated driving behavior of the autonomous vehicle, and providing a visual feedback of the simulated driving behavior of the autonomous vehicle on a simulated road.

Abstract: A system and method for determining car to lane distance is provided. In one aspect, the system includes a camera configured to generate an image, a processor, and a computer-readable memory. The processor is configured to receive the image from the camera, generate a wheel segmentation map representative of one or more wheels detected in the image, and generate a lane segmentation map representative of one or more lanes detected in the image. For at least one of the wheels in the wheel segmentation map, the processor is also configured to determine a distance between the wheel and at least one nearby lane in the lane segmentation map. The processor is further configured to determine a distance between a vehicle in the image and the lane based on the distance between the wheel and the lane.

Abstract: A method of constructing a map including a plurality of lanes and a system thereof are provided. The method includes: for each of the plurality of lanes, constructing corresponding lane geometry data based on a plurality of polyline segments, including constructing a general outline circumscribing the plurality of lanes and identifying an outline of each of the plurality of lanes based on the plurality of polyline segments and the general outline. Outline polyline segments as boundaries of the general outline are selected from the plurality of polyline segments.

Abstract: Techniques are disclosed for performing hybrid simulation operations with an autonomous vehicle. A method of testing autonomous vehicle operations includes receiving, by a computer, a pre-configured scenario that includes one or more simulation parameters and one or more initial condition parameters, sending, to the autonomous vehicle and based on the one or more initial condition parameters, control signals that instruct the autonomous vehicle to operate at an operative condition, and in response to determining that the autonomous vehicle is operating at the operative condition, performing a simulation with the one or more simulated objects and the autonomous vehicle to test a response of the autonomous vehicle.

Abstract: An integrated housing assembly can be mounted on a roof of a vehicle, such as a semi-trailer truck. The integrated housing assembly includes a main enclosure that includes four sides, a top panel, and a bottom panel. One of the four sides is a front panel that is inclined towards the ground. The main enclosure includes one or more cavities. A front panel of the integrated housing assembly includes one or more openings to allow cameras or sensors to be placed within the one or more cavities and behind the one or more opening. The cameras or sensors cameras can be clamped at a downward angle within multiple lock apparatus. The angled front panel and the inclined cameras or sensors within the lock apparatus allow the cameras or sensors to obtain images or sensor data from one or more regions of interest at some distance from the front of the vehicle.

Abstract: Systems and methods for detecting trailer angle are provided. In one aspect, an in-vehicle control system includes an optical sensor configured to be mounted on a tractor so as to face a trailer coupled to the tractor, the optical sensor further configured to generate optical data indicative of an angle formed between the trailer and the tractor. The system further includes a processor and a computer-readable memory in communication with the processor and having stored thereon computer-executable instructions to cause the processor to receive the optical data from the optical sensor, determine at least one candidate plane representative of a surface of the trailer visible in the optical data based on the optical data, and determine an angle between the trailer and the tractor based on the at least one candidate plane.

Abstract: Disclosed are devices, systems and methods for incorporating a smoothness constraint for camera pose estimation. One method for robust camera pose estimation includes determining a first bounding box based on a previous frame, determining a second bounding box based on a current frame that is temporally subsequent to the previous frame, estimating the camera pose by minimizing a weighted sum of a camera pose function and a constraint function, where the camera pose function tracks a position and an orientation of the camera in time, and where the constraint function is based on coordinates of the first bounding box and coordinates of the second bounding box, and using the camera pose for navigating the vehicle. The method may further include generating an initial estimate of the camera pose is based on a Global Positioning System (GPS) sensor or an Inertial Measurement Unit (IMU).

Abstract: Techniques are described to estimate orientation of one or more cameras located on a vehicle. The orientation estimation technique can include obtaining an image from a camera located on a vehicle while the vehicle is being driven on a road, determining, from a terrain map, a location of a landmark located at a distance from a location of the vehicle on the road, determining, in the image, pixel locations of the landmark, selecting one pixel location from the determined pixel locations; and calculating values that describe an orientation of the camera using at least an intrinsic matrix and a previously known extrinsic matrix of the camera, where the intrinsic matrix is characterized based on at least the one pixel location and the location of the landmark.