Abstract: The present teaching relates to method, system, medium, and implementation of lane planning in an autonomous vehicle. Sensor data are received that capture ground images of a road the autonomous vehicle is on. Based on the sensor data, a current lane of the road that autonomous vehicle is currently occupying is detected. Information indicating presence of a passenger in the vehicle is obtained and used to retrieve a personalized lane control model related to the passenger. Lane control for the autonomous vehicle is planned based on the detected current lane and self-aware capability parameters in accordance with the personalized lane control model. The self-aware capability parameters are used to predict operational capability of the autonomous vehicle with respect to a current location of the autonomous vehicle. The personalized lane control model is generated based on recorded human driving data.

Abstract: The present teaching relates to method, system, medium, and implementation of lane planning in an autonomous vehicle. Sensor data are received that capture ground images of a road the autonomous vehicle is on. Based on the sensor data, a current lane of the road that autonomous vehicle is currently occupying is detected. Lane control for the autonomous vehicle is planned based on the detected current lane and self-aware capability parameters in accordance with a driving lane control model. The self-aware capability parameters are used to predict operational capability of the autonomous vehicle with respect to a current location of the autonomous vehicle. The driving lane control model is generated based on recorded human driving data to achieve human-like lane control behavior in different scenarios.

Abstract: The present teaching relates to method, system, medium, and implementation of lane planning in an autonomous vehicle. Sensor data are received that capture ground images of a road the autonomous vehicle is on. Based on the sensor data, a current lane of the road that autonomous vehicle is currently occupying is detected. Information indicating presence of a passenger in the vehicle is obtained and used to retrieve a personalized lane control model related to the passenger. Lane control for the autonomous vehicle is planned based on the detected current lane and self-aware capability parameters in accordance with the personalized lane control model. The self-aware capability parameters are used to predict operational capability of the autonomous vehicle with respect to a current location of the autonomous vehicle. The personalized lane control model is generated based on recorded human driving data.

Abstract: The present teaching relates to method, system, medium, and implementation of lane planning in an autonomous vehicle. Sensor data are received that capture ground images of a road the autonomous vehicle is on. Based on the sensor data, a current lane of the road that autonomous vehicle is currently occupying is detected. Lane control for the autonomous vehicle is planned based on the detected current lane and self-aware capability parameters in accordance with a driving lane control model. The self-aware capability parameters are used to predict operational capability of the autonomous vehicle with respect to a current location of the autonomous vehicle. The driving lane control model is generated based on recorded human driving data to achieve human-like lane control behavior in different scenarios.

Abstract: The present teaching relates to method, system, and medium, for presenting a warning to a driver. An instruction indicating an upcoming change in an operating mode of the vehicle is obtained, wherein the instruction specifies a set of tasks to be completed by the driver and a task duration associated with each task. Information of a current state of the driver is obtained and used to determine a warning to be used to alert the driver to perform the change, wherein the warning includes warning content and indication of at least one media to be used to deliver the warning content. A warning schedule is generated to comprise a set of warnings, each warning corresponding to one task, and arranged in an order based on an order of the tasks. The warning schedule is transmitted so that each warning of the set of warnings is executed.

Abstract: The present teaching relates to method, system, medium, and implementation of human-like vehicle control for an autonomous vehicle. Recorded human driving data are first received, which include vehicle state data, vehicle control data, and environment data. For each piece of recorded human driving data, a vehicle kinematic model based vehicle control signal is generated in accordance with a vehicle kinematic model based on a corresponding vehicle state and vehicle control data of the piece of recorded human driving data. A human-like vehicle control model is obtained, via machine learning, based on the recorded human driving data as well as the vehicle kinematic model based vehicle control signal generated based on vehicle kinematic model. Such derived human-like vehicle control model is to be used to generate a human-like vehicle control signal with respect to a target motion of an autonomous vehicle to achieve human-like vehicle control behavior.

Abstract: The present teaching relates to method, system, medium, and implementation of a global model update center. At least one model is established at the model update center for detecting objects surrounding each of autonomous driving vehicles of a fleet. A plurality of labeled data items are received, from the fleet of autonomous driving vehicles, where each of the labeled data items is detected, based on the at least one model, from sensor data characterizing surroundings of the autonomous driving vehicles. The labeled data items are generated automatically on-the-fly by the autonomous driving vehicles. Based on the received labeled data items, at least some of the models are updated and model update information is accordingly generated. Such generated model update information is then distributed to the fleet of autonomous driving vehicles.

Abstract: The present teaching relates to method, system, and medium, for generating an augmented alert in a hybrid vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

Abstract: The present teaching relates to method, system, and medium, for generating an augmented alert in a hybrid vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

Abstract: The present teaching relates to method, system, and medium, for generating an augmented alert in a hybrid vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

Abstract: The present teaching relates to method, system, and medium, for generating an augmented alert in a hybrid vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

Abstract: The present teaching relates to method, system, and medium, for presenting a warning to a driver. An instruction indicating an upcoming change in an operating mode of the vehicle is obtained, wherein the instruction specifies a set of tasks to be completed by the driver and a task duration associated with each task. Information of a current state of the driver is obtained and used to determine a warning to be used to alert the driver to perform the change, wherein the warning includes warning content and indication of at least one media to be used to deliver the warning content. A warning schedule is generated to comprise a set of warnings, each warning corresponding to one task, and arranged in an order based on an order of the tasks. The warning schedule is transmitted so that each warning of the set of warnings is executed.

Abstract: The present teaching relates to method, system, medium, and implementation of human-like vehicle control for an autonomous vehicle. Information related to a target motion to be achieved by the autonomous vehicle is received, wherein the information includes a current vehicle state of the autonomous vehicle. A first vehicle control signal is generated with respect to the target motion and the given vehicle state in accordance with a vehicle kinematic model. A second vehicle control signal is generated in accordance with a human-like vehicle control model, with respect to the target motion, the given vehicle state, and the first vehicle control signal, wherein the second vehicle control signal modifies the first vehicle control signal to achieve human-like vehicle control behavior.

Abstract: The present teaching relates to method, system, medium, and implementation of a global model update center. At least one model is established at the model update center for detecting objects surrounding each of autonomous driving vehicles of a fleet. A plurality of labeled data items are received, from the fleet of autonomous driving vehicles, where each of the labeled data items is detected, based on the at least one model, from sensor data characterizing surroundings of the autonomous driving vehicles. The labeled data items are generated automatically on-the-fly by the autonomous driving vehicles. Based on the received labeled data items, at least some of the models are updated and model update information is accordingly generated. Such generated model update information is then distributed to the fleet of autonomous driving vehicles.

Abstract: A modular rack assembly for autonomous vehicles, and an autonomous vehicle having said modular rack assembly. The modular rack assembly includes a rail configured for placement onto a vehicle, e.g., a roof and/or near a front windshield. The rail has at least one sensor (radar, LiDAR, camera) mounted thereon. Connector(s) are provided on the rail to connect to one or more corresponding couplings on the vehicle. The connectors are communicatively tied to the sensor(s) for sending and receiving communication via the couplings when connected thereto. Also included is a controller that connects to a computer within the vehicle to communicate with the computer and the sensor(s). Connection of the rail to the couplings establishes communication between the controller and the computer, such that the controller is configured to send and receive signals to and from the computer and to and from the sensor(s) for controlling operation and driving of the autonomous vehicle.

Abstract: The present teaching relates to method, system, medium, and implementation of determining depth information in autonomous driving. Stereo images are first obtained from multiple stereo pairs selected from at least two stereo pairs. The at least two stereo pairs have stereo cameras installed with the same baseline and in the same vertical plane. Left images from the multiple stereo pairs are fused to generate a fused left image and right images from the multiple stereo pairs are fused to generate a fused right image. Disparity is then estimated based on the fused left and right images and depth information can be computed based on the stereo images and the disparity.

Abstract: The present teaching relates to method, system, and medium, for generating an augmented alert in a hybrid vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

Abstract: The present teaching relates to method, system, medium, and implementation of human-like vehicle control for an autonomous vehicle. Information related to a target motion to be achieved by the autonomous vehicle is received, wherein the information includes a current vehicle state of the autonomous vehicle. A first vehicle control signal is generated with respect to the target motion and the given vehicle state in accordance with a vehicle kinematic model. A second vehicle control signal is generated in accordance with a human-like vehicle control model, with respect to the target motion, the given vehicle state, and the first vehicle control signal, wherein the second vehicle control signal modifies the first vehicle control signal to achieve human-like vehicle control behavior.

Abstract: The present teaching relates to method, system, medium, and implementation of determining depth information in autonomous driving. Stereo images are first obtained from multiple stereo pairs selected from at least two stereo pairs. The at least two stereo pairs have stereo cameras installed with the same baseline and in the same vertical plane. Left images from the multiple stereo pairs are fused to generate a fused left image and right images from the multiple stereo pairs are fused to generate a fused right image. Disparity is then estimated based on the fused left and right images and depth information can be computed based on the stereo images and the disparity.

Abstract: The present teaching relates to method, system, medium, and implementation of estimating a pose of an object in autonomous driving. Stereo images are obtained from a scene via at least two cameras. Objects present in the scene are then detected from the stereo images. For each object detected, a plurality of feature points are identified and depth information associated with the feature points are obtained. An orientation of each object is then estimated based on the feature points and depth information of the object and the pose of the object is then estimated based on the orientation and additional features of the object.