Abstract: According to various embodiments, described herein is a method of creating a simulation environment with multiple simulation obstacle vehicles, each with a different human-like driving style. Training datasets with different driving styles can be collected from individual human drivers, and can be combined to generate mixed datasets, each mixed dataset including only data of a particular driving style. Multiple learning-based motion planner critics can be trained using the mixed datasets, and can be used to tune multiple motion planners. Each tuned motion planner can have a different human-like driving style, and can be installed in one of multiple simulation obstacle vehicles. The simulation obstacle vehicles with different human-like driving styles can be deployed to the simulation environment to make the simulation environment more resemble a real-world driving environment.

Abstract: Described herein are a method of training a learning-based critic for tuning a rule-based motion planner of an autonomous driving vehicle, a method of tuning a motion planner using an automatic tuning framework that with the learning-based critic. The method includes receiving training data that incudes human driving trajectories and random trajectories derived from the human driving trajectories; training a learning-based critic using the training data; identifying a set of discrepant trajectories by comparing a first set of trajectories, and a second set of trajectories; and refining, at the neural network training platform, the learning-based critic based on the set of discrepant trajectories. The automatic tuning framework can remove human efforts in tedious parameter tuning, reduce tuning time, while retaining the physical and safety constraints of the ruled-based motion planner.