Patents by Inventor Jinghao Miao

Jinghao Miao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210318683
    Abstract: In one embodiment, method performed by an autonomous driving vehicle (ADV) that determines, within a driving space, a plurality of routes from a current location of the ADV to a desired location. The method determines, for each route of the plurality of routes, an objective function to control the ADV autonomously along the route and, for each of the objective functions, performs Differential Dynamic Programming (DDP) optimization in view of a set of constraints to produce a path trajectory. The method determines whether at least one of the path trajectories satisfies each constraint and, in response to a path trajectory satisfying each of the constraints, selects the path trajectory for navigating the ADV from the current location to the desired location.
    Type: Application
    Filed: April 8, 2020
    Publication date: October 14, 2021
    Inventors: QI LUO, JINYUN ZHOU, SHU JIANG, JIAMING TAO, YU WANG, JIAXUAN XU, KECHENG XU, JINGHAO MIAO, JIANGTAO HU
  • Patent number: 11137762
    Abstract: In one embodiment, a method, apparatus, and system may predict behavior of environmental objects using machine learning at an autonomous driving vehicle (ADV). One or more yield/overtake decisions are made with respect to one or more objects in the ADV's surrounding environment using a data processing architecture comprising at least a first, a second, and a third neural networks, the first, the second, and the third neural networks having been trained with a training data set. Driving signals are generated based at least in part on the yield/overtake decisions to control operations of the ADV.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: October 5, 2021
    Assignee: BAIDU USA LLC
    Inventors: Liangliang Zhang, Hongyi Sun, Dong Li, Jiangtao Hu, Jinghao Miao, Jiaming Tao, Yifei Jiang
  • Patent number: 11136023
    Abstract: A moving object such as a vehicle is identified within an intersection having multiple exits. The moving object and the intersection and its exits may be identified based on sensor data obtained from various sensors mounted on an ADV. An exit coordinate map is generated based on the orientation of the moving object and a relative position of each of the exits of the intersection with respect to the current position of the moving object. For each of the exits, an exit probability of the exit that the moving object likely exits the intersection using the exit coordinate map. Thereafter, a trajectory of the ADV is planned to navigate through the intersection to avoid the collision with the moving object based on the exit probabilities of the exits of the intersection. The above process is iteratively performed for each of the moving objects detected within the proximity of the intersection.
    Type: Grant
    Filed: May 7, 2019
    Date of Patent: October 5, 2021
    Assignee: BAIDU USA LLC
    Inventors: Hongyi Sun, Jiacheng Pan, Kecheng Xu, Yajia Zhang, Jinghao Miao
  • Publication number: 20210300427
    Abstract: In one embodiment, a plurality of obstacles is sensed in an environment of an automated driving vehicle (ADV). One or more representations are formed to represent corresponding groupings of the plurality of obstacles. A vehicle route is determined in view of the one or more representations, rather than each and every one of the obstacles individually.
    Type: Application
    Filed: March 25, 2020
    Publication date: September 30, 2021
    Inventors: JIAMING TAO, QI LUO, JINYUN ZHOU, KECHENG XU, YU WANG, SHU JIANG, JIANGTAO HU, JINGHAO MIAO
  • Publication number: 20210291862
    Abstract: In one embodiment, a control command is generated with an MPC controller, the MPC controller including a cost function with weights associated with cost terms of the cost function. The control command is applied to a dynamic model of an autonomous driving vehicle (ADV) to simulate behavior of the ADV. One or more of the weights are based on evaluation of the dynamic model in response to the control command, resulting in an adjusted cost function of the MPC controller. Another control command is generated with the MPC controller having the adjusted cost function. This second control command can be used to effect movement of the ADV.
    Type: Application
    Filed: March 18, 2020
    Publication date: September 23, 2021
    Inventors: Shu JIANG, Qi LUO, Jinghao MIAO, Jiangtao HU, Yu WANG, Jinyun ZHOU, Jiaming TAO, Kecheng XU
  • Publication number: 20210291863
    Abstract: In one embodiment, an ADV is routed by executing a first driving scenario that is active. The first driving scenario is one of a plurality of driving scenario types, each driving scenario type being associated with one or more stages to be executed while a corresponding driving scenario type is active. Based on an environmental condition around the ADV, a second driving scenario is set as active. The ADV is routed by executing the second driving scenario. When the second driving scenario exits, execution of the first driving scenario resumes at the one or more stages of the first driving scenario that remains to be executed.
    Type: Application
    Filed: March 23, 2020
    Publication date: September 23, 2021
    Inventors: JIAMING TAO, QI LUO, JINYUN ZHOU, KECHENG XU, YU WANG, SHU JIANG, JIANGTAO HU, JINGHAO MIAO
  • Publication number: 20210291855
    Abstract: In one embodiment, static-state curvature error compensation control logic for autonomous driving vehicles (ADV) receives planning and control data associated with the ADV, including a planned steering angle and a planned speed. A steering command is generated based on a current steering angle and the planned steering angle of the ADV. A throttle command is generated based on the planned speed in view of a current speed of the ADV. A curvature error is calculated based on a difference between the current steering angle and the planned steering angle. The steering command is issued to the ADV while withholding the throttle command, in response to determining that the curvature error is greater than a predetermined curvature threshold, such that the steering angle of the ADV is adjusted in view of the planned steering angle without acceleration.
    Type: Application
    Filed: March 23, 2020
    Publication date: September 23, 2021
    Inventors: Yu Wang, Qi Luo, Jinyun Zhou, Shu Jiang, Jiaxuan Xu, Jinghao Miao, Jiangtao Hu
  • Publication number: 20210294340
    Abstract: In one embodiment, a method determines a route from a first location of an autonomous driving vehicle (ADV) to a second location within an open space, the first location being a current location of the ADV. The method determines an objective function based on the route, the objective function having a set of costs for maneuvering the ADV from the first location to the second location. The method determines environmental conditions of the open space and uses the environmental conditions to determine a set of weights, each weight to be applied to a corresponding cost of the objective function. The method optimizes the objective function in view of one or more constraints, such that an output of the objective function reaches minimum while the one or more constraints are satisfied and generates a path trajectory with the optimized objective function to control the ADV autonomously according to the path trajectory.
    Type: Application
    Filed: March 23, 2020
    Publication date: September 23, 2021
    Inventors: Jinyun Zhou, Qi Luo, Shu Jiang, Jiaming Tao, Yu Wang, JiaXuan Xu, KeCheng Xu, Jinghao Miao, Jiangtao Hu
  • Publication number: 20210294324
    Abstract: In one embodiment, control of an autonomous driving vehicle (ADV) includes determining a current scenario of the ADV. Based on the scenario, a control algorithm is selected among a plurality of distinct control algorithms as the active control algorithm. One or more control commands are generated using the active control algorithm, based one or more target inputs. The control commands are applied to effect movement of the ADV.
    Type: Application
    Filed: March 18, 2020
    Publication date: September 23, 2021
    Inventors: Shu JIANG, Qi LUO, Jinghao MIAO, Jiangtao HU, Yu WANG, Jinyun ZHOU, Jiaming TAO, Xiangquan XIAO
  • Patent number: 11127142
    Abstract: A system and method for predicting the near-term trajectory of a moving obstacle sensed by an autonomous driving vehicle (ADV) is disclosed. The method applies neural networks such as a LSTM model to learn dynamic features of the moving obstacle's motion based on its past trajectory up to its current position and a CNN model to learn the semantic map features of the driving environment in a portion of an image map. From the learned dynamic features of the moving obstacle and the learned semantic map features of the environment, the method applies a neural network to iteratively predict the moving obstacle's positions for successive time points of a prediction interval. To predict the moving obstacle's position at the next time point from the currently predicted position, the methods may update the learned dynamic features of the moving obstacle based on its past trajectory up to the currently predicted position.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: September 21, 2021
    Assignee: BAIDU USA LLC
    Inventors: Kecheng Xu, Hongyi Sun, Jiacheng Pan, Xiangquan Xiao, Jiangtao Hu, Jinghao Miao
  • Publication number: 20210261160
    Abstract: Systems and methods are disclosed for reducing second order dynamics delays in a control subsystem (e.g. throttle, braking, or steering) in an autonomous driving vehicle (ADV). A control input is received from an ADV perception and planning system. The control input is translated in a control command to a control subsystem of the ADV. A reference actuation output is obtained from a storage of the ADV. The reference actuation output is a smoothed output that accounts for second order actuation dynamic delays attributable to the control subsystem actuator. Based on a difference between the control input and the reference actuation output, adaptive gains are determined and applied to the input control signal to reduce error between the control output and the reference actuation output.
    Type: Application
    Filed: February 21, 2020
    Publication date: August 26, 2021
    Inventors: Yu WANG, Qi LUO, Shu JIANG, Jinghao MIAO, Jiangtao HU, Jingao WANG, Jinyun ZHOU, Jiaxuan XU
  • Publication number: 20210253118
    Abstract: Systems and methods are disclosed for identifying time-latency and subsystem control actuation dynamic delay due to second order dynamics that are neglected in control systems of the prior art. Embodiments identify time-latency and subsystem control actuation delays by developing a discrete-time dynamic model having parameters and estimating the parameters using a least-squares method over selected crowd-driving data. After estimating the model parameters, the model can be used to identify dynamic actuation delay metrics such as time-latency, rise time, settling time, overshoot, bandwidth, and resonant peak of the control subsystem. Control subsystems can include steering, braking, and throttling.
    Type: Application
    Filed: February 13, 2020
    Publication date: August 19, 2021
    Inventors: Yu WANG, Qi LUO, Shu JIANG, Jinghao MIAO, Jiangtao HU, Jingao WANG, Jinyun ZHOU, Jiaxuan XU
  • Publication number: 20210229678
    Abstract: Systems and methods are disclosed for collecting driving data from simulated autonomous driving vehicle (ADV) driving sessions and real-world ADV driving sessions. The driving data is processed to exclude manual (human) driving data and to exclude data corresponding to the ADV being stationary (not driving). Data can further be filtered based on driving direction: forward or reverse driving. Driving data records are time stamped. The driving data can be aligned according to the timestamp, then a standardized set of metrics is generated from the collected, filtered, and time-aligned data. The standardized set of metrics are used to grade the performance the control system of the ADV, and to generate an updated ADV controller, based on the standardized set of metrics.
    Type: Application
    Filed: January 23, 2020
    Publication date: July 29, 2021
    Inventors: Yu WANG, Qi LUO, Yu CAO, Feng Zongbao, Lin LONGTAO, Xiao XIANGQUAN, Jinghao MIAO, Jingtao HU, Jingao WANG, Shu JIANG, Jinyun ZHOU, Jiaxuan XU
  • Patent number: 11061403
    Abstract: A driving environment is perceived based on sensor data obtained from a plurality of sensors mounted on the ADV. In response to a request for changing lane from a first lane to a second lane, path planning is performed. The path planning includes identifying a first lane change point for the ADV to change from the first lane to the second lane in a first trajectory of the ADV, determining a lane change preparation distance with respect to the first lane change point, and generating a second trajectory based on the lane change preparation distance, where the second trajectory having a second lane change point delayed from the first lane change point. Speed planning is performed on the second trajectory to control the ADV to change lane according to the second trajectory with different speeds at different point in time.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: July 13, 2021
    Assignee: BAIDU USA LLC
    Inventors: Jiacheng Pan, Jiaxuan Xu, Jinyun Zhou, Hongyi Sun, Shu Jiang, Jiaming Tao, Yifei Jiang, Jiangtao Hu, Jinghao Miao
  • Publication number: 20210206397
    Abstract: In one embodiment, when an autonomous driving vehicle (ADV) is parked, the ADV can determine, based on criteria, whether to operate in an open-space mode or an on-lane mode. The criteria can include whether the ADV is within a threshold distance and threshold heading relative to a vehicle lane. If the criteria are not satisfied, then the ADV can enter the open-space mode. While in the open-space mode, the ADV can maneuver it is within the threshold distance and the threshold heading relative to the vehicle lane. In response to the criteria being satisfied, the ADV can enter and operate in the on-lane mode for the ADV to resume along the vehicle lane.
    Type: Application
    Filed: January 3, 2020
    Publication date: July 8, 2021
    Inventors: SHU JIANG, JIAMING TAO, JINYUN ZHOU, QI LUO, JINGHAO MIAO, JIANGTAO HU, JIAXUAN XU, YU WANG
  • Patent number: 11054829
    Abstract: Methods and systems for multimodal motion planning framework for autonomous driving vehicles are disclosed. In one embodiment, driving environment data of an autonomous vehicle is received, where the environment data includes a route segment. The route segment is segmented into a number of route sub-segments. A specific driving scenario is assigned to each of the route sub-segments, where each specific driving scenario is included in a set of driving scenarios. A first motion planning algorithm is assigned according to a first assigned driving scenario included in the set of driving scenarios. The first motion planning algorithm is invoked to generate a first set of trajectories. The autonomous vehicle is controlled based on the first set of trajectories.
    Type: Grant
    Filed: July 17, 2018
    Date of Patent: July 6, 2021
    Assignee: BAIDU USA LLC
    Inventors: Yajia Zhang, Dong Li, Liangliang Zhang, Kecheng Xu, Jiaming Tao, Yifei Jiang, Qi Luo, Jiangtao Hu, Jinghao Miao
  • Patent number: 11055857
    Abstract: In an embodiment, a method for representing a surrounding environment of an ego autonomous driving vehicle (ADV) is described. The method represents the surrounding environment using a first set of features from a definition (HD) map and a second set of features from a target object in the surrounding environment. The first set of features are extracted from the high definition map using a convolutional neural network (CNN), and the second set of features are handcrafted features from the target object during a predetermined number of past driving cycles of the ego ADV. The first set of features and the second set of features are concatenated and provided to a number of fully connected layers of the CNN to predict behaviors of the target object. In one embodiment, the operations in the method can be repeated for each driving cycle of the ego ADV.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: July 6, 2021
    Assignee: BAIDU USA LLC
    Inventors: Liangliang Zhang, Hongyi Sun, Dong Li, Jiangtao Hu, Jinghao Miao
  • Publication number: 20210197865
    Abstract: In one embodiment, an autonomous driving vehicle (ADV) operates in an on-lane mode, where the ADV follows a path along a vehicle lane. In response to determining that the ADV is approaching a dead-end, the ADV switches to an open-space mode. While in the open-space mode, the ADV conducts a three-point turn using a series of steering and throttle commands to generate forward and reverse movements until the ADV is within a) a threshold heading, and b) a threshold distance, relative to the vehicle lane. The ADV can then return to the on-lane mode and resume along the vehicle lane away from the dead-end.
    Type: Application
    Filed: December 26, 2019
    Publication date: July 1, 2021
    Inventors: Jinyun ZHOU, Shu JIANG, Jiaming TAO, Qi LUO, Jinghao MIAO, Jiangtao HU, Jiaxuan XU, Yu WANG
  • Publication number: 20210201504
    Abstract: A system and method for predicting the near-term trajectory of a moving obstacle sensed by an autonomous driving vehicle (ADV) is disclosed. The method applies neural networks such as a LSTM model to learn dynamic features of the moving obstacle's motion based on its past trajectory up to its current position and a CNN model to learn the semantic map features of the driving environment in a portion of an image map. From the learned dynamic features of the moving obstacle and the learned semantic map features of the environment, the method applies a neural network to iteratively predict the moving obstacle's positions for successive time points of a prediction interval. To predict the moving obstacle's position at the next time point from the currently predicted position, the methods may update the learned dynamic features of the moving obstacle based on its past trajectory up to the currently predicted position.
    Type: Application
    Filed: December 31, 2019
    Publication date: July 1, 2021
    Inventors: KECHENG XU, HONGYI SUN, JIACHENG PAN, XIANGQUAN XIAO, JIANGTAO HU, JINGHAO MIAO
  • Publication number: 20210181738
    Abstract: In one embodiment, a set of predetermined driving parameters is determined from a set of driving statistics data collected from a number of vehicles, which may be driven by human drivers. For each pair of the predetermined driving parameters, a distribution of the pair of driving parameters is plotted based on their relationship on a two-dimensional (2D) distribution space. The 2D distribution space is partitioned into a number of grid cells, each grid cell representing a particular pair of driving parameters. For each of the grid cells, a probability is calculated that the pair of driving parameter likely falls in the grid cell. A grid table is generated corresponding to the pair of driving parameters. The grid table can be utilized during the autonomous driving at real-time or during simulation to determine a ride stability of an autonomous driving vehicle (ADV) in view of the pair of driving parameters.
    Type: Application
    Filed: December 12, 2019
    Publication date: June 17, 2021
    Inventors: YIFEI JIANG, JINYUN ZHOU, JIACHENG PAN, JIAXUAN XU, HONGYI SUN, JIAMING TAO, SHU JIANG, JINGHAO MIAO, JIANGTAO HU