Patents by Inventor Jinyun Zhou

Jinyun Zhou has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11945434
    Abstract: In one embodiment, a process is performed during controlling Autonomous Driving Vehicle (ADV). A confidence level associated with a sensed obstacle is determined. If the confidence level is below a confidence threshold, and a distance between the ADV and a potential point of contact with the sensed obstacle is below a distance threshold, then performance of a driving decision is delayed. Otherwise, the driving decision is performed to reduce risk of contact with the sensed obstacle.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: April 2, 2024
    Assignee: BAIDU USA LLC
    Inventors: Jiaming Tao, Jiaxuan Xu, Jiacheng Pan, Jinyun Zhou, Hongyi Sun, Yifei Jiang, Jiangtao Hu
  • Patent number: 11814073
    Abstract: In one embodiment, a control command is generated with an MPC controller, the MPC controller including a cost function with weights associated with cost terms of the cost function. The control command is applied to a dynamic model of an autonomous driving vehicle (ADV) to simulate behavior of the ADV. One or more of the weights are based on evaluation of the dynamic model in response to the control command, resulting in an adjusted cost function of the MPC controller. Another control command is generated with the MPC controller having the adjusted cost function. This second control command can be used to effect movement of the ADV.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: November 14, 2023
    Assignee: BAIDU USA LLC
    Inventors: Shu Jiang, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jinyun Zhou, Jiaming Tao, Kecheng Xu
  • Patent number: 11815891
    Abstract: A method of navigating an autonomous driving vehicle (ADV) includes determining a target function for an open space model based on one or more obstacles and map information within a proximity of the ADV, then iteratively performing first and second quadratic programming (QP) optimizations on the target function. Then, generating a second trajectory based on results of the first and second QP optimizations to control the ADV autonomously using the second trajectory. The first QP optimization is based on fixing a first set of variables of the target function. The second QP optimization is based on maximizing a sum of the distances from the ADV to each of the obstacles over a plurality of points of the first trajectory, and minimizing a difference between a target end-state of the ADV and a determined final state of the ADV using the first trajectory.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: November 14, 2023
    Assignee: BAIDU USA LLC
    Inventors: Runxin He, Yu Wang, Jinyun Zhou, Qi Luo, Jinghao Miao, Jiangtao Hu, Jingao Wang, Jiaxuan Xu, Shu Jiang
  • Patent number: 11738771
    Abstract: A simulation of an autonomous driving vehicle (ADV) includes capturing first data that includes a control command output by an autonomous vehicle controller of the ADV, and capturing second data that includes the control command being implemented at a control unit of the ADV. The control command, for example, a steering command, a braking command, or a throttle command, is implemented by the ADV to affect movement of the ADV. A latency model is determined based on comparing the first data with the second data, where the latency model defines time delay and/or amplitude difference between the first data and the second data. The latency model is applied in a virtual driving environment.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: August 29, 2023
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Shu Jiang, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jiaxuan Xu, Jinyun Zhou, Kuang Hu, Chao Ma
  • Patent number: 11740628
    Abstract: In one embodiment, control of an autonomous driving vehicle (ADV) includes determining a current scenario of the ADV. Based on the scenario, a control algorithm is selected among a plurality of distinct control algorithms as the active control algorithm. One or more control commands are generated using the active control algorithm, based one or more target inputs. The control commands are applied to effect movement of the ADV.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: August 29, 2023
    Assignee: BAIDU USA LLC
    Inventors: Shu Jiang, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jinyun Zhou, Jiaming Tao, Xiangquan Xiao
  • Patent number: 11731612
    Abstract: In one embodiment, a computer-implemented method of operating an autonomous driving vehicle (ADV) includes perceiving a driving environment surrounding the ADV based on sensor data obtained from one or more sensors mounted on the ADV, determining a driving scenario, in response to a driving decision based on the driving environment, applying a predetermined machine-learning model to data representing the driving environment and the driving scenario to generate a set of one or more driving parameters, and planning a trajectory to navigate the ADV using the set of the driving parameters according to the driving scenario through the driving environment.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: August 22, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jinyun Zhou, Runxin He, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jiaxuan Xu, Shu Jiang
  • Patent number: 11704554
    Abstract: In one embodiment, a method of training dynamic models for autonomous driving vehicles includes the operations of receiving a first set of training data from a training data source, the first set of training data representing driving statistics for a first set of features; training a dynamic model based on the first set of training data for the first set of features; determining a second set of features as a subset of the first set of features based on evaluating the dynamic model, each of the second set of features representing a feature whose performance score is below a predetermined threshold. The method further includes the following operations for each of the second set of features: retrieving a second set of training data associated with the corresponding feature of the second set of features, and retraining the dynamic model using the second set of training data.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: July 18, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jiaxuan Xu, Qi Luo, Runxin He, Jinyun Zhou, Jinghao Miao, Jiangtao Hu, Yu Wang, Shu Jiang
  • Patent number: 11673576
    Abstract: In one embodiment, an ADV is routed by executing a first driving scenario that is active. The first driving scenario is one of a plurality of driving scenario types, each driving scenario type being associated with one or more stages to be executed while a corresponding driving scenario type is active. Based on an environmental condition around the ADV, a second driving scenario is set as active. The ADV is routed by executing the second driving scenario. When the second driving scenario exits, execution of the first driving scenario resumes at the one or more stages of the first driving scenario that remains to be executed.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: June 13, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jiaming Tao, Qi Luo, Jinyun Zhou, Kecheng Xu, Yu Wang, Shu Jiang, Jiangtao Hu, Jinghao Miao
  • Patent number: 11673584
    Abstract: In one embodiment, a computer-implemented method for optimizing a controller of an autonomous driving vehicle (ADV) includes obtaining several samples, each sample having a set of parameters, iteratively performing, until a predetermined condition is satisfied: determining, for each sample, a score according to a configuration of the controller based on the set of parameters of the sample, applying a machine learning model to the samples and corresponding scores to determine a mean function and a variance function, producing a new sample as a minimum of a function of the mean function and the variance function with respect to an input space of the set of parameters, adding the new sample to the several samples, and outputting the new sample as an optimal sample, where parameters of the optimal sample are utilized to configure the controller to autonomously drive the ADV.
    Type: Grant
    Filed: April 15, 2020
    Date of Patent: June 13, 2023
    Assignee: BAIDU USA LLC
    Inventors: Yu Wang, Qi Luo, Jiaxuan Xu, Jinyun Zhou, Shu Jiang, Jiaming Tao, Yu Cao, Wei-Man Lin, Kecheng Xu, Jinghao Miao, Jiangtao Hu
  • Patent number: 11656627
    Abstract: In one embodiment, a method determines a route from a first location of an autonomous driving vehicle (ADV) to a second location within an open space, the first location being a current location of the ADV. The method determines an objective function based on the route, the objective function having a set of costs for maneuvering the ADV from the first location to the second location. The method determines environmental conditions of the open space and uses the environmental conditions to determine a set of weights, each weight to be applied to a corresponding cost of the objective function. The method optimizes the objective function in view of one or more constraints, such that an output of the objective function reaches minimum while the one or more constraints are satisfied and generates a path trajectory with the optimized objective function to control the ADV autonomously according to the path trajectory.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: May 23, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jinyun Zhou, Qi Luo, Shu Jiang, Jiaming Tao, Yu Wang, Jiaxuan Xu, Kecheng Xu, Jinghao Miao, Jiangtao Hu
  • Patent number: 11628858
    Abstract: In one embodiment, a system/method generates a driving trajectory for an autonomous driving vehicle (ADV). The system perceives an environment of an autonomous driving vehicle (ADV). The system determines one or more bounding conditions based on the perceived environment. The system generates a first trajectory using a neural network model, wherein the neural network model is trained to generate a driving trajectory. The system evaluates/determines if the first trajectory satisfies the one or more bounding conditions. If the first trajectory satisfies the one or more bounding conditions, the system controls the ADV autonomously according to the first trajectory. Otherwise, the system controls the ADV autonomously according to a second trajectory, where the second trajectory is generated based on an objective function, where the objective function is determined based on at least the one or more bounding conditions.
    Type: Grant
    Filed: September 15, 2020
    Date of Patent: April 18, 2023
    Assignee: BAIDU USA LLC
    Inventors: Yifei Jiang, Jinyun Zhou, Jiaming Tao, Shu Jiang, Jiangtao Hu, Jinghao Miao, Shiyu Song
  • Patent number: 11609576
    Abstract: In one embodiment, a process is performed during controlling Autonomous Driving Vehicle (ADV). Microphone signals sense sounds in an environment of the ADV. The microphone signals are combined and filtered to form an audio signal having the sounds sensed in the environment of the ADV. A neural network is applied to the audio signal to detect a presence of an audio signature of an emergency vehicle siren. If the siren is detected, a change in the audio signature to make a determination as to whether the emergency vehicle siren is a) moving towards the ADV, or b) not moving towards the ADV. The ADV can make a driving decision, such as slowing down, stopping, and/or steering to a side, based on if the emergency vehicle siren is moving towards the ADV.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: March 21, 2023
    Assignee: BAIDU USA LLC
    Inventors: Qi Luo, Kecheng Xu, Jinyun Zhou, Xiangquan Xiao, Shuo Huang, Jiangtao Hu, Jinghao Miao
  • Publication number: 20230060005
    Abstract: The present disclosure provides a method and device for predicting a motion track of an obstacle and an autonomous vehicle, and relates to the technical field of autonomous driving, so as to at least solve the technical problem of low prediction precision of a motion track of an obstacle in an interaction scene. A specific implementation solution includes: environment information in a target scene, historical state information of a target obstacle and track planning information of a target vehicle are obtained, and the target obstacle is a potential interaction object of the target vehicle; and a motion track of the target obstacle is predicted based on the environment information, the historical state information and the track planning information.
    Type: Application
    Filed: May 17, 2022
    Publication date: February 23, 2023
    Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.
    Inventors: Jianan JIANG, Xu LIU, Jinyun ZHOU, Fangfang DONG, Guowei WAN
  • Patent number: 11586209
    Abstract: In one embodiment, method performed by an autonomous driving vehicle (ADV) that determines, within a driving space, a plurality of routes from a current location of the ADV to a desired location. The method determines, for each route of the plurality of routes, an objective function to control the ADV autonomously along the route and, for each of the objective functions, performs Differential Dynamic Programming (DDP) optimization in view of a set of constraints to produce a path trajectory. The method determines whether at least one of the path trajectories satisfies each constraint and, in response to a path trajectory satisfying each of the constraints, selects the path trajectory for navigating the ADV from the current location to the desired location.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: February 21, 2023
    Assignee: BAIDU USA LLC
    Inventors: Qi Luo, Jinyun Zhou, Shu Jiang, Jiaming Tao, Yu Wang, Jiaxuan Xu, Kecheng Xu, Jinghao Miao, Jiangtao Hu
  • Patent number: 11577758
    Abstract: In one embodiment, when an autonomous driving vehicle (ADV) is parked, the ADV can determine, based on criteria, whether to operate in an open-space mode or an on-lane mode. The criteria can include whether the ADV is within a threshold distance and threshold heading relative to a vehicle lane. If the criteria are not satisfied, then the ADV can enter the open-space mode. While in the open-space mode, the ADV can maneuver it is within the threshold distance and the threshold heading relative to the vehicle lane. In response to the criteria being satisfied, the ADV can enter and operate in the on-lane mode for the ADV to resume along the vehicle lane.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: February 14, 2023
    Assignee: BAIDU USA LLC
    Inventors: Shu Jiang, Jiaming Tao, Jinyun Zhou, Qi Luo, Jinghao Miao, Jiangtao Hu, Jiaxuan Xu, Yu Wang
  • Patent number: 11560159
    Abstract: In one embodiment, a plurality of obstacles is sensed in an environment of an automated driving vehicle (ADV). One or more representations are formed to represent corresponding groupings of the plurality of obstacles. A vehicle route is determined in view of the one or more representations, rather than each and every one of the obstacles individually.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: January 24, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jiaming Tao, Qi Luo, Jinyun Zhou, Kecheng Xu, Yu Wang, Shu Jiang, Jiangtao Hu, Jinghao Miao
  • Patent number: 11518404
    Abstract: In one embodiment, static-state curvature error compensation control logic for autonomous driving vehicles (ADV) receives planning and control data associated with the ADV, including a planned steering angle and a planned speed. A steering command is generated based on a current steering angle and the planned steering angle of the ADV. A throttle command is generated based on the planned speed in view of a current speed of the ADV. A curvature error is calculated based on a difference between the current steering angle and the planned steering angle. The steering command is issued to the ADV while withholding the throttle command, in response to determining that the curvature error is greater than a predetermined curvature threshold, such that the steering angle of the ADV is adjusted in view of the planned steering angle without acceleration.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: December 6, 2022
    Assignee: BAIDU USA LLC
    Inventors: Yu Wang, Qi Luo, Jinyun Zhou, Shu Jiang, Jiaxuan Xu, Jinghao Miao, Jiangtao Hu
  • Patent number: 11511760
    Abstract: Systems and methods are disclosed for collecting driving data from simulated autonomous driving vehicle (ADV) driving sessions and real-world ADV driving sessions. The driving data is processed to exclude manual (human) driving data and to exclude data corresponding to the ADV being stationary (not driving). Data can further be filtered based on driving direction: forward or reverse driving. Driving data records are time stamped. The driving data can be aligned according to the timestamp, then a standardized set of metrics is generated from the collected, filtered, and time-aligned data. The standardized set of metrics are used to grade the performance the control system of the ADV, and to generate an updated ADV controller, based on the standardized set of metrics.
    Type: Grant
    Filed: January 23, 2020
    Date of Patent: November 29, 2022
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Yu Wang, Qi Luo, Yu Cao, Zongbao Feng, Longtao Lin, Xiangquan Xiao, Jinghao Miao, Jiangtao Hu, Jingao Wang, Shu Jiang, Jinyun Zhou, Jiaxuan Xu
  • Patent number: 11493926
    Abstract: In one embodiment, a system generates a plurality of driving scenarios to train a reinforcement learning (RL) agent and replays each of the driving scenarios to train the RL agent by: applying a RL algorithm to an initial state of a driving scenario to determine a number of control actions from a number of discretized control/action options for the ADV to advance to a number of trajectory states which are based on a number of discretized trajectory state options, determining a reward prediction by the RL algorithm for each of the controls/actions, determining a judgment score for the trajectory states, and updating the RL agent based on the judgment score.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: November 8, 2022
    Assignee: BAIDU USA LLC
    Inventors: Runxin He, Jinyun Zhou, Qi Luo, Shiyu Song, Jinghao Miao, Jiangtao Hu, Yu Wang, Jiaxuan Xu, Shu Jiang
  • Patent number: 11492008
    Abstract: Systems and methods are disclosed for reducing second order dynamics delays in a control subsystem (e.g. throttle, braking, or steering) in an autonomous driving vehicle (ADV). A control input is received from an ADV perception and planning system. The control input is translated in a control command to a control subsystem of the ADV. A reference actuation output is obtained from a storage of the ADV. The reference actuation output is a smoothed output that accounts for second order actuation dynamic delays attributable to the control subsystem actuator. Based on a difference between the control input and the reference actuation output, adaptive gains are determined and applied to the input control signal to reduce error between the control output and the reference actuation output.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: November 8, 2022
    Assignee: BAIDU USA LLC
    Inventors: Yu Wang, Qi Luo, Shu Jiang, Jinghao Miao, Jiangtao Hu, Jingao Wang, Jinyun Zhou, Jiaxuan Xu