Patents by Inventor Shu Jiang

Shu Jiang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240005066
    Abstract: A trajectory of an obstacle is predicted by a prediction module of the ADV. A trajectory of the ADV is determined based on the trajectory of the obstacle by a planning module of the ADV. A loss function of an analysis model of the prediction module is decomposed to multiple components with multiple weightings to generate a weighted loss function based on the trajectory of the ADV. A performance of the prediction module is evaluated based on the weighted loss function to improve the performance of the prediction module to increase a safety and comfort of the ADV.
    Type: Application
    Filed: June 30, 2022
    Publication date: January 4, 2024
    Inventors: Shu JIANG, Szu Hao WU, Yu CAO, Weiman LIN, Jiangtao HU
  • Publication number: 20230406362
    Abstract: A plurality of trajectories of a plurality of obstacles are predicted, at an autonomous driving simulation platform, by a prediction module of an autonomous driving vehicle (ADV). A trajectory of the ADV is planned, at the autonomous driving simulation platform, by a planning module of the ADV based on the plurality of trajectories of the plurality of obstacles. A performance of the planning module is determined based on one or more evaluation metrics regarding the trajectory of the ADV. A performance of the prediction module is evaluated based on the performance of the planning module to improve the performance of the prediction module to deploy the prediction module to the ADV to drive autonomously.
    Type: Application
    Filed: June 15, 2022
    Publication date: December 21, 2023
    Inventors: Shu JIANG, Szu Hao WU, Yu CAO, Weiman LIN, Jiangtao HU, Ang LI
  • Publication number: 20230406345
    Abstract: The present disclosure provides methods and techniques for evaluating and improving algorithms for autonomous driving planning and control (PNC), using one or more metrics (e.g., similarity scores) computed based on expert demonstrations. For example, the one or more metrics allow for improving PNC based on human, as opposed to or in addition to optimizing certain oversimplified properties, such as the least distance or time, as an objective. When driving in certain scenarios, such as taking a turn, people may drive in a distributed probability pattern instead of in a uniform line (e.g., different speeds and different curvatures at the same corner). As such, there can be more than one “correct” control trajectory for an autonomous vehicle to perform in the same turn. Safety, comfort, speeds, and other criteria may lead to different preferences and judgment as to how well the controlled trajectory has been computed.
    Type: Application
    Filed: June 17, 2022
    Publication date: December 21, 2023
    Inventors: Szu-Hao Wu, Shu Jiang, Yu Cao, Weiman Lin, Ang Li, Jiangtao Hu
  • Publication number: 20230391356
    Abstract: According to some embodiments, systems, methods and media for dynamically generating scenario parameters for an autonomous driving vehicles (ADV) are described. In one embodiment, when an ADV enters a driving scenario, the ADV can invoke a map-based scenario checker to determine the type of scenario, and invokes a corresponding neural network model to generate a set of parameters for the scenario based on real-time environmental conditions (e.g., traffics) and vehicle status information (e.g., speed). The set of scenario parameters can be a set of extra constraints for configuring the ADV to drive in a driving mode corresponding to the scenario.
    Type: Application
    Filed: June 1, 2022
    Publication date: December 7, 2023
    Inventors: Shu JIANG, Szu Hao WU, Yu CAO, Weiman LIN, Jiangtao HU
  • Patent number: 11814073
    Abstract: In one embodiment, a control command is generated with an MPC controller, the MPC controller including a cost function with weights associated with cost terms of the cost function. The control command is applied to a dynamic model of an autonomous driving vehicle (ADV) to simulate behavior of the ADV. One or more of the weights are based on evaluation of the dynamic model in response to the control command, resulting in an adjusted cost function of the MPC controller. Another control command is generated with the MPC controller having the adjusted cost function. This second control command can be used to effect movement of the ADV.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: November 14, 2023
    Assignee: BAIDU USA LLC
    Inventors: Shu Jiang, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jinyun Zhou, Jiaming Tao, Kecheng Xu
  • Patent number: 11815891
    Abstract: A method of navigating an autonomous driving vehicle (ADV) includes determining a target function for an open space model based on one or more obstacles and map information within a proximity of the ADV, then iteratively performing first and second quadratic programming (QP) optimizations on the target function. Then, generating a second trajectory based on results of the first and second QP optimizations to control the ADV autonomously using the second trajectory. The first QP optimization is based on fixing a first set of variables of the target function. The second QP optimization is based on maximizing a sum of the distances from the ADV to each of the obstacles over a plurality of points of the first trajectory, and minimizing a difference between a target end-state of the ADV and a determined final state of the ADV using the first trajectory.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: November 14, 2023
    Assignee: BAIDU USA LLC
    Inventors: Runxin He, Yu Wang, Jinyun Zhou, Qi Luo, Jinghao Miao, Jiangtao Hu, Jingao Wang, Jiaxuan Xu, Shu Jiang
  • Patent number: 11738771
    Abstract: A simulation of an autonomous driving vehicle (ADV) includes capturing first data that includes a control command output by an autonomous vehicle controller of the ADV, and capturing second data that includes the control command being implemented at a control unit of the ADV. The control command, for example, a steering command, a braking command, or a throttle command, is implemented by the ADV to affect movement of the ADV. A latency model is determined based on comparing the first data with the second data, where the latency model defines time delay and/or amplitude difference between the first data and the second data. The latency model is applied in a virtual driving environment.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: August 29, 2023
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Shu Jiang, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jiaxuan Xu, Jinyun Zhou, Kuang Hu, Chao Ma
  • Patent number: 11740628
    Abstract: In one embodiment, control of an autonomous driving vehicle (ADV) includes determining a current scenario of the ADV. Based on the scenario, a control algorithm is selected among a plurality of distinct control algorithms as the active control algorithm. One or more control commands are generated using the active control algorithm, based one or more target inputs. The control commands are applied to effect movement of the ADV.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: August 29, 2023
    Assignee: BAIDU USA LLC
    Inventors: Shu Jiang, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jinyun Zhou, Jiaming Tao, Xiangquan Xiao
  • Patent number: 11731612
    Abstract: In one embodiment, a computer-implemented method of operating an autonomous driving vehicle (ADV) includes perceiving a driving environment surrounding the ADV based on sensor data obtained from one or more sensors mounted on the ADV, determining a driving scenario, in response to a driving decision based on the driving environment, applying a predetermined machine-learning model to data representing the driving environment and the driving scenario to generate a set of one or more driving parameters, and planning a trajectory to navigate the ADV using the set of the driving parameters according to the driving scenario through the driving environment.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: August 22, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jinyun Zhou, Runxin He, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jiaxuan Xu, Shu Jiang
  • Patent number: 11731651
    Abstract: Systems and methods are disclosed for optimizing values of a set of tunable parameters of an autonomous driving vehicle (ADV). The controllers can be a linear quadratic regular, a “bicycle model,” a model-reference adaptive controller (MRAC) that reduces actuation latency in control subsystems such as steering, braking, and throttle, or other controller (“controllers”). An optimizer selects a set tunable parameters for the controllers. A task distribution system pairs each set of parameters with each of a plurality of simulated driving scenarios, and dispatches a task to the simulator to perform the simulation with the set of parameters. Each simulation is scored. A weighted score is generated from the simulation. The optimizer uses the weighted score as a target objective for a next iteration of the optimizer, for a fixed number of iterations. A physical real-world ADV is navigated using the optimized set of parameters for the controllers in the ADV.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: August 22, 2023
    Assignee: BAIDU USA LLC
    Inventors: Weiman Lin, Yu Cao, Yu Wang, Qi Luo, Shu Jiang, Xiangquan Xiao, Longtao Lin, Jinghao Miao, Jiangtao Hu
  • Patent number: 11704554
    Abstract: In one embodiment, a method of training dynamic models for autonomous driving vehicles includes the operations of receiving a first set of training data from a training data source, the first set of training data representing driving statistics for a first set of features; training a dynamic model based on the first set of training data for the first set of features; determining a second set of features as a subset of the first set of features based on evaluating the dynamic model, each of the second set of features representing a feature whose performance score is below a predetermined threshold. The method further includes the following operations for each of the second set of features: retrieving a second set of training data associated with the corresponding feature of the second set of features, and retraining the dynamic model using the second set of training data.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: July 18, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jiaxuan Xu, Qi Luo, Runxin He, Jinyun Zhou, Jinghao Miao, Jiangtao Hu, Yu Wang, Shu Jiang
  • Publication number: 20230202469
    Abstract: An obstacle is detected based on sensor data obtained from a plurality of sensors of the ADV. Multiple trajectories of the obstacle are predicted with corresponding probabilities including a first predicted trajectory of the obstacle with a highest probability and a second predicted trajectory of the obstacle with a second highest probability. A cautionary trajectory of the ADV is planned based on at least one of a difference between the highest probability and the second highest probability or a consequence of the second trajectory. The ADV is to drive with a speed lower than a speed limit and prepare to stop in the cautionary trajectory. The ADV is controlled to drive according to the cautionary trajectory.
    Type: Application
    Filed: December 23, 2021
    Publication date: June 29, 2023
    Inventors: Shu Jiang, Yu Cao, Weiman Lin, Jiangtao Hu, Jinghao Miao
  • Publication number: 20230205951
    Abstract: According to various embodiments, described herein is a method of creating a simulation environment with multiple simulation obstacle vehicles, each with a different human-like driving style. Training datasets with different driving styles can be collected from individual human drivers, and can be combined to generate mixed datasets, each mixed dataset including only data of a particular driving style. Multiple learning-based motion planner critics can be trained using the mixed datasets, and can be used to tune multiple motion planners. Each tuned motion planner can have a different human-like driving style, and can be installed in one of multiple simulation obstacle vehicles. The simulation obstacle vehicles with different human-like driving styles can be deployed to the simulation environment to make the simulation environment more resemble a real-world driving environment.
    Type: Application
    Filed: December 23, 2021
    Publication date: June 29, 2023
    Inventors: Shu JIANG, Yu CAO, Weiman LIN, Qi LUO, Zikang XIONG, Jinghao MIAO, Jiangtao HU
  • Publication number: 20230202517
    Abstract: According to some embodiments, described herein is a method and a system for guaranteeing safety at a control level of an ADV when at least a portion of a planned path generated by a planning module of the ADV is uncertain due to traffics and/or road condition changes. The planning module, when generating a path, also generate a confidence level of each segment of the path based on one or more of perception data, map information, or traffic rules. The confidence levels are decreasing further away from the ADV. When the control module of the ADV obtains the path and the associated confidence levels, the control module issue control commands to track only one or two segments whose confidence levels exceeds a threshold hold, and issue default control commands for the rest of the path.
    Type: Application
    Filed: December 23, 2021
    Publication date: June 29, 2023
    Inventors: Shu JIANG, Weiman LIN, Yu CAO, Jiangtao HU, Jinghao MIAO
  • Publication number: 20230202516
    Abstract: An obstacle is detected based on sensor data obtained from a plurality of sensors of the ADV. A distribution of a plurality of positions of the obstacle at a point of time may be predicted. A range of positions of the plurality of positions of the obstacle may be determined based on a confidence level of the range. A modified shape with a modified length of the obstacle may be determined based on the range of positions of the obstacle. A trajectory of the ADV based on the modified shape with the modified length of the obstacle may be planned. The ADV may be controlled to drive according to the planned trajectory to drive safely to avoid a collision with the obstacle.
    Type: Application
    Filed: December 29, 2021
    Publication date: June 29, 2023
    Inventors: Shu JIANG, Yu Cao, Weiman Lin, Jiangtao Hu, Jinghao Miao
  • Patent number: 11673576
    Abstract: In one embodiment, an ADV is routed by executing a first driving scenario that is active. The first driving scenario is one of a plurality of driving scenario types, each driving scenario type being associated with one or more stages to be executed while a corresponding driving scenario type is active. Based on an environmental condition around the ADV, a second driving scenario is set as active. The ADV is routed by executing the second driving scenario. When the second driving scenario exits, execution of the first driving scenario resumes at the one or more stages of the first driving scenario that remains to be executed.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: June 13, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jiaming Tao, Qi Luo, Jinyun Zhou, Kecheng Xu, Yu Wang, Shu Jiang, Jiangtao Hu, Jinghao Miao
  • Patent number: 11673584
    Abstract: In one embodiment, a computer-implemented method for optimizing a controller of an autonomous driving vehicle (ADV) includes obtaining several samples, each sample having a set of parameters, iteratively performing, until a predetermined condition is satisfied: determining, for each sample, a score according to a configuration of the controller based on the set of parameters of the sample, applying a machine learning model to the samples and corresponding scores to determine a mean function and a variance function, producing a new sample as a minimum of a function of the mean function and the variance function with respect to an input space of the set of parameters, adding the new sample to the several samples, and outputting the new sample as an optimal sample, where parameters of the optimal sample are utilized to configure the controller to autonomously drive the ADV.
    Type: Grant
    Filed: April 15, 2020
    Date of Patent: June 13, 2023
    Assignee: BAIDU USA LLC
    Inventors: Yu Wang, Qi Luo, Jiaxuan Xu, Jinyun Zhou, Shu Jiang, Jiaming Tao, Yu Cao, Wei-Man Lin, Kecheng Xu, Jinghao Miao, Jiangtao Hu
  • Patent number: 11668637
    Abstract: A data processing method includes: collecting test data of a target rock sample in different gas adsorption experiments; the test data including pore sizes and pore volumes corresponding to the pore sizes and including at least two selected from the group consisting of the test data with pore sizes less than 3 nm in CO2 adsorption experiment, the test data with pore sizes in 1.5 nm to 250 nm in N2 adsorption experiment and the test data with pore sizes in 10 nm to 1000 ?m in high-pressure mercury adsorption experiment; and fitting the test data in overlapping ranges of the pore sizes using a least square method, and obtaining target pore volumes corresponding to the pore sizes respectively. The accuracy of joint characterization of shale pore structures can be improved by using mathematical methods to process the data in overlapping ranges of pore sizes among different characterization methods.
    Type: Grant
    Filed: September 22, 2022
    Date of Patent: June 6, 2023
    Assignees: SOUTHWEST PETROLEUM UNIVERSITY, CHINA UNIVERSITY OF GEOSCIENCES, WUHAN
    Inventors: Kun Zhang, Shu Jiang, Jun Peng, Xiaoming Zhao, Bin Li, Lei Chen, Pei Liu, Xuejiao Yuan, Fengli Han, Xueying Wang
  • Publication number: 20230159047
    Abstract: Described herein are a method of training a learning-based critic for tuning a rule-based motion planner of an autonomous driving vehicle, a method of tuning a motion planner using an automatic tuning framework that with the learning-based critic. The method includes receiving training data that incudes human driving trajectories and random trajectories derived from the human driving trajectories; training a learning-based critic using the training data; identifying a set of discrepant trajectories by comparing a first set of trajectories, and a second set of trajectories; and refining, at the neural network training platform, the learning-based critic based on the set of discrepant trajectories. The automatic tuning framework can remove human efforts in tedious parameter tuning, reduce tuning time, while retaining the physical and safety constraints of the ruled-based motion planner.
    Type: Application
    Filed: November 24, 2021
    Publication date: May 25, 2023
    Inventors: Shu JIANG, Zikang XIONG, Weiman LIN, Yu CAO, Qi LUO, Jiangtao HU, Jinghao MIAO
  • Patent number: D1001133
    Type: Grant
    Filed: November 5, 2021
    Date of Patent: October 10, 2023
    Assignee: SHENZHEN COLORII TECH LIMITED
    Inventor: Shu Jiang