Patents by Inventor Shu Jiang

Shu Jiang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11738771
    Abstract: A simulation of an autonomous driving vehicle (ADV) includes capturing first data that includes a control command output by an autonomous vehicle controller of the ADV, and capturing second data that includes the control command being implemented at a control unit of the ADV. The control command, for example, a steering command, a braking command, or a throttle command, is implemented by the ADV to affect movement of the ADV. A latency model is determined based on comparing the first data with the second data, where the latency model defines time delay and/or amplitude difference between the first data and the second data. The latency model is applied in a virtual driving environment.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: August 29, 2023
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Shu Jiang, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jiaxuan Xu, Jinyun Zhou, Kuang Hu, Chao Ma
  • Patent number: 11740628
    Abstract: In one embodiment, control of an autonomous driving vehicle (ADV) includes determining a current scenario of the ADV. Based on the scenario, a control algorithm is selected among a plurality of distinct control algorithms as the active control algorithm. One or more control commands are generated using the active control algorithm, based one or more target inputs. The control commands are applied to effect movement of the ADV.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: August 29, 2023
    Assignee: BAIDU USA LLC
    Inventors: Shu Jiang, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jinyun Zhou, Jiaming Tao, Xiangquan Xiao
  • Patent number: 11731612
    Abstract: In one embodiment, a computer-implemented method of operating an autonomous driving vehicle (ADV) includes perceiving a driving environment surrounding the ADV based on sensor data obtained from one or more sensors mounted on the ADV, determining a driving scenario, in response to a driving decision based on the driving environment, applying a predetermined machine-learning model to data representing the driving environment and the driving scenario to generate a set of one or more driving parameters, and planning a trajectory to navigate the ADV using the set of the driving parameters according to the driving scenario through the driving environment.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: August 22, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jinyun Zhou, Runxin He, Qi Luo, Jinghao Miao, Jiangtao Hu, Yu Wang, Jiaxuan Xu, Shu Jiang
  • Patent number: 11731651
    Abstract: Systems and methods are disclosed for optimizing values of a set of tunable parameters of an autonomous driving vehicle (ADV). The controllers can be a linear quadratic regular, a “bicycle model,” a model-reference adaptive controller (MRAC) that reduces actuation latency in control subsystems such as steering, braking, and throttle, or other controller (“controllers”). An optimizer selects a set tunable parameters for the controllers. A task distribution system pairs each set of parameters with each of a plurality of simulated driving scenarios, and dispatches a task to the simulator to perform the simulation with the set of parameters. Each simulation is scored. A weighted score is generated from the simulation. The optimizer uses the weighted score as a target objective for a next iteration of the optimizer, for a fixed number of iterations. A physical real-world ADV is navigated using the optimized set of parameters for the controllers in the ADV.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: August 22, 2023
    Assignee: BAIDU USA LLC
    Inventors: Weiman Lin, Yu Cao, Yu Wang, Qi Luo, Shu Jiang, Xiangquan Xiao, Longtao Lin, Jinghao Miao, Jiangtao Hu
  • Patent number: 11704554
    Abstract: In one embodiment, a method of training dynamic models for autonomous driving vehicles includes the operations of receiving a first set of training data from a training data source, the first set of training data representing driving statistics for a first set of features; training a dynamic model based on the first set of training data for the first set of features; determining a second set of features as a subset of the first set of features based on evaluating the dynamic model, each of the second set of features representing a feature whose performance score is below a predetermined threshold. The method further includes the following operations for each of the second set of features: retrieving a second set of training data associated with the corresponding feature of the second set of features, and retraining the dynamic model using the second set of training data.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: July 18, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jiaxuan Xu, Qi Luo, Runxin He, Jinyun Zhou, Jinghao Miao, Jiangtao Hu, Yu Wang, Shu Jiang
  • Publication number: 20230202516
    Abstract: An obstacle is detected based on sensor data obtained from a plurality of sensors of the ADV. A distribution of a plurality of positions of the obstacle at a point of time may be predicted. A range of positions of the plurality of positions of the obstacle may be determined based on a confidence level of the range. A modified shape with a modified length of the obstacle may be determined based on the range of positions of the obstacle. A trajectory of the ADV based on the modified shape with the modified length of the obstacle may be planned. The ADV may be controlled to drive according to the planned trajectory to drive safely to avoid a collision with the obstacle.
    Type: Application
    Filed: December 29, 2021
    Publication date: June 29, 2023
    Inventors: Shu JIANG, Yu Cao, Weiman Lin, Jiangtao Hu, Jinghao Miao
  • Publication number: 20230205951
    Abstract: According to various embodiments, described herein is a method of creating a simulation environment with multiple simulation obstacle vehicles, each with a different human-like driving style. Training datasets with different driving styles can be collected from individual human drivers, and can be combined to generate mixed datasets, each mixed dataset including only data of a particular driving style. Multiple learning-based motion planner critics can be trained using the mixed datasets, and can be used to tune multiple motion planners. Each tuned motion planner can have a different human-like driving style, and can be installed in one of multiple simulation obstacle vehicles. The simulation obstacle vehicles with different human-like driving styles can be deployed to the simulation environment to make the simulation environment more resemble a real-world driving environment.
    Type: Application
    Filed: December 23, 2021
    Publication date: June 29, 2023
    Inventors: Shu JIANG, Yu CAO, Weiman LIN, Qi LUO, Zikang XIONG, Jinghao MIAO, Jiangtao HU
  • Publication number: 20230202469
    Abstract: An obstacle is detected based on sensor data obtained from a plurality of sensors of the ADV. Multiple trajectories of the obstacle are predicted with corresponding probabilities including a first predicted trajectory of the obstacle with a highest probability and a second predicted trajectory of the obstacle with a second highest probability. A cautionary trajectory of the ADV is planned based on at least one of a difference between the highest probability and the second highest probability or a consequence of the second trajectory. The ADV is to drive with a speed lower than a speed limit and prepare to stop in the cautionary trajectory. The ADV is controlled to drive according to the cautionary trajectory.
    Type: Application
    Filed: December 23, 2021
    Publication date: June 29, 2023
    Inventors: Shu Jiang, Yu Cao, Weiman Lin, Jiangtao Hu, Jinghao Miao
  • Publication number: 20230202517
    Abstract: According to some embodiments, described herein is a method and a system for guaranteeing safety at a control level of an ADV when at least a portion of a planned path generated by a planning module of the ADV is uncertain due to traffics and/or road condition changes. The planning module, when generating a path, also generate a confidence level of each segment of the path based on one or more of perception data, map information, or traffic rules. The confidence levels are decreasing further away from the ADV. When the control module of the ADV obtains the path and the associated confidence levels, the control module issue control commands to track only one or two segments whose confidence levels exceeds a threshold hold, and issue default control commands for the rest of the path.
    Type: Application
    Filed: December 23, 2021
    Publication date: June 29, 2023
    Inventors: Shu JIANG, Weiman LIN, Yu CAO, Jiangtao HU, Jinghao MIAO
  • Patent number: 11673576
    Abstract: In one embodiment, an ADV is routed by executing a first driving scenario that is active. The first driving scenario is one of a plurality of driving scenario types, each driving scenario type being associated with one or more stages to be executed while a corresponding driving scenario type is active. Based on an environmental condition around the ADV, a second driving scenario is set as active. The ADV is routed by executing the second driving scenario. When the second driving scenario exits, execution of the first driving scenario resumes at the one or more stages of the first driving scenario that remains to be executed.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: June 13, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jiaming Tao, Qi Luo, Jinyun Zhou, Kecheng Xu, Yu Wang, Shu Jiang, Jiangtao Hu, Jinghao Miao
  • Patent number: 11673584
    Abstract: In one embodiment, a computer-implemented method for optimizing a controller of an autonomous driving vehicle (ADV) includes obtaining several samples, each sample having a set of parameters, iteratively performing, until a predetermined condition is satisfied: determining, for each sample, a score according to a configuration of the controller based on the set of parameters of the sample, applying a machine learning model to the samples and corresponding scores to determine a mean function and a variance function, producing a new sample as a minimum of a function of the mean function and the variance function with respect to an input space of the set of parameters, adding the new sample to the several samples, and outputting the new sample as an optimal sample, where parameters of the optimal sample are utilized to configure the controller to autonomously drive the ADV.
    Type: Grant
    Filed: April 15, 2020
    Date of Patent: June 13, 2023
    Assignee: BAIDU USA LLC
    Inventors: Yu Wang, Qi Luo, Jiaxuan Xu, Jinyun Zhou, Shu Jiang, Jiaming Tao, Yu Cao, Wei-Man Lin, Kecheng Xu, Jinghao Miao, Jiangtao Hu
  • Patent number: 11668637
    Abstract: A data processing method includes: collecting test data of a target rock sample in different gas adsorption experiments; the test data including pore sizes and pore volumes corresponding to the pore sizes and including at least two selected from the group consisting of the test data with pore sizes less than 3 nm in CO2 adsorption experiment, the test data with pore sizes in 1.5 nm to 250 nm in N2 adsorption experiment and the test data with pore sizes in 10 nm to 1000 ?m in high-pressure mercury adsorption experiment; and fitting the test data in overlapping ranges of the pore sizes using a least square method, and obtaining target pore volumes corresponding to the pore sizes respectively. The accuracy of joint characterization of shale pore structures can be improved by using mathematical methods to process the data in overlapping ranges of pore sizes among different characterization methods.
    Type: Grant
    Filed: September 22, 2022
    Date of Patent: June 6, 2023
    Assignees: SOUTHWEST PETROLEUM UNIVERSITY, CHINA UNIVERSITY OF GEOSCIENCES, WUHAN
    Inventors: Kun Zhang, Shu Jiang, Jun Peng, Xiaoming Zhao, Bin Li, Lei Chen, Pei Liu, Xuejiao Yuan, Fengli Han, Xueying Wang
  • Publication number: 20230159047
    Abstract: Described herein are a method of training a learning-based critic for tuning a rule-based motion planner of an autonomous driving vehicle, a method of tuning a motion planner using an automatic tuning framework that with the learning-based critic. The method includes receiving training data that incudes human driving trajectories and random trajectories derived from the human driving trajectories; training a learning-based critic using the training data; identifying a set of discrepant trajectories by comparing a first set of trajectories, and a second set of trajectories; and refining, at the neural network training platform, the learning-based critic based on the set of discrepant trajectories. The automatic tuning framework can remove human efforts in tedious parameter tuning, reduce tuning time, while retaining the physical and safety constraints of the ruled-based motion planner.
    Type: Application
    Filed: November 24, 2021
    Publication date: May 25, 2023
    Inventors: Shu JIANG, Zikang XIONG, Weiman LIN, Yu CAO, Qi LUO, Jiangtao HU, Jinghao MIAO
  • Patent number: 11656627
    Abstract: In one embodiment, a method determines a route from a first location of an autonomous driving vehicle (ADV) to a second location within an open space, the first location being a current location of the ADV. The method determines an objective function based on the route, the objective function having a set of costs for maneuvering the ADV from the first location to the second location. The method determines environmental conditions of the open space and uses the environmental conditions to determine a set of weights, each weight to be applied to a corresponding cost of the objective function. The method optimizes the objective function in view of one or more constraints, such that an output of the objective function reaches minimum while the one or more constraints are satisfied and generates a path trajectory with the optimized objective function to control the ADV autonomously according to the path trajectory.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: May 23, 2023
    Assignee: BAIDU USA LLC
    Inventors: Jinyun Zhou, Qi Luo, Shu Jiang, Jiaming Tao, Yu Wang, Jiaxuan Xu, Kecheng Xu, Jinghao Miao, Jiangtao Hu
  • Patent number: 11628858
    Abstract: In one embodiment, a system/method generates a driving trajectory for an autonomous driving vehicle (ADV). The system perceives an environment of an autonomous driving vehicle (ADV). The system determines one or more bounding conditions based on the perceived environment. The system generates a first trajectory using a neural network model, wherein the neural network model is trained to generate a driving trajectory. The system evaluates/determines if the first trajectory satisfies the one or more bounding conditions. If the first trajectory satisfies the one or more bounding conditions, the system controls the ADV autonomously according to the first trajectory. Otherwise, the system controls the ADV autonomously according to a second trajectory, where the second trajectory is generated based on an objective function, where the objective function is determined based on at least the one or more bounding conditions.
    Type: Grant
    Filed: September 15, 2020
    Date of Patent: April 18, 2023
    Assignee: BAIDU USA LLC
    Inventors: Yifei Jiang, Jinyun Zhou, Jiaming Tao, Shu Jiang, Jiangtao Hu, Jinghao Miao, Shiyu Song
  • Publication number: 20230096906
    Abstract: A data processing method includes: collecting test data of a target rock sample in different gas adsorption experiments; the test data including pore sizes and pore volumes corresponding to the pore sizes and including at least two selected from the group consisting of the test data with pore sizes less than 3 nm in CO2 adsorption experiment, the test data with pore sizes in 1.5 nm to 250 nm in N2 adsorption experiment and the test data with pore sizes in 10 nm to 1000 ?m in high-pressure mercury adsorption experiment; and fitting the test data in overlapping ranges of the pore sizes using a least square method, and obtaining target pore volumes corresponding to the pore sizes respectively. The accuracy of joint characterization of shale pore structures can be improved by using mathematical methods to process the data in overlapping ranges of pore sizes among different characterization methods.
    Type: Application
    Filed: September 22, 2022
    Publication date: March 30, 2023
    Inventors: Kun Zhang, Shu Jiang, Jun Peng, Xiaoming Zhao, Bin Li, Lei Chen, Pei Liu, Xuejiao Yuan, Fengli Han, Xueying Wang
  • Publication number: 20230067822
    Abstract: In one embodiment, an exemplary method includes receiving, at a simulation platform, a record file recorded by a manually-driving ADV on a road segment, the simulation platform including a first encoder, a second encoder, and a performance evaluator; simulating automatic driving operations of a dynamic model of the ADV on the road segment based on the record file, the dynamic model including an autonomous driving module to be evaluated. The method further includes: for each trajectory generated by the autonomous driving module during the simulation: extracting a corresponding trajectory associated with the manually-driving ADV from the record file, encoding the trajectory into a first semantic map and the corresponding trajectory into a second semantic map, and generating a similarity score based on the first semantic map and the second semantic map. The method also includes generating an overall performance score based on each similarity score.
    Type: Application
    Filed: September 1, 2021
    Publication date: March 2, 2023
    Inventors: Shu JIANG, Weiman LIN, Yu CAO, Yu WANG, Kecheng XU, Hongyi SUN, Jiaming TAO, Qi LUO, Jiangtao HU, Jinghao MIAO
  • Publication number: 20230060776
    Abstract: Embodiments of the invention are intended to evaluate the performance of a planning module of the ADV in terms of decision consistency in addition to other metrics, such as comfort, latency, controllability, and safety. In one embodiment, an exemplary method includes receiving, at an autonomous driving simulation platform, a record file recorded by the ADV that was automatically driving on a road segment; simulating operations of a dynamic model of the ADV in the autonomous driving simulation platform during one or more driving scenarios on the road segment based on the record file. The method further includes performing a comparison between each planned trajectory generated by a planning module of the dynamic model after an initial period of time with each trajectory stored in a buffer; and modifying a performance score generated by a planning performance profiler in the autonomous driving simulation platform based on a result of the comparison.
    Type: Application
    Filed: September 1, 2021
    Publication date: March 2, 2023
    Inventors: Shu JIANG, Weiman LIN, Yu CAO, Yu WANG, Qi LUO, Jiangtao HU, Jinghao MIAO
  • Publication number: 20230065284
    Abstract: Systems, methods, and media for factoring localization uncertainty of an ADV into its planning and control process to increase the safety of the ADV. The uncertainty of the localization can be caused by sensor inaccuracy, map matching algorithm inaccuracy, and/or speed uncertainty. The localization uncertainty can have negative impact on trajectory planning and vehicle control. Embodiments described herein are intended to increase the safety of the ADV by considering localization uncertainty in trajectory planning and vehicle control. An exemplary method includes determining a confidence region for an ADV that is automatically driving on a road segment based on localization uncertainty and speed uncertainty; determining that an object is within the confidence region, and a probability of collision with the ADV based on a distance of the object to the ADV; and planning a trajectory based on the probability of collision, and controlling the ADV based on the probability of collision.
    Type: Application
    Filed: September 1, 2021
    Publication date: March 2, 2023
    Inventors: Shu JIANG, Weiman LIN, Yu CAO, Yu WANG, Qi LUO, Jiangtao HU, Jinghao MIAO
  • Patent number: 11586209
    Abstract: In one embodiment, method performed by an autonomous driving vehicle (ADV) that determines, within a driving space, a plurality of routes from a current location of the ADV to a desired location. The method determines, for each route of the plurality of routes, an objective function to control the ADV autonomously along the route and, for each of the objective functions, performs Differential Dynamic Programming (DDP) optimization in view of a set of constraints to produce a path trajectory. The method determines whether at least one of the path trajectories satisfies each constraint and, in response to a path trajectory satisfying each of the constraints, selects the path trajectory for navigating the ADV from the current location to the desired location.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: February 21, 2023
    Assignee: BAIDU USA LLC
    Inventors: Qi Luo, Jinyun Zhou, Shu Jiang, Jiaming Tao, Yu Wang, Jiaxuan Xu, Kecheng Xu, Jinghao Miao, Jiangtao Hu