Patents by Inventor Yajia ZHANG

Yajia ZHANG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210004010
    Abstract: According to one embodiment, during a first planning cycle, a first lane boundary of a driving environment perceived by an ADV is determined using a first lane boundary determination scheme (e.g., current lane boundary), which has been designated as a current lane boundary determination scheme. A first trajectory is planned based on the first lane boundary to drive the ADV to navigate through the driving environment. The first trajectory is evaluated against a predetermined set of safety rules (e.g., whether it will collide or get too close to an object) to avoid a collision with an object detected in the driving environment. In response to determining that the first trajectory fails to satisfy the safety rules, a second lane determination boundary of the driving environment is determined using a second lane boundary determination scheme and a second trajectory is planned based on the second lane boundary to drive the ADV.
    Type: Application
    Filed: July 1, 2019
    Publication date: January 7, 2021
    Inventors: Jiacheng PAN, Yifei JIANG, Yajia ZHANG, Jiaming TAO, Jiangtao HU
  • Patent number: 10884422
    Abstract: In one embodiment, in response to detecting an obstacle based on a driving environment surrounding an autonomous driving vehicle (ADV), a system projects the obstacle onto a station-time (ST) graph, where the ST graph indicates a location of the obstacle relative to a current location of the ADV at different points in time. The system determines a first set of end points that are not overlapped with the obstacle within the ST graph, wherein each of the end points in the first set represents a possible end condition. The system generates a first set of trajectory candidates between a starting point representing the current location of the ADV and the end points of the first set based on the ST graph. The system selects one of the trajectory candidates in the first set using a predetermined trajectory selection algorithm to control the ADV in view of the obstacle.
    Type: Grant
    Filed: April 16, 2018
    Date of Patent: January 5, 2021
    Assignee: BAIDU USA LLC
    Inventors: Yajia Zhang, Kecheng Xu
  • Publication number: 20200379474
    Abstract: In one embodiment, a method is provided. The method includes determining a first reference line representing a path through an environment for an autonomous driving vehicle. The method also includes determining a speed constraint function based on a set of speed limits associated with the environment, a set of curvatures of the path, and a set of obstacles in the environment, wherein the speed constraint function comprises a continuous function. The method further includes determining a set of speeds for the path through the environment based on the speed constraint function. The method further includes controlling the autonomous driving vehicle based on the path and the set of speeds.
    Type: Application
    Filed: May 28, 2019
    Publication date: December 3, 2020
    Inventor: Yajia Zhang
  • Publication number: 20200353920
    Abstract: A moving object such as a vehicle is identified within an intersection having multiple exits. The moving object and the intersection and its exits may be identified based on sensor data obtained from various sensors mounted on an ADV. An exit coordinate map is generated based on the orientation of the moving object and a relative position of each of the exits of the intersection with respect to the current position of the moving object. For each of the exits, an exit probability of the exit that the moving object likely exits the intersection using the exit coordinate map. Thereafter, a trajectory of the ADV is planned to navigate through the intersection to avoid the collision with the moving object based on the exit probabilities of the exits of the intersection. The above process is iteratively performed for each of the moving objects detected within the proximity of the intersection.
    Type: Application
    Filed: May 7, 2019
    Publication date: November 12, 2020
    Inventors: HONGYI SUN, JIACHENG PAN, KECHENG XU, YAJIA ZHANG, JINGHAO MIAO
  • Publication number: 20200348684
    Abstract: In one embodiment, a method of generating a path for an autonomous driving vehicle (ADV) is disclosed. The method includes obtaining a plurality of path inputs including a lateral starting state for an autonomous driving vehicle (ADV), a longitudinal starting state for the ADV, a threshold lateral jerk, and a set of static obstacle boundaries with respect to a reference line. The method also includes obtaining a plurality of path constraints including a first constraint related to the threshold lateral jerk, a second constraint related to avoidance of one or more static obstacles, and a third constraint related to a threshold lateral velocity. The method further includes obtaining a cost function associated with a path objective, the cost function comprising a first term relating to cumulative lateral distances, a second term relating to cumulative first order lateral rates of change, and a third term relating to cumulative second order lateral rates of change.
    Type: Application
    Filed: April 30, 2019
    Publication date: November 5, 2020
    Inventor: Yajia Zhang
  • Patent number: 10823575
    Abstract: A first reference line representing a routing line from a first location to a second location associated with an autonomous driving vehicle (ADV) is received. The first reference line is segmented into a number of reference line segments. For each of the reference line segments, a quintic polynomial function is defined to represent the reference line segment. An objective function is determined based on the quintic polynomial functions of the reference line segments. An optimization is performed on coefficients of the quintic polynomial functions in view of a set of constraints associated with the reference line segments, such that an output of the objective function reaches minimum while the constraints are satisfied. A second reference line is then generated based on the optimized parameters or coefficients of the quintic polynomial functions of the objective function. The second reference line is then utilized to plan and control the ADV.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: November 3, 2020
    Assignee: BAIDU USA LLC
    Inventor: Yajia Zhang
  • Publication number: 20200339116
    Abstract: In response to perceiving a moving object, one or more possible object paths of the moving object are determined based on the prior movement predictions of the moving object, for example, using a machine-learning model, which may be created based on a large amount of driving statistics of different vehicles. For each of the possible object paths, a set of trajectory candidates is generated based on a set of predetermined accelerations. Each of the trajectory candidates corresponds to one of the predetermined accelerations. A trajectory cost is calculated for each of the trajectory candidates using a predetermined cost function. One of the trajectory candidates having the lowest trajectory cost amongst the trajectory candidates is selected. An ADV path is planned to navigate the ADV to avoid collision with the moving object based on the lowest costs of the possible object paths of the moving object.
    Type: Application
    Filed: April 23, 2019
    Publication date: October 29, 2020
    Inventors: KECHENG XU, YAJIA ZHANG, HONGYI SUN, JIACHENG PAN, JINGHAO MIAO
  • Patent number: 10809736
    Abstract: In one embodiment, a data processing system for an autonomous driving vehicle (ADV) includes a processor, and a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations. The operations include generating a station-time (ST) graph based on perception data obtained from one or more sensors of the ADV, the ST graph including representing a location of an obstacle at different points in time, obtaining a tensor based on the ST graph, the tensor including a plurality of layers, the plurality of layers including a first layer having data representing one or more obstacles on a path in which the ADV is moving, applying a machine-learning model to the plurality of layers of the tensor to generate a plurality of numerical values, the plurality of numerical values defining a potential path trajectory of the ADV, and determining a path trajectory of the ADV based on the plurality of numerical values.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: October 20, 2020
    Assignee: BAIDU USA LLC
    Inventors: Kecheng Xu, Haoyang Fan, Yajia Zhang, Qi Luo, Jiacheng Pan, Jinghao Miao
  • Patent number: 10732632
    Abstract: In one embodiment, when an ADV is driving on a trajectory generated based on a reference line, a separate processing thread is executed to precalculate a new reference line as a future reference line for a future planning cycle in parallel. The future reference line is being created while the ADV is moving along a trajectory generated based on the original reference line and before reaching a location corresponding to the starting point of the future reference line. The future reference line is overlapped with an end section of the original reference line, such that the future reference line can be connected to the end section of the original reference line. The future reference line serves an extension of the original reference line before the ADV reaches the end section of the original reference line.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: August 4, 2020
    Assignee: BAIDU USA LLC
    Inventors: Dong Li, Liangliang Zhang, Yajia Zhang, Yifei Jiang, Haoyang Fan, Jiangtao Hu
  • Publication number: 20200209872
    Abstract: In one embodiment, a data processing system for an autonomous driving vehicle (ADV) includes a processor, and a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations. The operations include generating a station-time (ST) graph based on perception data obtained from one or more sensors of the ADV, the ST graph including representing a location of an obstacle at different points in time, obtaining a tensor based on the ST graph, the tensor including a plurality of layers, the plurality of layers including a first layer having data representing one or more obstacles on a path in which the ADV is moving, applying a machine-learning model to the plurality of layers of the tensor to generate a plurality of numerical values, the plurality of numerical values defining a potential path trajectory of the ADV, and determining a path trajectory of the ADV based on the plurality of numerical values.
    Type: Application
    Filed: December 27, 2018
    Publication date: July 2, 2020
    Inventors: KECHENG XU, HAOYANG FAN, YAJIA ZHANG, Qi LUO, JIACHENG PAN, JINGHAO MIAO
  • Publication number: 20200125094
    Abstract: In one embodiment, a method, apparatus, and system for generating an optimal path for an autonomous driving vehicle (ADV) is disclosed.
    Type: Application
    Filed: October 19, 2018
    Publication date: April 23, 2020
    Inventors: YAJIA ZHANG, KECHENG XU
  • Publication number: 20200117207
    Abstract: In one embodiment, a method, apparatus, and system for planning a trajectory for an autonomous driving vehicle (ADV) is disclosed.
    Type: Application
    Filed: October 15, 2018
    Publication date: April 16, 2020
    Inventor: YAJIA ZHANG
  • Patent number: 10606277
    Abstract: According to some embodiments, a system selects a number of polynomials representing a number of time segments of a time duration to complete the path trajectory. The system selects an objective function based on a number of cost functions to smooth speeds between the time segments. The system defines a set of constraints to the polynomials to at least ensure the polynomials are smoothly joined together. The system performs a quadratic programming (QP) optimization on the objective function in view of the set of constraints, such that a cost associated with the objective function reaches a minimum while the set of constraints are satisfied. The system generates a smooth speed for the time duration based on the optimized objective function to control the ADV autonomously.
    Type: Grant
    Filed: September 18, 2017
    Date of Patent: March 31, 2020
    Assignee: BAIDU USA LLC
    Inventors: Haoyang Fan, Liangliang Zhang, Yajia Zhang, Weicheng Zhu, Yifei Jiang, Qi Luo, Jiangtao Hu, Qi Kong
  • Patent number: 10591926
    Abstract: According to some embodiments, a system determines a number of boundary areas having predetermined dimensions centered around each of a number of control points of a first reference line. The system selects a number of two-dimensional polynomials each representing a segment of an optimal reference line between adjacent control points. The system defines a set of constraints to the two-dimensional polynomials to at least ensure the two-dimensional polynomials passes through each of the boundary areas. The system performs a quadratic programming (QP) optimization on a target function such that a total cost of the target function reaches minimum while the set of constraints are satisfied. The system generates a second reference line representing the optimal reference line based on the QP optimization to control the ADV autonomously according to the second reference line.
    Type: Grant
    Filed: September 18, 2017
    Date of Patent: March 17, 2020
    Assignee: BAIDU USA LLC
    Inventors: Haoyang Fan, Liangliang Zhang, Yajia Zhang, Weicheng Zhu, Yifei Jiang, Qi Luo, Jiangtao Hu, Qi Kong
  • Patent number: 10569651
    Abstract: When generating a control command of an autonomous driving vehicle (ADV), a pitch status and/or a roll status of the road is determined. The control command is adjusted based on the pitch status and the roll status. For example, when an ADV is driving on an uphill or downhill road, a pitch status of the road is determined and a speed control command will be generated based on the pitch status of the road, such that the ADV have a similar acceleration rate as of driving on a flat road. Similarly, when the ADV is driving on a road that is tilted or rolled left or right, a roll status of the road is determined and a steering control command will be generated in view of the roll status of the road, such that the ADV have a similar heading direction as of driving on a flat road.
    Type: Grant
    Filed: May 15, 2017
    Date of Patent: February 25, 2020
    Assignee: BAIDU USA LLC
    Inventors: Fan Zhu, Qi Kong, Qi Luo, Xiang Yu, Sen Hu, Li Zhuang, Liangliang Zhang, Weicheng Zhu, Haoyang Fan, Yajia Zhang, Guang Yang, Jingao Wang
  • Patent number: 10571921
    Abstract: According to some embodiments, a system segments a first path trajectory selected from an initial location of the ADV into a number of path segments, where each path segment is represented by a polynomial function. The system selects an objective function in view of the polynomial functions of the path segments for smoothing connections between the path segments. The system defines a set of constraints to the polynomial functions based on adjacent path segments in view of at least a road boundary and an obstacle perceived by the ADV. The system performs a quadratic programming (QP) optimization on the objective function in view of the added constraints, such that an output of the objective function reaches a minimum. The system generates a second path trajectory representing a path trajectory with an optimized objective function based on the QP optimization to control the ADV autonomously.
    Type: Grant
    Filed: September 18, 2017
    Date of Patent: February 25, 2020
    Assignee: BAIDU USA LLC
    Inventors: Haoyang Fan, Liangliang Zhang, Yajia Zhang, Weicheng Zhu, Yifei Jiang, Qi Luo, Jiangtao Hu, Qi Kong
  • Publication number: 20200026276
    Abstract: Methods and systems for multimodal motion planning framework for autonomous driving vehicles are disclosed. In one embodiment, driving environment data of an autonomous vehicle is received, where the environment data includes a route segment. The route segment is segmented into a number of route sub-segments. A specific driving scenario is assigned to each of the route sub-segments, where each specific driving scenario is included in a set of driving scenarios. A first motion planning algorithm is assigned according to a first assigned driving scenario included in the set of driving scenarios. The first motion planning algorithm is invoked to generate a first set of trajectories. The autonomous vehicle is controlled based on the first set of trajectories.
    Type: Application
    Filed: July 17, 2018
    Publication date: January 23, 2020
    Inventors: Yajia Zhang, Dong Li, Liangliang Zhang, Kecheng Xu, Jiaming Tao, Yifei Jiang, Qi Luo, Jiangtao Hu, Jinghao Miao
  • Publication number: 20200023838
    Abstract: Methods and systems to predict object movement within a driving environment is disclosed. In one embodiment, one or more objects are detected within the driving environment. One or more predicted trajectories are computed for each of the objects based on map and route information to produce a set of predicted trajectories for the objects. The set of predicted trajectories is used to enumerate a number of combinations of predicted trajectories on which the objects possibly travel within the driving environment. A risk value is computed for each of the combinations to generate a number of corresponding risk values. An autonomous vehicle is controlled based on a combination having a lowest risk value included in the corresponding risk values.
    Type: Application
    Filed: July 17, 2018
    Publication date: January 23, 2020
    Inventor: Yajia Zhang
  • Publication number: 20200003564
    Abstract: A first reference line representing a routing line from a first location to a second location associated with an autonomous driving vehicle (ADV) is received. The first reference line is segmented into a number of reference line segments. For each of the reference line segments, a quintic polynomial function is defined to represent the reference line segment. An objective function is determined based on the quintic polynomial functions of the reference line segments. An optimization is performed on coefficients of the quintic polynomial functions in view of a set of constraints associated with the reference line segments, such that an output of the objective function reaches minimum while the constraints are satisfied. A second reference line is then generated based on the optimized parameters or coefficients of the quintic polynomial functions of the objective function. The second reference line is then utilized to plan and control the ADV.
    Type: Application
    Filed: June 27, 2018
    Publication date: January 2, 2020
    Inventor: Yajia ZHANG
  • Publication number: 20200001862
    Abstract: A parking system for autonomous driving vehicles optimizes a solution to a parking problem. The ADV detects a parking lot and selects a parking space. The ADV defines constraints for the parking lot, parking space, and kinematic constraints of the ADV, and generates a plurality of potential parking paths to the parking space, taking into account the constraints of the parking lot, parking space, and kinematics of the ADV, but without taking into any obstacles that may be surrounding the ADV. The ADV determines a cost for traversing each of the parking paths. One or more least cost candidate paths are selected from the parking paths, then one or more candidate paths are eliminated based on obstacles surrounding the ADV. Remaining candidates can be analyzed using a quadratic optimization system. A best parking path can be selected from the remaining candidates to navigate the ADV to the parking space.
    Type: Application
    Filed: June 27, 2018
    Publication date: January 2, 2020
    Inventors: Qi Luo, Dong Li, Yajia Zhang, Liangliang Zhang, Yifei Jiang, Jiaming Tao, Kecheng Xu, Jiangtao Hu