Patents by Inventor Jinghao Miao

Jinghao Miao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200334985
    Abstract: According to one embodiment, in response to a request to park an ADV into a parking lot, a remote server is accessed over a network (e.g., a VX2 link) to obtain a list of parking spaces that appear to be available in the parking lot. Based on the list of available parking spaces and the map associated with the parking lot, a route is generated to navigate through at least the available parking spaces. The ADV is driven according to the route to locate at least one of the available parking spaces and to park the ADV into the located available parking space. The centralized server is configured to periodically receive signals from a number of parking lots indicating which of the parking spaces of the parking lots are apparently available.
    Type: Application
    Filed: April 22, 2019
    Publication date: October 22, 2020
    Inventors: JINYUN ZHOU, RUNXIN HE, QI LUO, JINGHAO MIAO, JIANGTAO HU, YU WANG, JIAXUAN XU, SHU JIANG
  • Patent number: 10809736
    Abstract: In one embodiment, a data processing system for an autonomous driving vehicle (ADV) includes a processor, and a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations. The operations include generating a station-time (ST) graph based on perception data obtained from one or more sensors of the ADV, the ST graph including representing a location of an obstacle at different points in time, obtaining a tensor based on the ST graph, the tensor including a plurality of layers, the plurality of layers including a first layer having data representing one or more obstacles on a path in which the ADV is moving, applying a machine-learning model to the plurality of layers of the tensor to generate a plurality of numerical values, the plurality of numerical values defining a potential path trajectory of the ADV, and determining a path trajectory of the ADV based on the plurality of numerical values.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: October 20, 2020
    Assignee: BAIDU USA LLC
    Inventors: Kecheng Xu, Haoyang Fan, Yajia Zhang, Qi Luo, Jiacheng Pan, Jinghao Miao
  • Patent number: 10800408
    Abstract: An ADV may determine a predicted path for a moving obstacle. The ADV may determine a predicted area based on the predicted path. The ADV may determine a path for the ADV based on the predicted area. The path for the ADV may avoid the predicted area when determining the path for the ADV.
    Type: Grant
    Filed: May 24, 2018
    Date of Patent: October 13, 2020
    Assignee: BAIDU USA LLC
    Inventors: Kecheng Xu, Jinghao Miao
  • Patent number: 10705536
    Abstract: Route segment information is received from a first autonomous vehicle over a network. The route segment information includes one or more route segments and estimated entrance times, each of the entrance times being associated with one of the route segments and representing a time the first autonomous vehicle enters the route segment. Whether the first autonomous vehicle is within a specific route segment is determined based on an entrance time associated with the specific route segment and a current location of the first autonomous vehicle. If the first autonomous vehicle is within the specific route segment, a request is sent to invite the first autonomous vehicle to join a vehicle group of one or more vehicles associated with the specific route segment. The vehicle group is one of a plurality of vehicle groups that were determined based on route segment information received from a plurality of autonomous vehicles.
    Type: Grant
    Filed: November 22, 2016
    Date of Patent: July 7, 2020
    Assignee: BAIDU USA LLC
    Inventors: Jinghao Miao, Liyun Li, I-Hsuan Yang, Shiyuan Fang, Jingao Wang
  • Publication number: 20200209872
    Abstract: In one embodiment, a data processing system for an autonomous driving vehicle (ADV) includes a processor, and a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations. The operations include generating a station-time (ST) graph based on perception data obtained from one or more sensors of the ADV, the ST graph including representing a location of an obstacle at different points in time, obtaining a tensor based on the ST graph, the tensor including a plurality of layers, the plurality of layers including a first layer having data representing one or more obstacles on a path in which the ADV is moving, applying a machine-learning model to the plurality of layers of the tensor to generate a plurality of numerical values, the plurality of numerical values defining a potential path trajectory of the ADV, and determining a path trajectory of the ADV based on the plurality of numerical values.
    Type: Application
    Filed: December 27, 2018
    Publication date: July 2, 2020
    Inventors: KECHENG XU, HAOYANG FAN, YAJIA ZHANG, Qi LUO, JIACHENG PAN, JINGHAO MIAO
  • Publication number: 20200174472
    Abstract: In one embodiment, a method, apparatus, and system may predict behavior of environmental objects using machine learning at an autonomous driving vehicle (ADV). One or more yield/overtake decisions are made with respect to one or more objects in the ADV's surrounding environment using a data processing architecture comprising at least a first, a second, and a third neural networks, the first, the second, and the third neural networks having been trained with a training data set. Driving signals are generated based at least in part on the yield/overtake decisions to control operations of the ADV.
    Type: Application
    Filed: November 30, 2018
    Publication date: June 4, 2020
    Inventors: LIANGLIANG ZHANG, HONGYI SUN, DONG LI, JIANGTAO HU, JINGHAO MIAO, JIAMING TAO, YIFEI JIANG
  • Publication number: 20200175695
    Abstract: In an embodiment, a method for representing a surrounding environment of an ego autonomous driving vehicle (ADV) is described. The method represents the surrounding environment using a first set of features from a definition (HD) map and a second set of features from a target object in the surrounding environment. The first set of features are extracted from the high definition map using a convolutional neural network (CNN), and the second set of features are handcrafted features from the target object during a predetermined number of past driving cycles of the ego ADV. The first set of features and the second set of features are concatenated and provided to a number of fully connected layers of the CNN to predict behaviors of the target object. In one embodiment, the operations in the method can be repeated for each driving cycle of the ego ADV.
    Type: Application
    Filed: November 30, 2018
    Publication date: June 4, 2020
    Inventors: LIANGLIANG ZHANG, HONGYI SUN, DONG LI, JIANGTAO HU, JINGHAO MIAO
  • Publication number: 20200174486
    Abstract: In an embodiment, a learning-based dynamic modeling method is provided for use with an autonomous driving vehicle. A control module in the ADV can generate current states of the ADV and control commands for a first driving cycle, and send the current states and control commands to a dynamic model implemented using a trained neural network model. Based on the current states and the control commands, the dynamic model generates expected future states for a second driving cycle, during which the control module generates actual future states. The ADV compares the expected future states and the actual future states to generate a comparison result, for use in evaluating one or more of a decision module, a planning module and a control module in the ADV.
    Type: Application
    Filed: November 29, 2018
    Publication date: June 4, 2020
    Inventors: QI LUO, JIAXUAN XU, KECHENG XU, XIANGQUAN XIAO, SIYANG YU, JINGHAO MIAO, JIANGTAO HU
  • Publication number: 20200175691
    Abstract: In one embodiment, a method, apparatus, and system may predict behavior of environmental objects using machine learning at an autonomous driving vehicle (ADV). A data processing architecture comprising at least a first neural network and a second neural network is generated, the first and the second neural networks having been trained with a training data set. Behavior of one or more objects in the ADV's environment is predicted using the data processing architecture comprising the trained neural networks. Driving signals are generated based at least in part on the predicted behavior of the one or more objects in the ADV's environment to control operations of the ADV.
    Type: Application
    Filed: November 30, 2018
    Publication date: June 4, 2020
    Inventors: LIANGLIANG ZHANG, HONGYI SUN, DONG LI, JIANGTAO HU, JINGHAO MIAO
  • Patent number: 10642268
    Abstract: The present disclosure discloses a method and an apparatus for generating an autonomous driving strategy. A specific implementation of the method comprises: measuring state information of an instant vehicle and ambient scene information, the ambient scene information comprising: state information of an impediment vehicle, road structure information, and traffic scene information of the instant vehicle; determining a running track of the impediment vehicle according to the state information of the impediment vehicle within a predetermined period of time; determining a first mapping relation based on the state information of the impediment vehicle within the predetermined period of time and the running track of the impediment vehicle; and generating the autonomous driving strategy of the instant vehicle based on the first mapping relation, the road structure information, the state information of the instant vehicle and the traffic scene information of the instant vehicle.
    Type: Grant
    Filed: August 3, 2017
    Date of Patent: May 5, 2020
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventors: Zhongpu Xia, Jinghao Miao, Liyun Li
  • Publication number: 20200026276
    Abstract: Methods and systems for multimodal motion planning framework for autonomous driving vehicles are disclosed. In one embodiment, driving environment data of an autonomous vehicle is received, where the environment data includes a route segment. The route segment is segmented into a number of route sub-segments. A specific driving scenario is assigned to each of the route sub-segments, where each specific driving scenario is included in a set of driving scenarios. A first motion planning algorithm is assigned according to a first assigned driving scenario included in the set of driving scenarios. The first motion planning algorithm is invoked to generate a first set of trajectories. The autonomous vehicle is controlled based on the first set of trajectories.
    Type: Application
    Filed: July 17, 2018
    Publication date: January 23, 2020
    Inventors: Yajia Zhang, Dong Li, Liangliang Zhang, Kecheng Xu, Jiaming Tao, Yifei Jiang, Qi Luo, Jiangtao Hu, Jinghao Miao
  • Publication number: 20190359205
    Abstract: An ADV may determine a predicted path for a moving obstacle. The ADV may determine a predicted area based on the predicted path. The ADV may determine a path for the ADV based on the predicted area. The path for the ADV may avoid the predicted area when determining the path for the ADV.
    Type: Application
    Filed: May 24, 2018
    Publication date: November 28, 2019
    Inventors: Kecheng Xu, Jinghao Miao
  • Patent number: 10457294
    Abstract: According to one embodiment, a system receives sensor data from a number of sensors of the ADV. The system extracts a predetermined number of features from the sensor data using a machine learning model. The system determining whether to alert a user to intervene the ADS based on the extracted features using the machine learning model. The system then generating a safety alarm based on the determining whether to alert the user to intervene the ADS and alerts the user to intervene the ADS of the ADV based on the generated safety alarm.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: October 29, 2019
    Assignee: BAIDU USA LLC
    Inventors: Liangliang Zhang, Guang Yang, Jingtao Hu, Dong Li, Jinghao Miao
  • Publication number: 20190317511
    Abstract: According to one embodiment, an obstacle is predicted to move from a starting point to an end point based on perception data perceiving a driving environment surrounding an ADV that is driving within a lane. A longitudinal movement trajectory from the starting point to the end point is generated in view of a shape of the lane. A lateral movement trajectory from the starting point to the end point is generated, including optimizing a shape of the lateral movement trajectory using a first polynomial function. The longitudinal movement trajectory and the lateral movement trajectory are then combined to form a final predicted trajectory that predicts how the obstacle is to move. A path is generated to control the ADV to move in view of the predicted trajectory of the obstacle, for example, to avoid the collision with the obstacle.
    Type: Application
    Filed: April 17, 2018
    Publication date: October 17, 2019
    Inventors: KECHENG XU, JINGHAO MIAO, YAJIA ZHANG
  • Patent number: 10429849
    Abstract: A first reference line representing a trajectory from a first location to a second location associated with an autonomous driving vehicle (ADV) is received. The first reference line is segmented into a number of reference line segments. For each of the reference line segments, a quintic polynomial function is defined to represent the reference line segment. An objective function is determined based on the quintic polynomial functions of the reference line segments. An optimization is performed on coefficients of the quintic polynomial functions in view of a set of constraints associated with the reference line segments, such that an output of the objective function reaches minimum while the constraints are satisfied. A second reference line is then generated based on the optimized parameters or coefficients of the quintic polynomial functions of the objective function. The second reference line is then utilized to plan and control the ADV.
    Type: Grant
    Filed: December 14, 2017
    Date of Patent: October 1, 2019
    Assignee: BAIDU USA LLC
    Inventors: Yajia Zhang, Liyun Li, Kecheng Xu, Dong Li, Jinghao Miao, Jiangtao Hu, Jingao Wang
  • Patent number: 10394245
    Abstract: Responsive to sensor data received from one or more sensors of an autonomous vehicle, one or more predicted trajectories are generated, with each of the predicted trajectories having an associated probability. One or more driving scenarios that trigger gesture recognition are identified. For each of the identified driving scenarios, one or more gestures from one or more vehicles are detected in accordance with a gesture detection protocol. One or more gestures from the autonomous vehicle are emitted for communication with the vehicles in accordance with a gesture emission protocol based on the detected gestures. The predicted trajectories are modified based on the detected gestures, the emitted gestures and the associated probabilities of the predicted trajectories. The autonomous vehicle is controlled based on the modified predicted trajectories.
    Type: Grant
    Filed: November 22, 2016
    Date of Patent: August 27, 2019
    Assignee: BAIDU USA LLC
    Inventors: Liyun Li, Jinghao Miao, Shiyuan Fang, I-Hsuan Yang, Jingao Wang
  • Publication number: 20190204843
    Abstract: A surrounding environment of an autonomous vehicle is perceived to identify one or more vehicles nearby. For each of the identified vehicles, based on a current location of the identified vehicle, vehicle-independent information is obtained to determine context surrounding the identified vehicle, where the vehicle-independent information includes vehicle surrounding information that defines physical constraints imposed on the identified vehicle. For each of the identified vehicles, one or more trajectories for the identified vehicle are predicted based at least in part on the vehicle-independent information associated with the identified vehicle. The autonomous vehicle is controlled based on the one or more predicted trajectories of the one or more identified vehicles.
    Type: Application
    Filed: March 7, 2019
    Publication date: July 4, 2019
    Inventors: Shiyuan Fang, I-Hsuan Yang, Jinghao Miao, Liyun Li, Liangliang Zhang, Jingao Wang
  • Publication number: 20190187715
    Abstract: A first reference line representing a trajectory from a first location to a second location associated with an autonomous driving vehicle (ADV) is received. The first reference line is segmented into a number of reference line segments. For each of the reference line segments, a quintic polynomial function is defined to represent the reference line segment. An objective function is determined based on the quintic polynomial functions of the reference line segments. An optimization is performed on coefficients of the quintic polynomial functions in view of a set of constraints associated with the reference line segments, such that an output of the objective function reaches minimum while the constraints are satisfied. A second reference line is then generated based on the optimized parameters or coefficients of the quintic polynomial functions of the objective function. The second reference line is then utilized to plan and control the ADV.
    Type: Application
    Filed: December 14, 2017
    Publication date: June 20, 2019
    Inventors: Yajia Zhang, Liyun Li, Kecheng Xu, Dong Li, Jinghao Miao, Jiangtao Hu, Jingao Wang
  • Patent number: 10268200
    Abstract: A surrounding environment of an autonomous vehicle is perceived to identify one or more vehicles nearby. For each of the identified vehicles, based on a current location of the identified vehicle, vehicle-independent information is obtained to determine context surrounding the identified vehicle, where the vehicle-independent information includes vehicle surrounding information that defines physical constraints imposed on the identified vehicle. For each of the identified vehicles, one or more trajectories for the identified vehicle are predicted based at least in part on the vehicle-independent information associated with the identified vehicle. The autonomous vehicle is controlled based on the one or more predicted trajectories of the one or more identified vehicles.
    Type: Grant
    Filed: December 21, 2016
    Date of Patent: April 23, 2019
    Assignee: BAIDU USA LLC
    Inventors: Shiyuan Fang, I-Hsuan Yang, Jinghao Miao, Liyun Li, Liangliang Zhang, Jingao Wang
  • Publication number: 20190004517
    Abstract: The present disclosure discloses a method and an apparatus for generating an autonomous driving strategy. A specific implementation of the method comprises: measuring state information of an instant vehicle and ambient scene information, the ambient scene information comprising: state information of an impediment vehicle, road structure information, and traffic scene information of the instant vehicle; determining a running track of the impediment vehicle according to the state information of the impediment vehicle within a predetermined period of time; determining a first mapping relation based on the state information of the impediment vehicle within the predetermined period of time and the running track of the impediment vehicle; and generating the autonomous driving strategy of the instant vehicle based on the first mapping relation, the road structure information, the state information of the instant vehicle and the traffic scene information of the instant vehicle.
    Type: Application
    Filed: August 3, 2017
    Publication date: January 3, 2019
    Inventors: Zhongpu Xia, Jinghao Miao, Liyun Li