Patents by Inventor Liangliang Zhang

Liangliang Zhang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11143513
    Abstract: According to one embodiment, perception data describing a set of trajectories driven by a number of vehicles is received at a server from the vehicles or data collection agents over a network. The vehicles were driving through a road segment of a road over a period of time and their driving trajectories were captured. A trajectory analysis is the performed on the perception data using a set of rules to determine driving behaviors of the corresponding vehicles. A lane configuration of the road segment is then determined based on the driving behaviors. A map segment of a navigation map is then updated based on the lane configuration of one or more lanes within the road segment. A higher definition map can be generated based on the updates of the navigation map and the lane configuration, which can be utilized to autonomously drive an ADV subsequently.
    Type: Grant
    Filed: October 19, 2018
    Date of Patent: October 12, 2021
    Assignee: BAIDU USA LLC
    Inventors: Yifei Jiang, Liangliang Zhang, Dong Li, Jiaming Tao, Jiangtao Hu
  • Patent number: 11137762
    Abstract: In one embodiment, a method, apparatus, and system may predict behavior of environmental objects using machine learning at an autonomous driving vehicle (ADV). One or more yield/overtake decisions are made with respect to one or more objects in the ADV's surrounding environment using a data processing architecture comprising at least a first, a second, and a third neural networks, the first, the second, and the third neural networks having been trained with a training data set. Driving signals are generated based at least in part on the yield/overtake decisions to control operations of the ADV.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: October 5, 2021
    Assignee: BAIDU USA LLC
    Inventors: Liangliang Zhang, Hongyi Sun, Dong Li, Jiangtao Hu, Jinghao Miao, Jiaming Tao, Yifei Jiang
  • Patent number: 11126199
    Abstract: A learning based speed planner for autonomous driving vehicles (ADV) is disclosed. An ADV is set into human-driving mode. Driving control elements are under control of a human driver, and other ADV logic is enabled. The ADV plans a route path on a segment of the route having an obstacle. ADV logic generates a station-time graph for the path of the segment, and a grid of cells to encompass the path and obstacle. A feature vector is generated from the grid. Human driving behavior is recorded as the ADV is navigated along the path. Recorded driving data for a large plurality of paths, obstacles and ADVs is transmitted to a server to generate a speed model. The speed model is downloaded to one or more ADVs for use in autonomous driving mode, to determine an initial speed to use in similar driving situations.
    Type: Grant
    Filed: April 16, 2018
    Date of Patent: September 21, 2021
    Assignee: BAIDU USA LLC
    Inventors: Liangliang Zhang, Dong Li, Jiangtao Hu, Jiaming Tao, Yifei Jiang
  • Patent number: 11117569
    Abstract: A parking system for autonomous driving vehicles optimizes a solution to a parking problem. The ADV detects a parking lot and selects a parking space. The ADV defines constraints for the parking lot, parking space, and kinematic constraints of the ADV, and generates a plurality of potential parking paths to the parking space, taking into account the constraints of the parking lot, parking space, and kinematics of the ADV, but without taking into any obstacles that may be surrounding the ADV. The ADV determines a cost for traversing each of the parking paths. One or more least cost candidate paths are selected from the parking paths, then one or more candidate paths are eliminated based on obstacles surrounding the ADV. Remaining candidates can be analyzed using a quadratic optimization system. A best parking path can be selected from the remaining candidates to navigate the ADV to the parking space.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: September 14, 2021
    Assignee: BAIDU USA LLC
    Inventors: Qi Luo, Dong Li, Yajia Zhang, Liangliang Zhang, Yifei Jiang, Jiaming Tao, Kecheng Xu, Jiangtao Hu
  • Patent number: 11097748
    Abstract: A method of determining a smooth reference line for navigating an autonomous vehicle in a manner similar to human driving is disclosed. A high density map is used to generate a centerline for a lane of roadway. Using the centerline, a number of sample points is generated that is related to a curvature of the centerline. Adjustment points are generated at each sample point, a few on either side of the centerline at each sample point. Candidate points at a sample point include the adjustment points and sample point. A least cost path is determined through each of the candidate points at each of the sample points. Path cost is based an angle of approach and departure through a candidate point, and a distance of the candidate point from the centerline.
    Type: Grant
    Filed: October 23, 2018
    Date of Patent: August 24, 2021
    Assignee: BAIDU USA LLC
    Inventors: Liangliang Zhang, Dong Li, Jiangtao Hu, Jiaming Tao, Jinyun Zhou
  • Patent number: 11099017
    Abstract: A first reference line representing a route from a first location to a second location associated with an autonomous driving vehicle (ADV). In response to the first reference line multiple sets of sample points are generated based on the first reference line. Each set of sample points includes a first subset of sample points and a second subset of sample points that are offset from the first subset of sample points. A plurality of segments is generated between the multiple sets of sample points. A path for the ADV is generated based on the plurality of segments. The path includes one sample point from each of the multiple sets of sample points.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: August 24, 2021
    Assignee: BAIDU USA LLC
    Inventors: Liangliang Zhang, Li Dong, Fan Zhu, Yifei Jiang, Jiangtao Hu
  • Patent number: 11092888
    Abstract: Provided is a processing method for a multi-row, multi-column flat lens with an equivalent negative refractive index, which includes: performing photoresist coating, masking and exposure on the photolithography surface; removing photoresist in an unexposed block, and forming a rectangular groove; coating a surface of an exposed block and all surfaces of the rectangular groove with a protective layer, and then coating a side surface of the rectangular groove with a reflective film; removing the protective layer on the surface of the exposed block and the bottom surface of the rectangular groove, then filling up the groove with a filling material, and further processing the front and rear surfaces of the parallel plate in such a manner that a parallel misalignment between the front and rear surfaces thereof is smaller than 1?; and adding a protective window sheet on each of the front and rear surfaces of the new parallel plate.
    Type: Grant
    Filed: January 6, 2021
    Date of Patent: August 17, 2021
    Assignee: ANHUI DONGCHAO SCIENCE AND TECH COMPANY LIMITED
    Inventors: Chao Fan, Dongcheng Han, Liangliang Zhang
  • Patent number: 11080975
    Abstract: Various techniques for theft proofing autonomous driving vehicles (ADV) for transporting goods are described. In one embodiment, sensor data of a moving object representing a person within a predetermined proximity of an ADV are captured for real-time analysis by a theft detection module, to determine a moving behavior of the moving object based on the sensor data in view of a set of known moving behaviors. The theft detection module further determines whether an intention of the person is likely to remove at least some of the goods from the ADV using a process derived from historical image set, and sends an alarm to a predetermined destination in response to determining such an intention of the person. Other sensor data, for example, real time movements and weights of the ADV, can be used in conjunction with the process derived from historical image sets to determine the intention of the person.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: August 3, 2021
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO, LTD.
    Inventors: Yiqun Fu, Liangliang Zhang, Shengxiang Liu, Jiangtao Hu
  • Patent number: 11076399
    Abstract: A service transmission method is provided. A first base station, which establishes an RRC connection with a UE, sends a request message to a second base station which is at least one of base stations serving the UE, where the request message includes service information, where the service information includes QoS information of a service and/or configuration information of an RB, and the request message instructs the second base station to perform resource configuration according to service information. The first base station sends a configuration message to the UE, where the configuration message includes configuration list information of the RB and/or cell information of the offload base station.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: July 27, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Li Chai, Bo Lin, Liangliang Zhang
  • Patent number: 11073831
    Abstract: In one embodiment, perception data is received from a number of autonomous driving vehicles (ADVs) over a network. The perception data includes information describing a set of trajectories that a number of vehicles having driven through a road segment of a road and perceived by one or more ADVs using their respective sensors driving on the same road segment. In response to the perception data, an analysis is performed on the perception data, i.e., the trajectories, to determine one or more lanes within the road segment. For each of the lanes, a lane reference line associated with the lane is calculated based on the trajectories within the corresponding lane. The lane metadata describing the lane reference lines for the one or more lanes are stored in a lane configuration data structure such as a database. The lane configuration database can then be utilized for autonomous driving at real-time subsequently without having to use a high definition map.
    Type: Grant
    Filed: October 17, 2018
    Date of Patent: July 27, 2021
    Assignee: BAIDU USA LLC
    Inventors: Yifei Jiang, Liangliang Zhang, Dong Li, Jiaming Tao, Jiangtao Hu
  • Patent number: 11066067
    Abstract: A parking system for autonomous driving vehicles (ADV) is disclosed that utilizes the perception, planning, and prediction modules of ADV driving logic to more safely and accurately park an ADV. An ADV scans a parking lot for an available space, then determines a sequence of portions or segments of a parking path from the ADV's location to a selected parking space. The sequence of segments involves one or more forward driving segments and one or more reverse driving segments. During the forward driving segments, the ADV logic uses the perception, planning, and prediction modules to identify one or more obstacles to the ADV parking path, and speed and direction of those obstacles. During a reverse driving segment, the ADV logically inverts the orientation of the perception, planning, and prediction modules to continue to track the one or more obstacles and their direction and speed while the ADV is driving in a reverse direction.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: July 20, 2021
    Assignee: BAIDU USA LLC
    Inventors: Dong Li, Qi Luo, Liangliang Zhang, Yifei Jiang, Jiaming Tao, Jiangtao Hu
  • Publication number: 20210208597
    Abstract: A sensor aggregation framework for autonomous driving vehicles is disclosed. In one embodiment, sensor data is collected from one or more sensors mounted on an autonomous driving vehicle (ADV) while the ADV is moving within a region of interest (ROI) that includes a number of obstacles. The sensor data includes obstacle information of the obstacles and vehicle data of the ADV. Each of the vehicle data is timestamped with a current time at which the vehicle data is captured to generate a number of timestamps that correspond to the vehicle data. The obstacle information, the vehicle data, and the corresponding timestamps are aggregated into training data. The training data is used to train a set of parameters that is subsequently utilized to predict at least in part future obstacle behaviors and vehicle movement of the ADV.
    Type: Application
    Filed: March 18, 2021
    Publication date: July 8, 2021
    Inventors: Liangliang Zhang, Dong Li, Jiangtao Hu, Jiaming Tao, Yifei Jiang
  • Patent number: 11055857
    Abstract: In an embodiment, a method for representing a surrounding environment of an ego autonomous driving vehicle (ADV) is described. The method represents the surrounding environment using a first set of features from a definition (HD) map and a second set of features from a target object in the surrounding environment. The first set of features are extracted from the high definition map using a convolutional neural network (CNN), and the second set of features are handcrafted features from the target object during a predetermined number of past driving cycles of the ego ADV. The first set of features and the second set of features are concatenated and provided to a number of fully connected layers of the CNN to predict behaviors of the target object. In one embodiment, the operations in the method can be repeated for each driving cycle of the ego ADV.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: July 6, 2021
    Assignee: BAIDU USA LLC
    Inventors: Liangliang Zhang, Hongyi Sun, Dong Li, Jiangtao Hu, Jinghao Miao
  • Patent number: 11054829
    Abstract: Methods and systems for multimodal motion planning framework for autonomous driving vehicles are disclosed. In one embodiment, driving environment data of an autonomous vehicle is received, where the environment data includes a route segment. The route segment is segmented into a number of route sub-segments. A specific driving scenario is assigned to each of the route sub-segments, where each specific driving scenario is included in a set of driving scenarios. A first motion planning algorithm is assigned according to a first assigned driving scenario included in the set of driving scenarios. The first motion planning algorithm is invoked to generate a first set of trajectories. The autonomous vehicle is controlled based on the first set of trajectories.
    Type: Grant
    Filed: July 17, 2018
    Date of Patent: July 6, 2021
    Assignee: BAIDU USA LLC
    Inventors: Yajia Zhang, Dong Li, Liangliang Zhang, Kecheng Xu, Jiaming Tao, Yifei Jiang, Qi Luo, Jiangtao Hu, Jinghao Miao
  • Patent number: 11040726
    Abstract: In one embodiment, an intelligent and prompt alarm system is designed on autonomous driving vehicles to help autonomous driving vehicles to communicate to human drivers more vigilantly and promptly, and to improve human driver's performance to take over when an autonomous driving failure occurs. In one embodiment, an alarm system can be developed several levels: 1) basic warning, 2) risk warning, and 3) emergency/take-over alarming.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: June 22, 2021
    Assignee: BAIDU USA LLC
    Inventors: Jiaming Tao, Yifei Jiang, Dong Li, Jiangtao Hu, Liangliang Zhang, Liyun Li, Jingao Wang
  • Publication number: 20210179140
    Abstract: In one embodiment, a lateral drifting error is determined based on at least a current location of an ADV. The lateral drifting error is segmented into a first drifting error and a second drifting error using a predetermined segmentation algorithm. A planning module plans a path or trajectory for a current driving cycle (e.g., planning cycle) to drive the ADV from the current location for a predetermined period of time. The planning module performs a first drifting error correction on the trajectory by modifying at least a starting point of the trajectory based on the first drifting error to generate a modified trajectory. A control module controls the ADV to drive according to the modified trajectory, including performing a second drifting error correction based on the second drifting error.
    Type: Application
    Filed: May 18, 2018
    Publication date: June 17, 2021
    Inventors: Fan ZHU, Xin XU, Qi KONG, Yuchang PAN, Feiyi JIANG, Liangliang ZHANG, Jiaming TAO, Haoyang FAN, Hui JIANG
  • Publication number: 20210183221
    Abstract: Various techniques for theft proofing autonomous driving vehicles (ADV) for transporting goods are described. In one embodiment, sensor data of a moving object representing a person within a predetermined proximity of an ADV are captured for real-time analysis by a theft detection module, to determine a moving behavior of the moving object based on the sensor data in view of a set of known moving behaviors. The theft detection module further determines whether an intention of the person is likely to remove at least some of the goods from the ADV using a process derived from historical image set, and sends an alarm to a predetermined destination in response to determining such an intention of the person. Other sensor data, for example, real time movements and weights of the ADV, can be used in conjunction with the process derived from historical image sets to determine the intention of the person.
    Type: Application
    Filed: June 29, 2018
    Publication date: June 17, 2021
    Inventors: Yiqun FU, Liangliang ZHANG, Shengxiang LIU, Jiangtao HU
  • Publication number: 20210179101
    Abstract: According to some embodiments, a system receives a first control command and a speed measurement of the ADV. The system determines an expected acceleration of the ADV based on the speed measurement and the first control command. The system receives an acceleration measurement of the ADV. The system determines a feedback error based on the acceleration measurement and the expected acceleration. The system updates a portion of the calibration table based on the determined feedback error. The system generates a second control command to control the ADV based on the calibration table having the updated portion to control the ADV autonomously according to the second control command.
    Type: Application
    Filed: July 9, 2018
    Publication date: June 17, 2021
    Inventors: Fan ZHU, Qi KONG, Lin MA, Hui JIANG, Jiaming TAO, Liangliang ZHANG
  • Patent number: 11036225
    Abstract: A first localization system performs a first localization using a first set of sensors to track locations of the ADV along the path from a starting point to a destination point. A first localization curve is generated as a result representing the locations of the ADV along the path tracked by the first localization system. Currently, a second localization system performs a second localization using a second set of sensors to track the locations of the ADV along the path. A second localization curve is generated as a result representing the locations of the ADV along the path tracked by the second localization system. A system delay of the second localization system is determined by comparing the second localization curve against the first localization curve as a localization reference. The system delay of the second localization system can then be utilized to compensate path planning of the ADV subsequently.
    Type: Grant
    Filed: April 18, 2018
    Date of Patent: June 15, 2021
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Fan Zhu, Xin Xu, Qi Kong, Yuchang Pan, Feiyi Jiang, Liangliang Zhang, Jiaming Tao, Haoyang Fan, Hui Jiang
  • Publication number: 20210163037
    Abstract: In one embodiment, instead of using map data, a relative coordinate system is utilized to assist perception of the driving environment surrounding an ADV for some driving situations. One of such driving situations is driving on a highway. Typically, a highway has fewer intersections and exits. The relative coordinate system is utilized based on the relative lane configuration and relative obstacle information to control the ADV to simply follow the lane and avoid potential collision with any obstacles discovered within the road, without having to use map data. Once the relative lane configuration and obstacle information have been determined, regular path and speed planning and optimization can be performed to generate a trajectory to drive the ADV. Such a perception system is referred to as a relative perception system based on a relative coordinate system.
    Type: Application
    Filed: April 18, 2018
    Publication date: June 3, 2021
    Inventors: Fan ZHU, Qi KONG, Yuchang PAN, Feiyi JIANG, Xin XU, Xiaoxin FU, Zhongpu XIA, Chunming ZHAO, Liangliang ZHANG, Weicheng ZHU, Li ZHUANG, Haoyang FAN, Hui JIANG, Jiaming TAO