Patents by Inventor Ruigang Yang

Ruigang Yang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11763474
    Abstract: A method for generating simulated point cloud data, a device, and a storage medium includes: acquiring at least one frame of point cloud data collected by a road collecting device in an actual environment without a dynamic obstacle as static scene point cloud data; setting, least one dynamic obstacle in a coordinate system matching the static scene point cloud data; simulating in the coordinate system, a plurality of simulated scanning lights emitted by a virtual scanner located at an origin of the coordinate system; updating the static scene point cloud data according to intersections of the plurality of simulated scanning lights and the at least one dynamic obstacle to obtain the simulated point cloud data comprising point cloud data of the dynamic obstacle; and at least one of adding a set noise to the simulated point cloud data, and, deleting point cloud data corresponding to the dynamic obstacle according to a set ratio.
    Type: Grant
    Filed: July 27, 2021
    Date of Patent: September 19, 2023
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Feilong Yan, Jin Fang, Tongtong Zhao, Chi Zhang, Liang Wang, Yu Ma, Ruigang Yang
  • Patent number: 11753795
    Abstract: A device for detecting a rotary angle used for an excavator. The device can include: a synchronous belt, arranged around a rotating shaft of a slewing mechanism of the excavator, a tooth-shaped surface of the synchronous belt being away from a surface of the rotating shaft; a transmission part, engaged with the tooth-shaped surface of the synchronous belt and arranged on a supporting base; an angle detection part, in transmission connection to the transmission part; and the supporting base, connected to a chassis of the excavator.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: September 12, 2023
    Assignee: Baidu Online Network Technology (Bejing) Co., Ltd.
    Inventors: Xinjing Cheng, Ruigang Yang, Yajue Yang, Feixiang Lu, Hao Xu
  • Patent number: 11668076
    Abstract: Embodiments of the present disclosure relate to a method and apparatus for controlling an excavator to excavate. The method includes: acquiring a two-dimensional image of a material pile; generating a three-dimensional model of the material pile based on the two-dimensional image; analyzing the three-dimensional model to determine a target excavating point and a target excavating trajectory of the material pile; and controlling an excavator to excavate a material at the target excavating point along the target excavating trajectory.
    Type: Grant
    Filed: November 7, 2019
    Date of Patent: June 6, 2023
    Assignee: Beijing Baidu Netcom Science and Technology Co., Ltd.
    Inventors: Xinjing Cheng, Ruigang Yang, Yajue Yang, Feixiang Lu, Hao Xu
  • Patent number: 11568593
    Abstract: Embodiments of the present disclosure relate to a three-dimensional reconstruction method and apparatus for a material pile, an electronic device, and a computer-readable medium. The method may include: acquiring, in response to an instruction for controlling an excavator body of an excavator to rotate to transport materials being detected, a sequence of depth images of an excavated material pile collected by a binocular camera provided on a side of the excavator; and performing three-dimensional reconstruction based on the sequence of depth images of the material pile, to generate a three-dimensional model of the material pile.
    Type: Grant
    Filed: November 6, 2019
    Date of Patent: January 31, 2023
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Xinjing Cheng, Ruigang Yang, Feixiang Lu, Yajue Yang, Hao Xu
  • Patent number: 11514634
    Abstract: Presented herein are novel embodiments for converting a given speech audio or text into a photo-realistic speaking video of a person with synchronized, realistic, and expressive body dynamics. In one or more embodiments, 3D skeleton movements are generated from the audio sequence using a recurrent neural network, and an output video is synthesized via a conditional generative adversarial network. To make movements realistic and expressive, the knowledge of an articulated 3D human skeleton and a learned dictionary of personal speech iconic gestures may be embedded into the generation process in both learning and testing pipelines. The former prevents the generation of unreasonable body distortion, while the later helps the model quickly learn meaningful body movement with a few videos. To produce photo-realistic and high-resolution video with motion details, a part-attention mechanism is inserted in the conditional GAN, where each detailed part is automatically zoomed in to have their own discriminators.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: November 29, 2022
    Assignees: Baidu USA LLC, Baidu.com Times Technology (Beijing) Co., Ltd.
    Inventors: Miao Liao, Sibo Zhang, Peng Wang, Ruigang Yang
  • Patent number: 11463606
    Abstract: Embodiments of the present disclosure disclose an apparatus and method for fixing a sensing system to an unmanned construction machinery. The fixing apparatus includes an internal fixing module and an external fixing module, in which, the internal fixing module is configured to fix a sensing device in a sensing system of an unmanned construction machinery to the external fixing module in a predetermined fixing manner; and the external fixing module is configured to control the sensing device in the sensing system to perform an environment sensing on a target area of the unmanned construction machinery in a predetermined control manner.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: October 4, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Xinjing Cheng, Ruigang Yang, Hao Xu, Feixiang Lu, Yajue Yang
  • Patent number: 11401698
    Abstract: A method and an apparatus for controlling an excavator are provided according to the embodiments.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: August 2, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Xinjing Cheng, Ruigang Yang, Yajue Yang, Feixiang Lu, Hao Xu
  • Patent number: 11378957
    Abstract: Embodiments of the present disclosure relate to a method and apparatus for controlling vehicle driving. The method includes: generating a global path of a driving site of a vehicle; executing following controlling: generating a local path of a site in front of a current position of the vehicle based on the global path, the local path following a direction of the global path, controlling the vehicle to drive along the local path until reaching an end point of the local path, determining whether the vehicle reaches an end point of the global path, and terminating the controlling if the vehicle reaches the endpoint of the global path; and continuing, in response to determining the vehicle failing to reach the end point of the global path, executing the controlling.
    Type: Grant
    Filed: November 7, 2019
    Date of Patent: July 5, 2022
    Assignee: Beijing Baidu Netcom Science And Technology Co., Ltd.
    Inventors: Xinjing Cheng, Ruigang Yang, Yajue Yang, Feixiang Lu, Hao Xu
  • Patent number: 11372413
    Abstract: Embodiments of the present disclosure relate to a method and apparatus for outputting information. The method includes: acquiring a target excavating trajectory, the target excavating trajectory including at least two sub-trajectories; determining trajectory parameters of the at least two sub-trajectories; determining, based on the trajectory parameters, positions of a plurality of control points; and outputting the positions of the plurality of control points.
    Type: Grant
    Filed: November 7, 2019
    Date of Patent: June 28, 2022
    Inventors: Xinjing Cheng, Ruigang Yang, Yajue Yang, Feixiang Lu, Hao Xu
  • Publication number: 20220185271
    Abstract: Embodiments of the present disclosure relate to a method and apparatus for controlling vehicle driving. The method includes: generating a global path of a driving site of a vehicle; executing following controlling: generating a local path of a site in front of a current position of the vehicle based on the global path, the local path following a direction of the global path, controlling the vehicle to drive along the local path until reaching an end point of the local path, determining whether the vehicle reaches an end point of the global path, and terminating the controlling if the vehicle reaches the endpoint of the global path; and continuing, in response to determining the vehicle failing to reach the end point of the global path, executing the controlling.
    Type: Application
    Filed: November 7, 2019
    Publication date: June 16, 2022
    Inventors: Xinjing Cheng, Ruigang Yang, Yajue Yang, Feixiang Lu, Hao Xu
  • Patent number: 11361456
    Abstract: Presented are systems and methods for improving speed and quality of real-time per-pixel depth estimation of scene layouts from a single image by using an end-to-end Convolutional Spatial Propagation Network (CSPN). An efficient linear propagation model performs propagation using a recurrent convolutional operation. The affinity among neighboring pixels may be learned through a deep convolutional neural network (CNN). The CSPN may be applied to two depth estimation tasks, given a single image: (1) to refine the depth output of existing methods, and (2) to convert sparse depth samples to a dense depth map, e.g., by embedding the depth samples within the propagation procedure. The conversion ensures that the sparse input depth values are preserved in the final depth map and runs in real-time and is, thus, well suited for robotics and autonomous driving applications, where sparse but accurate depth measurements, e.g., from LiDAR, can be fused with image data.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: June 14, 2022
    Assignees: Baidu USA LLC, Baidu.com Times Technology (Beijing) Co., Ltd.
    Inventors: Peng Wang, Xinjing Cheng, Ruigang Yang
  • Patent number: 11354461
    Abstract: A method and system for simulating a distribution of obstacles are provided. The method includes: acquiring a plurality of point clouds of a plurality of frames, wherein each point cloud includes a plurality of original obstacles; acquiring real labeling data of an acquisition vehicle, and obtaining data of a simulation position of the acquisition vehicle based on the real labeling data and a movement rule of the acquisition vehicle; determining the number of obstacles to be simulated based on the data of the simulation position of the acquisition vehicle; selecting the determined number of obstacles to be simulated, from a range with the simulation position of the acquisition vehicle as a center, wherein the range is less than or equal to a maximum scanning range of the vehicle; and acquiring real labeling data of the selected obstacles, and obtaining a position distribution of the selected obstacles.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: June 7, 2022
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventors: Jin Fang, Feilong Yan, Ruigang Yang, Liang Wang, Yu Ma
  • Patent number: 11356510
    Abstract: Embodiments of the present disclosure disclose a control system and a control method of an unmanned engineering machinery. The system includes at least a slave computer, a master computer and an execution device. The slave computer is configured to receive a current sensing value fed back by a sensing device in the unmanned engineering machinery, and to send the current sensing value to the master computer. The master computer is configured to generate a control instruction according to the current sensing value and a predetermined target sensing value of the sensing device, and to send the control instruction to the execution device through the slave computer.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: June 7, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Xinjing Cheng, Ruigang Yang, Hao Xu, Feixiang Lu, Yajue Yang
  • Patent number: 11348465
    Abstract: Embodiments of the present disclosure relate to a method and apparatus for updating information. The method may include: acquiring road network structure information of a target road network and vehicle information of a target number of vehicles in the target road network, the vehicle information including initial state information, perception information and positioning information, and the vehicle information being constrained by the road network structure information; selecting a target vehicle from the target number of vehicles; determining, based on a vehicle dynamics model, a reference speed at which the target vehicle passes a preset time step; and updating vehicle information of a vehicle in the target road network based on the reference speed of the target vehicle.
    Type: Grant
    Filed: June 9, 2020
    Date of Patent: May 31, 2022
    Assignees: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD., BAIDU USA LLC
    Inventors: He Jiang, Jinxin Zhao, Ruigang Yang
  • Patent number: 11341297
    Abstract: Embodiments of an obstacle distribution simulation method, device and terminal based on a probability graph are provided. The method can include: acquiring a plurality of point clouds of a plurality of frames; acquiring real labeling data of an acquisition vehicle at vehicle labeled positions, and acquiring data of a simulation position of the acquisition vehicle; determining the number of obstacles to be simulated at a position to be simulated; extracting real labeling data of the obstacles, and constructing a labeling data set; dividing the labeling data set into a plurality of grids and calculating occurrence probabilities of the plurality of obstacles; selecting the determined number of obstacles to be simulated according to the occurrence probabilities; and acquiring a position distribution of the selected obstacles to be simulated for the position to be simulated based on the real labeling data of the selected obstacles to be simulated.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: May 24, 2022
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventors: Jin Fang, Feilong Yan, Ruigang Yang, Liang Wang, Yu Ma
  • Patent number: 11313685
    Abstract: Embodiments of the present disclosure relate to a method and apparatus for generating a driving path. The method includes acquiring a two-dimensional image of a driving site obtained by a camera provided on an unmanned aerial vehicle through aerial photography, and a two-dimensional image of a site in front of a vehicle photographed by a camera provided on the vehicle; generating a global map based on the two-dimensional image of the driving site, and generating a local map based on the two-dimensional image of the site in front of the vehicle; and performing path planning based on the global map and the local map, to generate a global path and a local path, the local path following a direction of the global path.
    Type: Grant
    Filed: November 7, 2019
    Date of Patent: April 26, 2022
    Assignee: Beijing Baidu Netcom Science And Technology Co., Ltd.
    Inventors: Xinjing Cheng, Ruigang Yang, Feixiang Lu, Hao Xu, Yajue Yang
  • Patent number: 11288492
    Abstract: The present disclosure provides a method and device for acquiring 3D information of an object. The method includes: extracting two-dimensional (2D) key points of the object based on the image, and determining a candidate 3D model set matching the image; determining a plurality of first reference attitudes and positions of each candidate 3D model according to the 3D key points and the 2D key points; acquiring a plurality of reprojection error values between each candidate 3D model and the object at the plurality of first reference attitudes and positions; determining a first target attitude and position and a first target 3D model corresponding to a minimum reprojection error value in the first reprojection error value set; and acquiring the 3D information of the object based on the first target attitude and position and the first target 3D model.
    Type: Grant
    Filed: January 27, 2020
    Date of Patent: March 29, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Xibin Song, Ruigang Yang
  • Patent number: 11282164
    Abstract: Systems and methods of video inpainting for autonomous driving are disclosed. For example, the method stitches a multiplicity of depth frames into a 3D map, where one or more objects in the depth frames have previously been removed. The method further projects the 3D map onto a first image frame to generate a corresponding depth map, where the first image frame includes a target inpainting region. For each target pixel within the target inpainting region of the first image frame, based on the corresponding depth map, the method further maps the target pixel within the target inpainting region of the first image frame to a candidate pixel in a second image frame. The method further determines a candidate color to fill the target pixel. The method further performs Poisson image editing on the first image frame to achieve color consistency at a boundary and between inside and outside of the target inpainting region of the first image frame.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: March 22, 2022
    Assignees: BAIDU USA LLC, BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Miao Liao, Feixiang Lu, Dingfu Zhou, Sibo Zhang, Ruigang Yang
  • Patent number: 11276243
    Abstract: A simulation data augmentation method, a simulation data augmentation device and a simulation data augmentation terminal are provided according to embodiments of the present application. The method includes: acquiring a point cloud based on a plurality of frames, wherein the point cloud includes a plurality of obstacles labeled with real labeling data; dividing the point cloud into a plurality of preset regions, wherein each of the preset regions includes at least one obstacle; and adjusting the obstacle based on the real labeling data of the obstacle in the preset regions to obtain simulation data.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: March 15, 2022
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventors: Jin Fang, Feilong Yan, Ruigang Yang, Liang Wang, Yu Ma
  • Patent number: 11236493
    Abstract: Embodiments of the present disclosure relate to a method and apparatus for controlling equipment. The method includes: acquiring an electrical signal collected by a displacement sensor; determining a displacement of a movable rod of a hydraulic cylinder relative to a cylinder tube of the hydraulic cylinder according to the electrical signal; determining, according to the displacement, a rotating angle of a mechanical arm connected to the movable rod relative to a mechanical arm connected to the cylinder tube; and controlling equipment according to the rotating angle.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: February 1, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Xinjing Cheng, Ruigang Yang, Yajue Yang, Feixiang Lu, Hao Xu