Patents by Inventor Ruoyu Tan

Ruoyu Tan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Single frame 4D detection using deep fusion of camera image, imaging RADAR and LiDAR point cloud
    Patent number: 11815623
    Abstract: Embodiments of the present disclosure are directed to a method for object detection. The method includes receiving sensor data indicative of one or more objects for each of a camera subsystem, a LiDAR subsystem, and an imaging RADAR subsystem. The sensor data is received simultaneously and within one frame for each of the subsystems. The method also includes extracting one or more feature representations of the objects from camera image data, LiDAR point cloud data and imaging RADAR point cloud data and generating image feature maps, LiDAR feature maps and imaging RADAR feature maps. The method further includes combining the image feature maps, the LiDAR feature maps and the imaging RADAR feature maps to generate merged feature maps and generating object classification, object position, object dimensions, object heading and object velocity from the merged feature maps.
    Type: Grant
    Filed: August 31, 2021
    Date of Patent: November 14, 2023
    Assignee: NIO Technology (Anhui) Co., Ltd.
    Inventors: Huazeng Deng, Ajaya H S Rao, Ashwath Aithal, Xu Chen, Ruoyu Tan, Veera Ganesh Yalla
  • SINGLE FRAME 4D DETECTION USING DEEP FUSION OF CAMERA IMAGE, IMAGING RADAR AND LIDAR POINT CLOUD
    Publication number: 20210397880
    Abstract: Embodiments of the present disclosure are directed to a method for object detection. The method includes receiving sensor data indicative of one or more objects for each of a camera subsystem, a LiDAR subsystem, and an imaging RADAR subsystem. The sensor data is received simultaneously and within one frame for each of the subsystems. The method also includes extracting one or more feature representations of the objects from camera image data, LiDAR point cloud data and imaging RADAR point cloud data and generating image feature maps, LiDAR feature maps and imaging RADAR feature maps. The method further includes combining the image feature maps, the LiDAR feature maps and the imaging RADAR feature maps to generate merged feature maps and generating object classification, object position, object dimensions, object heading and object velocity from the merged feature maps.
    Type: Application
    Filed: August 31, 2021
    Publication date: December 23, 2021
    Applicant: NIO Technology (Anhui) Co., Ltd.
    Inventors: Huazeng Deng, Ajaya H S Rao, Ashwath Aithal, Xu Chen, Ruoyu Tan, Veera Ganesh Yalla
  • Single frame 4D detection using deep fusion of camera image, imaging RADAR and LiDAR point cloud
    Patent number: 11113584
    Abstract: Embodiments of the present disclosure are directed to a method for object detection. The method includes receiving sensor data indicative of one or more objects for each of a camera subsystem, a LiDAR subsystem, and an imaging RADAR subsystem. The sensor data is received simultaneously and within one frame for each of the subsystems. The method also includes extracting one or more feature representations of the objects from camera image data, LiDAR point cloud data and imaging RADAR point cloud data and generating image feature maps, LiDAR feature maps and imaging RADAR feature maps. The method further includes combining the image feature maps, the LiDAR feature maps and the imaging RADAR feature maps to generate merged feature maps and generating object classification, object position, object dimensions, object heading and object velocity from the merged feature maps.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: September 7, 2021
    Assignee: NIO USA, Inc.
    Inventors: Huazeng Deng, Ajaya H S Rao, Ashwath Aithal, Xu Chen, Ruoyu Tan, Veera Ganesh Yalla
  • SINGLE FRAME 4D DETECTION USING DEEP FUSION OF CAMERA IMAGE, IMAGING RADAR AND LIDAR POINT CLOUD
    Publication number: 20210241026
    Abstract: Embodiments of the present disclosure are directed to a method for object detection. The method includes receiving sensor data indicative of one or more objects for each of a camera subsystem, a LiDAR subsystem, and an imaging RADAR subsystem. The sensor data is received simultaneously and within one frame for each of the subsystems. The method also includes extracting one or more feature representations of the objects from camera image data, LiDAR point cloud data and imaging RADAR point cloud data and generating image feature maps, LiDAR feature maps and imaging RADAR feature maps. The method further includes combining the image feature maps, the LiDAR feature maps and the imaging RADAR feature maps to generate merged feature maps and generating object classification, object position, object dimensions, object heading and object velocity from the merged feature maps.
    Type: Application
    Filed: February 4, 2020
    Publication date: August 5, 2021
    Inventors: Huazeng Deng, Ajaya H S Rao, Ashwath Aithal, Xu Chen, Ruoyu Tan, Veera Ganesh Yalla