Patents by Inventor Wenyuan Zeng
Wenyuan Zeng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11959866Abstract: A live flaw detection system for a multi-bundled conductor splicing sleeve and an application method thereof are disclosed. The system includes an upper apparatus and a lower apparatus, where the upper apparatus includes an unmanned aerial vehicle and an industrial X-ray machine, and a laser sensor, and the lower apparatus includes a press plate frame apparatus, vertical screw slide table modules, a horizontal screw slide table module, a projection imager, and a linear retractable apparatus. The unmanned aerial vehicle functions as a power apparatus that controls the system to be online or offline, the industrial X-ray machine is configured to perform ray flaw detection on each splicing sleeve, the laser sensor is configured to guide the unmanned aerial vehicle to land the lower apparatus on splicing sleeves accurately, and the press plate frame apparatus is configured to fixedly clamp the splicing sleeves.Type: GrantFiled: May 9, 2022Date of Patent: April 16, 2024Assignees: STATE GRID HUNAN ELECTRIC COMPANY LIMITED, STATE GRID HUNAN EXTRA HIGH VOLTAGE TRANSMISSION COMPANY, STATE GRID CORPORATION OF CHINAInventors: Dehua Zou, Shasha Peng, Zhipeng Jiang, Zhenyu Wang, Bocheng Li, Qiaosha Xiao, Yurong Xu, Zhenyu Chen, Wenyuan Zeng, Zhiguo Liu
-
Publication number: 20240010241Abstract: A computing system can input first relative location embedding data into an interaction transformer model and receive, as an output of the interaction transformer model, motion forecast data for actors relative to a vehicle. The computing system can input the motion forecast data into a prediction model to receive respective trajectories for the actors for a current time step and respective projected trajectories for the actors for a subsequent time step. The computing system can generate second relative location embedding data based on the respective projected trajectories from the second time step. The computing system can produce second motion forecast data using the interaction transformer model based on the second relative location embedding. The computing system can determine second respective trajectories for the actors using the prediction model based on the second forecast data.Type: ApplicationFiled: August 31, 2023Publication date: January 11, 2024Inventors: Lingyun Li, Bin Yang, Wenyuan Zeng, Ming Liang, Mengye Ren, Sean Segal, Raquel Urtasun Sotil
-
Patent number: 11858536Abstract: Example aspects of the present disclosure describe determining, using a machine-learned model framework, a motion trajectory for an autonomous platform. The motion trajectory can be determined based at least in part on a plurality of costs based at least in part on a distribution of probabilities determined conditioned on the motion trajectory.Type: GrantFiled: November 1, 2021Date of Patent: January 2, 2024Assignee: UATC, LLCInventors: Jerry Junkai Liu, Wenyuan Zeng, Raquel Urtasun, Mehmet Ersin Yumer
-
Publication number: 20230418717Abstract: The present disclosure provides systems and methods that combine physics-based systems with machine learning to generate synthetic LiDAR data that accurately mimics a real-world LiDAR sensor system. In particular, aspects of the present disclosure combine physics-based rendering with machine-learned models such as deep neural networks to simulate both the geometry and intensity of the LiDAR sensor. As one example, a physics-based ray casting approach can be used on a three-dimensional map of an environment to generate an initial three-dimensional point cloud that mimics LiDAR data. According to an aspect of the present disclosure, a machine-learned model can predict one or more dropout probabilities for one or more of the points in the initial three-dimensional point cloud, thereby generating an adjusted three-dimensional point cloud which more realistically simulates real-world LiDAR data.Type: ApplicationFiled: September 13, 2023Publication date: December 28, 2023Inventors: Sivabalan Manivasagam, Shenlong Wang, Wei-Chiu Ma, Kelvin Ka Wing Wong, Wenyuan Zeng, Raquel Urtasun
-
Publication number: 20230367318Abstract: Systems and methods for generating motion plans including target trajectories for autonomous vehicles are provided. An autonomous vehicle may include or access a machine-learned motion planning model including a backbone network configured to generate a cost volume including data indicative of a cost associated with future locations of the autonomous vehicle. The cost volume can be generated from raw sensor data as part of motion planning for the autonomous vehicle. The backbone network can generate intermediate representations associated with object detections and objection predictions. The motion planning model can include a trajectory generator configured to evaluate one or more potential trajectories for the autonomous vehicle and to select a target trajectory based at least in part on the cost volume generate by the backbone network.Type: ApplicationFiled: July 25, 2023Publication date: November 16, 2023Inventors: Wenyuan Zeng, Wenjie Luo, Abbas Sadat, Bin Yang, Rachel Urtasun
-
Publication number: 20230347941Abstract: Systems and methods are provided for forecasting the motion of actors within a surrounding environment of an autonomous platform. For example, a computing system of an autonomous platform can use machine-learned model(s) to generate actor-specific graphs with past motions of actors and the local map topology. The computing system can project the actor-specific graphs of all actors to a global graph. The global graph can allow the computing system to determine which actors may interact with one another by propagating information over the global graph. The computing system can distribute the interactions determined using the global graph to the individual actor-specific graphs. The computing system can then predict a motion trajectory for an actor based on the associated actor-specific graph, which captures the actor-to-actor interactions and actor-to-map relations.Type: ApplicationFiled: July 3, 2023Publication date: November 2, 2023Inventors: Wenyuan Zeng, Renjie Liao, Raquel Urtasun, Ming Liang
-
Patent number: 11797407Abstract: The present disclosure provides systems and methods that combine physics-based systems with machine learning to generate synthetic LiDAR data that accurately mimics a real-world LiDAR sensor system. In particular, aspects of the present disclosure combine physics-based rendering with machine-learned models such as deep neural networks to simulate both the geometry and intensity of the LiDAR sensor. As one example, a physics-based ray casting approach can be used on a three-dimensional map of an environment to generate an initial three-dimensional point cloud that mimics LiDAR data. According to an aspect of the present disclosure, a machine-learned model can predict one or more dropout probabilities for one or more of the points in the initial three-dimensional point cloud, thereby generating an adjusted three-dimensional point cloud which more realistically simulates real-world LiDAR data.Type: GrantFiled: April 22, 2022Date of Patent: October 24, 2023Assignee: UATC, LLCInventors: Sivabalan Manivasagam, Shenlong Wang, Wei-Chiu Ma, Kelvin Ka Wing Wong, Wenyuan Zeng, Raquel Urtasun
-
Patent number: 11780472Abstract: A computing system can input first relative location embedding data into an interaction transformer model and receive, as an output of the interaction transformer model, motion forecast data for actors relative to a vehicle. The computing system can input the motion forecast data into a prediction model to receive respective trajectories for the actors for a current time step and respective projected trajectories for the actors for a subsequent time step. The computing system can generate second relative location embedding data based on the respective projected trajectories from the second time step. The computing system can produce second motion forecast data using the interaction transformer model based on the second relative location embedding. The computing system can determine second respective trajectories for the actors using the prediction model based on the second forecast data.Type: GrantFiled: September 2, 2020Date of Patent: October 10, 2023Assignee: UATC, LLCInventors: Lingyun Li, Bin Yang, Wenyuan Zeng, Ming Liang, Mengye Ren, Sean Segal, Raquel Urtasun
-
Systems and methods for vehicle-to-vehicle communications for improved autonomous vehicle operations
Patent number: 11760386Abstract: Systems and methods for vehicle-to-vehicle communications are provided. An example computer-implemented method includes obtaining from a first autonomous vehicle, by a computing system onboard a second autonomous vehicle, a first compressed intermediate environmental representation. The first compressed intermediate environmental representation is indicative of at least a portion of an environment of the second autonomous vehicle and is based at least in part on sensor data acquired by the first autonomous vehicle at a first time. The method includes generating, by the computing system, a first decompressed intermediate environmental representation by decompressing the first compressed intermediate environmental representation. The method includes determining, by the computing system, a first time-corrected intermediate environmental representation based at least in part on the first decompressed intermediate environmental representation.Type: GrantFiled: October 8, 2020Date of Patent: September 19, 2023Assignee: UATC, LLCInventors: Sivabalan Manivasagam, Ming Liang, Bin Yang, Wenyuan Zeng, Raquel Urtasun, Tsun-Hsuan Wang -
Systems and methods for vehicle-to-vehicle communications for improved autonomous vehicle operations
Patent number: 11760385Abstract: Systems and methods for vehicle-to-vehicle communications are provided. An example computer-implemented method includes obtaining, by a computing system onboard a first autonomous vehicle, sensor data associated with an environment of the first autonomous vehicle. The method includes determining, by the computing system, an intermediate environmental representation of at least a portion of the environment of the first autonomous vehicle based at least in part on the sensor data. The method includes generating, by the computing system, a compressed intermediate environmental representation by compressing the intermediate environmental representation of at least the portion of the environment of the first autonomous vehicle. The method includes communicating, by the computing system, the compressed intermediate environmental representation to a second autonomous vehicle.Type: GrantFiled: October 8, 2020Date of Patent: September 19, 2023Assignee: UATC, LLCInventors: Sivabalan Manivasagam, Ming Liang, Bin Yang, Wenyuan Zeng, Raquel Urtasun, Tsun-hsuan Wang -
Patent number: 11755018Abstract: Systems and methods for generating motion plans including target trajectories for autonomous vehicles are provided. An autonomous vehicle may include or access a machine-learned motion planning model including a backbone network configured to generate a cost volume including data indicative of a cost associated with future locations of the autonomous vehicle. The cost volume can be generated from raw sensor data as part of motion planning for the autonomous vehicle. The backbone network can generate intermediate representations associated with object detections and objection predictions. The motion planning model can include a trajectory generator configured to evaluate one or more potential trajectories for the autonomous vehicle and to select a target trajectory based at least in part on the cost volume generate by the backbone network.Type: GrantFiled: August 15, 2019Date of Patent: September 12, 2023Assignee: UATC, LLCInventors: Wenyuan Zeng, Wenjie Luo, Abbas Sadat, Bin Yang, Raquel Urtasun
-
Publication number: 20230278582Abstract: Trajectory value learning for autonomous systems includes generating an environment image from sensor input and processing the environment image through an image neural network to obtain a feature map. Trajectory value learning further includes sampling possible trajectories to obtain a candidate trajectory for an autonomous system, extracting, from the feature map, feature vectors corresponding to the candidate trajectory, combining the feature vectors into the input vector, and processing, by a score neural network model, the input vector to obtain a projected score for the candidate trajectory. Trajectory value learning further includes selecting, from the candidate trajectories, the candidate trajectory as a selected trajectory based on the projected score, and implementing the selected trajectory.Type: ApplicationFiled: March 7, 2023Publication date: September 7, 2023Applicant: WAABI Innovation Inc.Inventors: Chris Jia Han Zhang, Runsheng Guo, Wenyuan Zeng, Raquel Urtasun
-
Patent number: 11731663Abstract: Systems and methods are provided for forecasting the motion of actors within a surrounding environment of an autonomous platform. For example, a computing system of an autonomous platform can use machine-learned model(s) to generate actor-specific graphs with past motions of actors and the local map topology. The computing system can project the actor-specific graphs of all actors to a global graph. The global graph can allow the computing system to determine which actors may interact with one another by propagating information over the global graph. The computing system can distribute the interactions determined using the global graph to the individual actor-specific graphs. The computing system can then predict a motion trajectory for an actor based on the associated actor-specific graph, which captures the actor-to-actor interactions and actor-to-map relations.Type: GrantFiled: November 17, 2021Date of Patent: August 22, 2023Assignee: UATC, LLCInventors: Wenyuan Zeng, Ming Liang, Renjie Liao, Raquel Urtasun
-
Patent number: 11691650Abstract: A computing system can be configured to input data that describes sensor data into an object detection model and receive, as an output of the object detection model, object detection data describing features of the plurality of the actors relative to the autonomous vehicle. The computing system can generate an input sequence that describes the object detection data. The computing system can analyze the input sequence using an interaction model to produce, as an output of the interaction model, an attention embedding with respect to the plurality of actors. The computing system can be configured to input the attention embedding into a recurrent model and determine respective trajectories for the plurality of actors based on motion forecast data received as an output of the recurrent model.Type: GrantFiled: February 26, 2020Date of Patent: July 4, 2023Assignee: UATC, LLCInventors: Lingyun Li, Bin Yang, Ming Liang, Wenyuan Zeng, Mengye Ren, Sean Segal, Raquel Urtasun
-
Systems and methods for vehicle-to-vehicle communications for improved autonomous vehicle operations
Patent number: 11685403Abstract: Systems and methods for vehicle-to-vehicle communications are provided. An example computer-implemented method includes obtaining from a first autonomous vehicle, by a second autonomous vehicle, a first compressed intermediate environmental representation. The first compressed intermediate environmental representation is indicative of at least a portion of an environment of the second autonomous vehicle. The method includes generating a first decompressed intermediate environmental representation by decompressing the first compressed intermediate environmental representation. The method includes determining, using one or more machine-learned models, an updated intermediate environmental representation based at least in part on the first decompressed intermediate environmental representation and a second intermediate environmental representation generated by the second autonomous vehicle.Type: GrantFiled: October 8, 2020Date of Patent: June 27, 2023Assignee: UATC, LLCInventors: Sivabalan Manivasagam, Ming Liang, Bin Yang, Wenyuan Zeng, Raquel Urtasun, Tsun-Hsuan Wang -
Publication number: 20230152247Abstract: A live flaw detection system for a multi-bundled conductor splicing sleeve and an application method thereof are disclosed. The system includes an upper apparatus and a lower apparatus, where the upper apparatus includes an unmanned aerial vehicle and an industrial X-ray machine, and a laser sensor, and the lower apparatus includes a press plate frame apparatus, vertical screw slide table modules, a horizontal screw slide table module, a projection imager, and a linear retractable apparatus. The unmanned aerial vehicle functions as a power apparatus that controls the system to be online or offline, the industrial X-ray machine is configured to perform ray flaw detection on each splicing sleeve, the laser sensor is configured to guide the unmanned aerial vehicle to land the lower apparatus on splicing sleeves accurately, and the press plate frame apparatus is configured to fixedly clamp the splicing sleeves.Type: ApplicationFiled: May 9, 2022Publication date: May 18, 2023Applicants: State Grid HuNan Electric Company Limited, STATE GRID HUNAN EXTRA HIGH VOLTAGE TRANSMISSION COMPANY, State Grid Corporation of ChinaInventors: Dehua ZOU, Shasha PENG, Zhipeng JIANG, Zhenyu WANG, Bocheng LI, Qiaosha XIAO, Yurong XU, Zhenyu CHEN, Wenyuan ZENG, Zhiguo LIU
-
Patent number: 11544167Abstract: The present disclosure provides systems and methods that combine physics-based systems with machine learning to generate synthetic LiDAR data that accurately mimics a real-world LiDAR sensor system. In particular, aspects of the present disclosure combine physics-based rendering with machine-learned models such as deep neural networks to simulate both the geometry and intensity of the LiDAR sensor. As one example, a physics-based ray casting approach can be used on a three-dimensional map of an environment to generate an initial three-dimensional point cloud that mimics LiDAR data. According to an aspect of the present disclosure, a machine-learned model can predict one or more dropout probabilities for one or more of the points in the initial three-dimensional point cloud, thereby generating an adjusted three-dimensional point cloud which more realistically simulates real-world LiDAR data.Type: GrantFiled: March 23, 2020Date of Patent: January 3, 2023Assignee: UATC, LLCInventors: Sivabalan Manivasagam, Shenlong Wang, Wei-Chiu Ma, Kelvin Ka Wing Wong, Wenyuan Zeng, Raquel Urtasun
-
Publication number: 20220262072Abstract: The present disclosure provides systems and methods that combine physics-based systems with machine learning to generate synthetic LiDAR data that accurately mimics a real-world LiDAR sensor system. In particular, aspects of the present disclosure combine physics-based rendering with machine-learned models such as deep neural networks to simulate both the geometry and intensity of the LiDAR sensor. As one example, a physics-based ray casting approach can be used on a three-dimensional map of an environment to generate an initial three-dimensional point cloud that mimics LiDAR data. According to an aspect of the present disclosure, a machine-learned model can predict one or more dropout probabilities for one or more of the points in the initial three-dimensional point cloud, thereby generating an adjusted three-dimensional point cloud which more realistically simulates real-world LiDAR data.Type: ApplicationFiled: April 22, 2022Publication date: August 18, 2022Inventors: Sivabalan Manivasagam, Shenlong Wang, Wei-Chiu Ma, Kelvin Ka Wing Wong, Wenyuan Zeng, Raquel Urtasun
-
Publication number: 20220153315Abstract: Systems and methods are provided for forecasting the motion of actors within a surrounding environment of an autonomous platform. For example, a computing system of an autonomous platform can use machine-learned model(s) to generate actor-specific graphs with past motions of actors and the local map topology. The computing system can project the actor-specific graphs of all actors to a global graph. The global graph can allow the computing system to determine which actors may interact with one another by propagating information over the global graph. The computing system can distribute the interactions determined using the global graph to the individual actor-specific graphs. The computing system can then predict a motion trajectory for an actor based on the associated actor-specific graph, which captures the actor-to-actor interactions and actor-to-map relations.Type: ApplicationFiled: November 17, 2021Publication date: May 19, 2022Inventors: Wenyuan Zeng, Ming Liang, Renjie Liao, Raquel Urtasun
-
Publication number: 20220153310Abstract: Techniques for improving the performance of an autonomous vehicle (AV) by automatically annotating objects surrounding the AV are described herein. A system can obtain sensor data from a sensor coupled to the AV and generate an initial object trajectory for an object using the sensor data. Additionally, the system can determine a fixed value for the object size of the object based on the initial object trajectory. Moreover, the system can generate an updated initial object trajectory, wherein the object size corresponds to the fixed value. Furthermore, the system can determine, based on the sensor data and the updated initial object trajectory, a refined object trajectory. Subsequently, the system can generate a multi-dimensional label for the object based on the refined object trajectory. A motion plan for controlling the AV can be generated based on the multi-dimensional label.Type: ApplicationFiled: November 17, 2021Publication date: May 19, 2022Inventors: Bin Yang, Ming Liang, Wenyuan Zeng, Min Bai, Raquel Urtasun