Patents by Inventor Shuqing Zeng

Shuqing Zeng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220253635
    Abstract: An attention-driven streaming system includes an adaptive-streaming module and a transceiver. The adaptive-streaming module includes filters, a compression module, an attention-driven strategy module and a fusion module. The filters filter sensor data received from sensors of a vehicle. The compression module compresses the filtered sensor data to generate compressed data. The attention-driven strategy module generates feedforward information based on a state of the vehicle and a state of an environment of the vehicle to adjust a region of interest. The fusion module generates an adaptive streaming strategy to adaptively adjust operations of each of the filters. The transceiver streams the compressed data to at least one of an edge computing device or a cloud-based network device and in response receive feedback information and pipeline monitoring information.
    Type: Application
    Filed: March 3, 2021
    Publication date: August 11, 2022
    Inventors: Bo YU, Sycamore Zhang, Shuqing Zeng, Kamran Ali, Vivek Vijaya Kumar, Donald K. Grimm
  • Publication number: 20220245598
    Abstract: A vehicle communication and control system includes a servicing host capable of exchanging data with a vehicle. The servicing host provides a vehicle service and includes a service identifier (ID) that indicates the vehicle service. The vehicle is configured to actively detect the service ID and to determine the vehicle service in response to detecting the service ID. The vehicle and the servicing host establish a wireless connection to exchange data and automatically initiate the vehicle service in response to detecting the service ID.
    Type: Application
    Filed: February 1, 2021
    Publication date: August 4, 2022
    Inventors: Wei Tong, Shuqing Zeng, Shige Wang, Jiang-Ling Du, Upali P. Mudalige
  • Publication number: 20220248194
    Abstract: A latency masking system for use in an autonomous vehicle (AV) system. The latency masking system comprises a sensors module providing sensor data from a plurality of sensors. The sensor data includes image frames provided by a vehicle camera and vehicle motion data. A wireless transceiver transmits the sensor data to a remote server associated with a network infrastructure and receives remote state information derived from the sensor data. An on-board function module receives the sensor data from the sensors module and generates local state information. A state fusion and prediction module receives the remote station information and the local state information and updates the local state information with the remote state information. The state fusion and prediction module uses checkpoints in a state history data structure to update the local state information with the remote state information.
    Type: Application
    Filed: January 29, 2021
    Publication date: August 4, 2022
    Inventors: Bo Yu, Can Carlak, Jimmy Qi, Shuqing Zeng, Fan Bai
  • Publication number: 20220219644
    Abstract: A vehicle includes a body supporting at least one camera. The at least one camera is positioned to collect images of objects outside of the vehicle. The vehicle also includes a selectively operable vehicle system and a controller operatively connected to the at least one camera and the selectively operable vehicle system. The controller includes a gesture recognition system operable to process a gesture made by a person associated with the vehicle collected by the at least one camera and activate the selectively operable vehicle system associated with the gesture.
    Type: Application
    Filed: January 11, 2021
    Publication date: July 14, 2022
    Inventors: Wei Tong, Shuqing Zeng, Xiaofeng F. Song, Mohannad Murad, Upali P. Mudalige
  • Publication number: 20220222129
    Abstract: A system includes a queue, a memory and a controller. The queue is configured to transfer a message between a first thread and a second thread, where the first thread and the second thread are implemented as part of a single process, and where an amount of data corresponding to the message is less than a set amount of data. The memory is configured for sharing data between the first thread and the second thread, wherein an amount of the data shared between the first thread and the second thread is greater than the set amount of data. The controller is configured to execute the single process including concurrently executing (i) a first middleware node process as the first thread, and (ii) a second middleware node process as the second thread.
    Type: Application
    Filed: January 12, 2021
    Publication date: July 14, 2022
    Inventors: Shige WANG, Wei Tong, Shuqing Zeng
  • Patent number: 11354888
    Abstract: A signal processing system includes a central processing unit (CPU) in communication with an accelerator, and an instruction scheduler in communication with the accelerator. A first memory device including a first instruction set is configured to operate the accelerator, a second instruction set is configured to operate the CPU, and a second memory device is configured to receive a datafile. The accelerator includes a plurality of processing engines (PEs) and an instruction scheduler, the instruction set includes a plurality of operators, and the instruction scheduler is configured to implement the operators in the accelerator employing the PEs. The CPU employs the operators implemented in the accelerator to analyze the datafile to extract a feature therefrom.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: June 7, 2022
    Assignee: GM Global Technology Operations LLC
    Inventors: Shige Wang, Wei Tong, Shuqing Zeng, Roman L. Millett
  • Publication number: 20220156533
    Abstract: A system includes first and second sensors and a controller. The first sensor is of a first type and is configured to sense objects around a vehicle and to capture first data about the objects in a frame. The second sensor is of a second type and is configured to sense the objects around the vehicle and to capture second data about the objects in the frame. The controller is configured to down-sample the first and second data to generate down-sampled first and second data having a lower resolution than the first and second data. The controller is configured to identify a first set of the objects by processing the down-sampled first and second data having the lower resolution. The controller is configured to identify a second set of the objects by selectively processing the first and second data from the frame.
    Type: Application
    Filed: November 16, 2020
    Publication date: May 19, 2022
    Inventors: Yasen HU, Shuqing ZENG
  • Patent number: 11325594
    Abstract: Methods and systems to implement sensor fusion to determine collision potential for a vehicle include identifying a specific intersection that the vehicle is approaching, and identifying collision potential scenarios associated with one or more paths through the specific intersection. Each collision potential scenario defines a risk of a collision between the vehicle and an object in a specified area. A weight with which one or more information sources of the vehicle are considered is adjusted for each collision potential scenario such that a highest weight is given to one or more of the one or more information sources that provide most relevant and reliable information about the specified area. Sensor fusion is implemented based on the adjusting the weight of the one or more information sources and performing detection based on the sensor fusion, and an alert is provided or actions are implemented according to the detection.
    Type: Grant
    Filed: February 10, 2020
    Date of Patent: May 10, 2022
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Shengbing Jiang, Shuqing Zeng, Prakash Mohan Peranandam, Meng Jiang, Jiyu Zhang, Mohamed A. Layouni
  • Patent number: 11300974
    Abstract: Methods and systems are provided for detecting objects within an environment of a vehicle. In one embodiment, a method includes: receiving, by a processor, image data sensed from the environment of the vehicle; determining, by a processor, an area within the image data that object identification is uncertain; controlling, by the processor, a position of a lighting device to illuminate a location in the environment of the vehicle, wherein the location is associated with the area; controlling, by the processor, a position of one or more sensors to obtain sensor data from the location of the environment of the vehicle while the lighting device is illuminating the location; identifying, by the processor, one or more objects from the sensor data; and controlling, by the processor, the vehicle based on the one or more objects.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: April 12, 2022
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Lawrence A. Bush, Upali P. Mudalige, Zachariah E. Tyree, Wei Tong, Shuqing Zeng
  • Patent number: 11281974
    Abstract: In one example implementation according to aspects of the present disclosure, a computer-implemented method includes capturing a plurality of images at a camera associated with a vehicle and storing image data associated with the plurality of images to a memory. The method further includes dispatching vehicle perception tasks to a plurality of processing elements of an accelerator in communication with the memory. The method further includes performing, by at least one of the plurality of processing elements, the vehicle perception tasks for the vehicle perception using a neural network, wherein performing the vehicle perception tasks comprises performing an activation bypass for values below a first threshold, and performing weight pruning of synapses and neurons of the neural network based at least in part on a second threshold. The method further includes controlling the vehicle based at least in part on a result of performing the vehicle perception tasks.
    Type: Grant
    Filed: October 25, 2018
    Date of Patent: March 22, 2022
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Shuqing Zeng, Wei Tong, Shige Wang, Roman L. Millett
  • Patent number: 11204417
    Abstract: The vehicle mounted perception sensor gathers environment perception data from a scene using first and second heterogeneous (different modality) sensors, at least one of the heterogeneous sensors is directable to a predetermined region of interest. A perception processor receives the environment perception data and performs object recognition to identify objects each with a computed confidence score. The processor assesses the confidence score vis-à-vis a predetermined threshold, and based on that assessment, generates an attention signal to redirect the one of the heterogeneous sensors to a region of interest identified by the other heterogeneous sensor. In this way information from one sensor primes the other sensor to increase accuracy and provide deeper knowledge about the scene and thus do a better job of object tracking in vehicular applications.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: December 21, 2021
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Shuqing Zeng, Wei Tong, Upali P. Mudalige, Lawrence A. Bush
  • Patent number: 11155258
    Abstract: A risk maneuver assessment system and method to generate a perception of an environment of a vehicle and a behavior decision making model for the vehicle; a sensor system configured to provide the sensor input in the environment for filtering target objects; one or more modules configured to map and track target objects to make a candidate detection from multiple candidate detections of a true candidate detection as the tracked target object; apply a Markov Random Field (MRF) algorithm for recognizing a current situation of the vehicle and predict a risk of executing a planned vehicle maneuver at the true detection of the dynamically tracked target; apply mapping functions to sensed data of the environment for configuring a machine learning model of decision making behavior of the vehicle; and apply adaptive threshold to cells of an occupancy grid for representing an area of tracking of objects within the vehicle environment.
    Type: Grant
    Filed: March 25, 2019
    Date of Patent: October 26, 2021
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Lawrence A. Bush, Manpreet S. Bajwa, Shuqing Zeng, Rickie A. Sprague
  • Patent number: 11119187
    Abstract: A system and method to resolve ambiguity in a radar system involve detecting one or more objects with the radar system. The detecting includes obtaining range, azimuth, and an ambiguous range rate of a first object of the one or more objects. A plurality of Kalman filters are generated with state variables that include parameters based on the range, the azimuth, and the ambiguous range rate. Each of the plurality of Kalman filters provides a different estimate for an unambiguous range rate. The method also includes updating the plurality of Kalman filters using additional detections by the radar system, selecting a selected Kalman filter from among the plurality of Kalman filters that exhibits a highest probability mass among a plurality of probability mass corresponding with and derived from the plurality of Kalman filters, and determining the unambiguous range rate of the object using the selected Kalman filter.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: September 14, 2021
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Shuqing Zeng, Igal Bilik, Yasen Hu
  • Publication number: 20210245743
    Abstract: Methods and systems to implement sensor fusion to determine collision potential for a vehicle include identifying a specific intersection that the vehicle is approaching, and identifying collision potential scenarios associated with one or more paths through the specific intersection. Each collision potential scenario defines a risk of a collision between the vehicle and an object in a specified area. A weight with which one or more information sources of the vehicle are considered is adjusted for each collision potential scenario such that a highest weight is given to one or more of the one or more information sources that provide most relevant and reliable information about the specified area. Sensor fusion is implemented based on the adjusting the weight of the one or more information sources and performing detection based on the sensor fusion, and an alert is provided or actions are implemented according to the detection.
    Type: Application
    Filed: February 10, 2020
    Publication date: August 12, 2021
    Inventors: Shengbing Jiang, Shuqing Zeng, Prakash Mohan Peranandam, Meng Jiang, Jiyu Zhang, Mohamed A. Layouni
  • Publication number: 20210239449
    Abstract: An electric powertrain includes a sensor-controller interface, an inverter-controller electrically connected to the battery pack, and an electric machine connected to the inverter-controller and having a rotor with an angular position. The rotor powers a driven load at a torque and/or speed level controlled by the inverter-controller in response to position signals indicative of the angular position. A rotary position sensor is operatively connected to the rotor to generate and output the position signals. The sensor derives the position signals from unmodulated sine and cosine signals, and communicates the position signals and a binary sensor state of health (SOH) to the inverter-controller over the interface. The inverter-controller also decodes the position signals and the binary sensor SOH to generate decoded control data, and controls the torque and/or speed level using the decoded control data.
    Type: Application
    Filed: January 30, 2020
    Publication date: August 5, 2021
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Suresh Gopalakrishnan, Shuqing Zeng, Chandra S. Namuduri
  • Publication number: 20210179115
    Abstract: A method and associated system for monitoring the on-vehicle yaw-rate sensor includes determining a vehicle heading during vehicle operation and determining a first vehicle heading parameter based thereon. A second vehicle heading parameter is determined via the yaw-rate sensor. A yaw-rate sensor bias parameter is determined based upon the first vehicle heading parameter and the second vehicle heading parameter. A first yaw term is determined via the yaw-rate sensor, and a final yaw term is determined based upon the first yaw term and the yaw-rate sensor bias parameter.
    Type: Application
    Filed: December 16, 2019
    Publication date: June 17, 2021
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Jagannadha Reddy Satti, Xiaofeng F. Song, Shuqing Zeng, Abdoul Karim Abdoul Azizou, Azadeh Farazandeh
  • Publication number: 20210181350
    Abstract: In an exemplary embodiment, a LiDAR is provided that is configured for installation in a mobile platform. The LiDAR includes a scanner and a light-intensity receiver. The scanner includes a light source configured to direct illumination in an illuminating direction. The light-intensity receiver includes one or more light-intensity sensors; and one or more lens assemblies configured with respect to the one or more light-intensity sensors, such that that at least one sensor plane from the one or more light-intensity sensors is tilted to form a non-zero angle with at least one equivalent lens plane from the one or more lens assemblies, transferring the sensor focal plane to be align with the main light illumination direction and be consistent with the direction of movement of a mobile platform.
    Type: Application
    Filed: December 12, 2019
    Publication date: June 17, 2021
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wei Zeng, Shuqing Zeng, Scott E. Parrish
  • Patent number: 11035945
    Abstract: System and method of controlling operation of a device in real-time. The system includes an optical sensor having a steerable optical field of view for obtaining image data and a radar unit having a steerable radar field of view for obtaining radar data. A controller may be configured to steer a first one of the optical sensor and the radar unit to a first region of interest and a second one of the optical sensor and the radar unit to the second region of interest. The controller may be configured to steer both the optical sensor and the radar unit to the first region of interest. The radar data and the image data are fused to obtain a target location and a target velocity. The controller is configured to control operation of the device based in part on at least one of the target location and the target velocity.
    Type: Grant
    Filed: April 18, 2019
    Date of Patent: June 15, 2021
    Assignee: GM Global Technology Operations LLC
    Inventors: Tzvi Philipp, Shahar Villeval, Igal Bilik, Jeremy A. Salinger, Shuqing Zeng
  • Publication number: 20210129842
    Abstract: Presented are embedded control systems with logic for computation and data sharing, methods for making/using such systems, and vehicles with distributed sensors and embedded processing hardware for provisioning automated driving functionality. A method for operating embedded controllers connected with distributed sensors includes receiving a first data stream from a first sensor via a first embedded controller, and storing the first data stream with a first timestamp and data lifespan via a shared data buffer in a memory device. A second data stream is received from a second sensor via a second embedded controller. A timing impact of the second data stream is calculated based on the corresponding timestamp and data lifespan. Upon determining that the timing impact does not violate a timing constraint, the first data stream is purged from memory and the second data stream is stored with a second timestamp and data lifespan in the memory device.
    Type: Application
    Filed: November 1, 2019
    Publication date: May 6, 2021
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Shige Wang, Wei Tong, Stephen N. McKinnie, Shuqing Zeng
  • Patent number: 10984534
    Abstract: Systems and methods to identify an attention region in sensor-based detection involve obtaining a detection result that indicates one or more detection areas where one or more objects of interest are detected. The detection result is based on using a first detection algorithm. The method includes obtaining a reference detection result that indicates one or more reference detection areas where one or more objects of interest are detected. The reference detection result is based on using a second detection algorithm. The method also includes identifying the attention region as one of the one or more reference detection areas without a corresponding one or more detection areas. The first detection algorithm is used to perform detection in the attention region.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: April 20, 2021
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wei Tong, Shuqing Zeng, Upali P. Mudalige