Patents Assigned to GM CRUISE HOLDINGS LLC
  • Publication number: 20250095412
    Abstract: An AV may detect degraded states of other AVs. For instance, the AV may use its sensors to detect one or more other vehicles in the local area. The AV may determine whether any of these vehicles is a peer of the AV based on features of these vehicles captured by its sensors. Alternatively, the AV may determine if any vehicle is a peer based on encrypted communication with the vehicle. The AV may also determine whether any peer AV has a state that deviates from an expected or desirable state. The AV may communicate with an online system and request the online system to provide information for identifying the vehicle or detecting degraded states. The AV may also report degradations in peer AVs to the online system. The online system may recover the degraded AV or dispatch another AV to complete a task assigned to the degraded AV.
    Type: Application
    Filed: September 14, 2023
    Publication date: March 20, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Domenico Rusciano, Omair Siddiqui, Arshad Zaman, Jose Maciel Torres, Kunal Mehta, Miles Avery Bowman, Mamoon Masud
  • Publication number: 20250088385
    Abstract: A set of devices are coupled to a control area network (CAN) bus. At least some of the devices include switchable resistors that can apply a termination resistor to the CAN bus. Identification pins are used to identify devices on the CAN bus, and also to identify which device or devices are at the ends of the CAN bus. If a device is at an end of the CAN bus, the switch of the switchable resistor is set to couple the termination resistor to the CAN bus. Otherwise, the termination resistor is not coupled to the CAN bus.
    Type: Application
    Filed: September 8, 2023
    Publication date: March 13, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Yingchang Yang, Jaimin Patel, Jason Seitz, Isaac Brown, Thomas Ray Shelburne, Devin Cass
  • Publication number: 20250088574
    Abstract: A unified electronic control unit (ECU) interface provides a bridge from ECU clients to the ECU. The ECU interface may be implemented on a vehicle's onboard computer, and it may be used by clients executing on the onboard computer and, in some cases, by clients outside the onboard computer. The ECU interface may receive a request from a client in a first messaging format, e.g., a local networking protocol used by processes running on the vehicle. The ECU interface translates the request into a second messaging format and transmits the request to the ECU. The ECU interface receives a response from the ECU and translates the response into the first messaging format for delivery to the client. The ECU interface may further perform authentication of the client and/or the ECU, packet serialization of the response from the ECU, packet diagnostics, and other functionalities associated with communicating with the ECU.
    Type: Application
    Filed: September 8, 2023
    Publication date: March 13, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Aniket Ratnakar, ShuTing Guo
  • Publication number: 20250077731
    Abstract: Disclosed are embodiments for facilitating purposeful stress testing of autonomous vehicle response time with simulation. In some aspects, an embodiment includes receiving a request to launch a simulation scenario on an autonomous vehicle (AV) that is to operate on a real-world test course; initiating a simulation derived from the simulation scenario using a simulation driver that is executing on the AV; engaging operation of the AV on the real-world test course; coordinating a simulated AV position in the simulation with a physical AV position of the AV on the real-world test course; combining virtual entities from the simulation with physical entities on the real-world test course into a list of tracked objects for the AV; and causing the AV to respond to the list of tracked objects including the virtual entities and the physical entities during the operation of the AV on the real-world test course.
    Type: Application
    Filed: August 28, 2023
    Publication date: March 6, 2025
    Applicant: GM CRUISE HOLDINGS LLC
    Inventors: Sidney Oderberg, Christopher Kniffin, Robert Tsai, Samuel J. Abrahams, Sagar Tatipamula, Pradeep Bhatta, Zhe Zhang, Tommaso Colombo
  • Publication number: 20250076499
    Abstract: An ultrasonic detection system provides enhanced object detection capabilities. The ultrasonic detection system can generate complex ultrasonic waveforms based on excitation voltage waveforms constructed using high frequency components. In certain embodiments, an ultrasonic detection system may be capable of producing multiple different waveforms, e.g., different waveforms output by different transmitters, or multiple time-multiplexed waveforms output by the same transmitter. The ultrasonic detection system may be included in an autonomous vehicle (AV) for object detection in the environment of the AV.
    Type: Application
    Filed: August 29, 2023
    Publication date: March 6, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Yingchang Yang, Amanda Lind, Behrad Kajbafzadeh, Jason Seitz, Anurup Guha, Nicholas Robinson, Fred Schleifer, Daniel Zaenker
  • Publication number: 20250077958
    Abstract: Autonomous vehicles utilize perception to identify objects in a vehicle's surrounding environment and plan a trajectory. In perceiving an AV's surroundings, an object detection model uses sensor data from AV sensors to detect objects in the AV surroundings. An object detection model can be trained to detect objects using training datasets having sensor data and ground truth objects. In training, the object detection model uses the sensor data to identify objects in the locations of the ground truth objects. However, sometimes there is little or no sensor data corresponding to the ground truth objects, and the model is not able to learn patterns in sensor data to correctly detect the objects. Systems and methods are provided herein for removing ground truth objects that do not have sufficient corresponding sensor data from the training dataset, thereby preventing these objects from dominating the loss and interfering with the model learning useful patterns.
    Type: Application
    Filed: September 1, 2023
    Publication date: March 6, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Sven Möller, Michael Meyer, Marc Unzueta, Filippo Grazioli
  • Publication number: 20250078651
    Abstract: Autonomous vehicles (AVs) utilize perception and understanding of objects on the road to predict behaviors of the objects, and to plan a trajectory for the vehicle. In some scenarios, an AV may benefit from having information about an object that is not within a perceivable area of the sensors of the AV. Another AV in the area that has the object within a perceivable area of the sensors of the other AV may share information with the AV. Rich information about the object determined by the other AV can be compressed using an encoder and transferred efficiently to the AV for inclusion in a temporal map that combines locally determined object information and transferred object information determined by other AV(s). The temporal map may be used in one or more parts of the software stack of the AV.
    Type: Application
    Filed: September 1, 2023
    Publication date: March 6, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Marc Unzueta, Michael Meyer, Sven Möller, Filippo Grazioli
  • Publication number: 20250078440
    Abstract: Autonomous vehicles (AVs) utilize perception and understanding of objects on the road to predict behaviors of the objects, and to plan a trajectory for the vehicle. In some situations, an object may be occluded and undetected by an AV. However, a different AV viewing the same scene may detect the object. With information from multiple views of the same scene, it is possible to determine occlusion attributes for the object, such as relational occlusion information and extent of occlusion. For the AV that is driving on the road, having knowledge of the occluded object and the occlusion attributes can improve the performance of perception, understanding, tracking, prediction, and/or planning algorithms. For the algorithms, occlusion attributes can be generated from the multi-view data and included as part of labeled data for machine learning training. The models in the algorithms can learn to better handle occluded objects.
    Type: Application
    Filed: September 1, 2023
    Publication date: March 6, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Marc Unzueta, Michael Meyer, Sven Möller, Filippo Grazioli
  • Publication number: 20250078485
    Abstract: Systems and methods for automatic removal for selected training data from a dataset are provided. Systems and methods are provided for identifying portions of radar data that contain information that is not present in camera and/or lidar data. The identified portions of the radar data can be processed by a neural network to provide the additional information. The identified parts of the radar data can then be processed while the remaining parts of the radar data remain unprocessed. In various examples, features can be extracted from identified regions of the radar data using a neural network and fused with camera and/or lidar features. In some examples, the fused features can be used for object detection.
    Type: Application
    Filed: September 1, 2023
    Publication date: March 6, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Sven Möller, Michael Meyer, Marc Unzueta, Filippo Grazioli
  • Publication number: 20250069410
    Abstract: A method includes dividing an image into a plurality of patches; generating for the patches image tokens each including a halting score associated with the image token; generating a contextual features token representative of at least one contextual feature in connection with the image; processing the image tokens and the contextual features token using a vision transformer block; performing adaptive halting on the image tokens output from the transformer block, the adaptive halting comprising updating the halting scores associated with the image tokens and discarding ones of the image tokens having halting scores greater than or equal to a predetermined threshold score, wherein the non-discarded image tokens comprise remaining image tokens; and forwarding the remaining image tokens to a next processing block.
    Type: Application
    Filed: August 23, 2023
    Publication date: February 27, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Filippo Grazioli, Michael Meyer, Sven Möller, Marc Unzueta
  • Publication number: 20250065906
    Abstract: A computer vision module facilitates multi-sensor vision of AVs based on privileged information learning. The module may input first sensor data captured by a first sensor into an already-trained privileged model, input second sensor data captured by a second sensor into a first backbone of a target model, and input third sensor data captured by a third sensor into a second backbone of the target model. The three sensors may be of different types. To train the target model, internal parameters of the target model may be modified to minimize a loss, which may include a privilege loss, which indicates a difference between a latent representation of the first sensor data and a latent representation of the second sensor data, and another privileged loss, which indicates a difference between the latent representation of the first sensor data and a latent representation of the third sensor data.
    Type: Application
    Filed: August 23, 2023
    Publication date: February 27, 2025
    Applicant: GM Cruise Holdings LLC
    Inventors: Filippo Grazioli, Sven Möller, Marc Unzueta, Michael Meyer
  • Patent number: 12233887
    Abstract: An operation of an AV in a scene is simulated. The AV includes sensors detecting the scene and generating sensor data. The sensor data can be input into a control model that outputs control signals, in accordance with which the AV operates. A learning cost, i.e., a cost of training or applying the control model, is determined. A performance of the AV during the simulation is evaluated. A simulation cost, i.e., a cost of running the simulation is determined. The control model can be optimized based on the learning cost and the performance of the AV. Settings of the sensors can be optimized based on the simulation cost and the performance of the AV. The optimization of the control model or the settings of the sensors can be done through reinforcement learning.
    Type: Grant
    Filed: May 31, 2022
    Date of Patent: February 25, 2025
    Assignee: GM Cruise Holdings LLC
    Inventor: Burkay Donderici
  • Patent number: 12227208
    Abstract: Systems and methods for collision imminent detection are provided. A method includes collecting sensor data generated by one or more sensors of a vehicle; detecting, by a fallback control system of the vehicle based on the sensor data, an imminent collision between the vehicle and an object in an environment of the vehicle using a first process different from a second process of a primary control system of the vehicle, wherein the first process and the second process are associated with at least one of a perception or a prediction; and transmitting, by the fallback control system to the primary control system, an indication of the detected imminent collision.
    Type: Grant
    Filed: June 15, 2022
    Date of Patent: February 18, 2025
    Assignee: GM Cruise Holdings LLC
    Inventors: Juan Fasola, Eugene Lo, Xiaoyu Zhou, Shreyans Kushwaha
  • Patent number: 12228757
    Abstract: Color filter array patterns are provided for enhancing an image sensor's light sensitivity while preserving a color accuracy for image signal processing applications. In one example, an image sensor can include a substrate layer containing a first set of photodiodes and a second set of photodiodes, wherein each of the first set of photodiodes is larger than each of the second set of photodiodes; a first color filter array (CFA) covering the first set of photodiodes, wherein the first CFA includes a first set of color filters and a portion of the first set of color filters includes one or more clear filters; a second CFA covering the second set of photodiodes, wherein the second CFA includes a second set of color filters that is different than the first set of color filters; and one or more lenses covering the first CFA and the second CFA.
    Type: Grant
    Filed: April 5, 2023
    Date of Patent: February 18, 2025
    Assignee: GM Cruise Holdings LLC
    Inventors: Ming-Hsuan Hsu, Boyang Zhang, Shane McGuire
  • Patent number: 12230021
    Abstract: The disclosed technology provides methods for training of a convolutional neural network (CNN) to identify or predict its own errors, and then those errors are used as inputs with feature visualization to generate images of scenes associated with those errors. This allows adjustment of a set of labeled training images, and then the adjusted set of labeled training images are used to retrain or further train the CNN. Systems and machine-readable media are also provided.
    Type: Grant
    Filed: April 6, 2022
    Date of Patent: February 18, 2025
    Assignee: GM Cruise Holdings LLC
    Inventors: Craig Quiter, Siddhartho Bhattacharya, Mayank Ketkar, Raluca Musaloiu-Elefteri, Wanlin Yang, Sandeep Gangundi
  • Patent number: 12227186
    Abstract: Apparatus and methods of the present disclosure provide a solution to quickly sort through and identify relevant data sets from large amounts of data collected by numerous vehicles. This process is a form of data mining where a processor executes instructions out of a memory to evaluate sensor data collected by vehicles over time. These vehicles may be driven by person's such that data collected by those sensors would be representative of how a person drives. After data has been acquired, it may be evaluated to identify portions of data where one vehicle encounters another vehicle along a roadway. Data may be classified as being associated with particular types of driving maneuvers and organized into data sets with labels consistent with the classification or driving maneuver. Classifications could correspond to different typed of driving maneuvers, “turning left across traffic,” “all way stop,” “merging onto a highway,” or “lane change”.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: February 18, 2025
    Assignee: GM Cruise Holdings LLC
    Inventors: Adeel Mufti, Prathyush Katukojwala, Na Yu
  • Patent number: 12230009
    Abstract: System, methods, and computer-readable media for a training technique of an object trajectory prediction model that inputs semantic map data pertaining to an environment and trajectory data of an object into an autoencoder neural network, which outputs the original trajectory as a feature embedding vector. Each feature embedding vector serves as a unique identifier for each behavior. Cluster analysis is performed on feature embedding vectors to determine clusters, each associated with a particular behavior attribute.
    Type: Grant
    Filed: December 22, 2021
    Date of Patent: February 18, 2025
    Assignee: GM Cruise Holdings LLC
    Inventor: Hariprasad Govardhanam
  • Patent number: 12227173
    Abstract: Systems and methods for a vehicle to use a fallback control system orthogonal to a primary control system are provided. A method includes collecting, by a fallback control system of a vehicle, sensor data generated by one or more sensors of the vehicle; determining, by the fallback control system using a first process different from a second process of a primary control system of the vehicle, an alternative action for the vehicle based on the sensor data; and sending, by the fallback control system based on the alternative action, an instruction for modifying an action associated with the primary control system upon a faulty condition associated with the primary control system.
    Type: Grant
    Filed: June 15, 2022
    Date of Patent: February 18, 2025
    Assignee: GM Cruise Holdings LLC
    Inventors: Juan Fasola, Eugene Lo, Xiaoyu Zhou, Shreyans Kushwaha
  • Patent number: 12227175
    Abstract: An autonomous vehicle (AV) is described herein. The AV is configured to identify an occluded region where a portion of a field of view of a sensor is occluded by an object. The AV is further configured to hypothesize that an object exists in the occluded region and is moving in the occluded region. The AV is still further configured to perform a driving maneuver based upon the hypothesized object existing in the occluded region.
    Type: Grant
    Filed: August 17, 2023
    Date of Patent: February 18, 2025
    Assignee: GM Cruise Holdings LLC
    Inventors: Shiva Ghose, Daniel Chen, Ted Nitz, Christophe Philippona, Curt Harrington, Christopher Daily-Diamond, Mason Swofford, Ryan Holben, Eric Lujan, Benjamin Greer, Francesco Capodieci
  • Patent number: 12230036
    Abstract: Particular embodiments described herein provide for a system and method for determining an intent of a third-party autonomous vehicle by an autonomous vehicle. The method can include identifying the third-party autonomous vehicle, identifying a third-party autonomous vehicle behavior signature associated with the third-party autonomous vehicle, capturing sensor data related to the third-party autonomous vehicle, analyzing the captured sensor data to determine behaviors of the third-party autonomous vehicle, and using a third-party autonomous vehicle behavior signature to determine if the behaviors of the third-party autonomous vehicle indicate a specific intent of the third-party autonomous vehicle. The third-party autonomous vehicle behavior signature can be created by identifying behaviors of the third-party autonomous vehicle and associating the behaviors with an intent of the third-party autonomous vehicle.
    Type: Grant
    Filed: June 22, 2022
    Date of Patent: February 18, 2025
    Assignee: GM Cruise Holdings LLC
    Inventor: Burkay Donderici