Abstract: The technology described herein provides systems and methods for an Autonomous Vehicle Cloud Control System (AVCCS) with a World Model. The AVCCS comprises a cloud-based platform, a communication module, and/or an onboard unit (OBU). The AVCCS leverages generative models, predictive models, and reinforcement learning methods to generate and synthesize comprehensive information at real-time, short-term, and long-term scales for sensing, transportation behavior prediction and management, planning and decision-making, and/or vehicle control. The comprehensive information generated from the World Model comprises vehicle surrounding information, weather information, vehicle attribute data, traffic state information, road information, and incident information.

Abstract: The technology described herein provides systems and methods for an Automated Driving Cloud System (ADCS) for long-tail corner cases. The ADCS for long-tail corner cases comprises a cloud-based platform, a communication module, and/or an onboard unit (OBU). The ADCS leverages world models to provide automated driving functions including sensing, prediction, planning, decision making, and control at microscopic, mesoscopic, and/or macroscopic levels. The system is specifically designed to address long-tail corner cases, which include work zones, special events, reduced speed zones, incident detection, buffer spaces, and adverse weather conditions. Additionally, the ADCS is configured to provide safety and efficiency measures for vehicle operations and control at various special scales that require additional system coverage, including construction zones, special event zones, and special weather conditions. The ADCS enables adaptive and reliable automated driving in highly uncertain and dynamic environments.

Abstract: The technology described herein provides a cloud-based learning system (CLS) for end to end and/or sequential models for autonomous driving. The CLS provides high-performance computation capability that allocates computation power for sensing, prediction, planning and decision making, and control at a microscopic level, a mesoscopic level, and/or a macroscopic level. The CLS can acquire computation resources from a cloud system and from one or more of a roadside unit network, a network of vehicles comprising onboard units, a traffic control center/traffic control unit, or a traffic operations center. Additionally, the CLS is configured to optimize and generate detailed customized information and time-sensitive control instructions for vehicles by processing data through learning models to fulfill driving tasks and provide operations and maintenance services for vehicles.

Abstract: This application describes a proactive sensing system for an autonomous vehicle. This system fuses vehicle sensing data and sensing data from a roadside unit, a Traffic Control Unit, and/or a cloud to provide full 360-degree coverage and birds-eye view of the driving environment. This proactive sensing system cooperatively uses vehicle-based sensor data and sensor data from external sources to provide better and more efficient sensing of longtail or corner cases, such as blind spots and blockage by surrounding objects. Specifically, this proactive sensing system effectively identifies major sensing points where vulnerable road users, such as pedestrians and bicycles, are major challenges for autonomous vehicles at intersections, roundabouts, or work zones. Accordingly, the technology significantly improves the safety of autonomous vehicles.

Abstract: The technology relates to a systematic intelligent system (SIS) configured to share data and allocate computing resources among automated driving systems (ADS), e.g., using unified data specifications and interfaces. The SIS comprises systematic intelligent units (SIU) that serve components of ADS, including vehicle intelligent units (VIU) and roadside intelligent units (RIU), and is configured to perform methods to serve an entire trip.

Abstract: The invention provides a vehicle AI computing system (VACS) that supports autonomous driving through an Onboard Unit (OBU) for vehicle-based computing and distributed computing based on vehicle-road-cloud. The vehicle-based computing can effectively complete various computational tasks by using onboard computing resources. The distributed computing allows the vehicle to work in collaboration with roadside units (RSUs) and/or the cloud to effectively complete various computational tasks. The VACS features an OBU with a sensing module, a communication module, and a data processing module that integrates data from vehicle sensors, RSUs, and the cloud. The OBU also includes a vehicle control module that helps control the vehicle based on the data of RSU and cloud. The VACS leverages high-performance computation resources to implement end-to-end driving tasks including sensing, prediction, planning and decision-making, and control.

Abstract: The Intelligent Information Conversion System (IICS) facilitates real-time dynamic information exchange among connected and automated vehicle (CAV), roadside intelligent unit (RIU), and cloud platform. The system comprises a codebook, coding module, connector module, and supporting system. The codebook provides a standardized format for information exchange, using a sequence of integers corresponding to various categories such as vehicle automation level, vehicle type, and road category. The coding module encodes and decodes information to enable seamless communication among CAV, RIU, and cloud platform, optimizing data transmission and service levels for autonomous driving. The system supports sorting, encoding, and decoding information into a codebook string, improving real-time interaction and information flow across connected environments. It enhances vehicle automation and supports dynamic, context sensitive data exchanges between different entities in the autonomous ecosystem.

Abstract: Provided herein is technology relating to aspects of a Distributed Driving System (DDS) for managing Connected and Automated Vehicles (CAV) and particularly, but not exclusively, to systems, designs, and methods for a Device Allocation System (DAS) configured to allocate and distribute resources to devices of a Distributed Driving Systems (DDS).

Abstract: Provided herein is a technology for an Autonomous Vehicle Cloud System (AVCS). This AVCS provides sensing, data fusion, prediction, decision-making, and/or control instructions for specific vehicles at a microscopic level based on data from one or more of other vehicles, roadside unit (RSU), cloud-based platform, and traffic control center/traffic control unit (TCC/TCU). Specifically, the AVs can be effectively and efficiently operated and controlled by the AVCS. The AVCS provides individual vehicles with detailed time-sensitive control instructions for fulfilling driving tasks, including car following, lane changing, route guidance, and other related information. The AVCS is configured to predict individual vehicle behavior and provide planning and decision-making at a microscopic level. In addition, the AVCS is configured to provide one or more of virtual traffic light management, travel demand assignment, traffic state estimation, and platoon control.

Abstract: Provided herein is a technology for an Autonomous Vehicle Intelligent System (AVIS), which facilitates vehicle operations and control for autonomous driving. The AVIS and related methods provide vehicles with vehicle-specific information for a vehicle to perform driving tasks such as car following, lane changing, and route guidance. The AVIS comprises an onboard unit (OBU), wherein the OBU comprises a communication module communicating with one or more of other autonomous vehicles (AV), a roadside unit (RSU), a cloud platform, and a traffic control center/traffic control unit (TCC/TCU). The AVIS implements one or more of the following functions: sensing, prediction, decision-making, and vehicle control using onboard information and vehicle-specific information received from other AVs, the RSU, the cloud platform, and/or the TCC/TCU.

Abstract: The invention provides systems and methods for a computing power allocation system for autonomous driving (CPAS-AD), which is a component of an Intelligent Road Infrastructure System (IRIS). The CPAS-AD incorporates advanced computing capabilities that effectively allocate computational power for sensing, prediction, planning, decision-making, and control functions to enable end-to-end driving functions. In addition to the vehicle, the CPAS-AD can acquire additional computation resources from one or more of: (a) a roadside unit (RSU) network, (b) a cloud platform, (c) a traffic control center/traffic control unit (TCC/TCU), and (d) a traffic operations center (TOC). Additionally, tailored to different traffic scenarios, the CPAS-AD can allocate data and computation resources (including but not limited to CPU and GPU) for vehicle sensing, prediction, planning, decision-making, and control functions, thereby enabling safe and efficient autonomous driving.

Abstract: The invention provides systems and methods for a function-based computing power allocation system (FCPAS), which is a component of an Intelligent Road Infrastructure System (IRIS). The FCPAS incorporates advanced computing capabilities that effectively allocate computational power for prediction, planning, and decision making functions. Specifically, through the FCPAS, an AV can acquire additional computational resources for vehicle prediction, planning, and decision-making functions, thereby enabling safe and efficient autonomous driving. Additionally, tailored to different traffic scenarios, the FCPAS can allocate data and computational resources (including but not limited to CPU and GPU) for vehicle automation.

Abstract: Provided herein is technology relating to automated driving and particularly, but not exclusively, to an intelligent information conversion system and related methods for providing collaborative automatic driving to intelligent transportation systems, vehicle networking systems, collaborative management control systems, vehicle-road collaborative systems, automated driving systems, and the like.

Abstract: Provided herein is technology relating to a function allocation system (FAS) that deploys artificial intelligence models for a connected automated highway (CAH) system and a connected automated vehicle (CAV) system to distribute driving intelligence between the CAV system and the CAH system. The FAS comprises a communication module, a data module, and a computing module. The computing module is configured to analyse scenes using sensing data, determine automated driving function requirements, deploy function allocation methods, and analyse CAH system and CAV system functions. The function allocation methods provide analysis, guidance, and optimization capabilities for sensing, decision-making, and control functions. The FAS allocates automated driving functions to the CAV system and the CAH system based on their respective intelligence levels.

Abstract: The invention provides a roadside computing system (RCS), or an edge computing system, for an autonomous vehicle. The RCS comprises a hierarchy of roadside unit (RSU) and an onboard unit (OBU) in an individual vehicle. The RSU comprises a data processing module and a communication module, and is capable of generating guidance information and targeted instructions for individual vehicle. The data processing module of the RSU comprises two processors: an External Object Calculating Module (EOCM) and an AI processing unit. Thus, the RCS utilizes roadside edge computing power and AI models to support autonomous driving for the vehicle. The OBU comprises a data processing module, a communication module, and a vehicle control module, and is capable of generating vehicle-specific targeted instruction for the vehicle based on guidance information and targeted instructions received from RSUs, and controlling the vehicle based on vehicle-specific targeted instruction.

Abstract: Provided herein is an artificial intelligence-based mobile roadside intelligent unit (MRIU) for providing, supplementing, and/or enhancing the control and operation of autonomous vehicles in normal and long-tail scenarios. The MRIU comprises a computing module configured to provide supplemental computation capability for autonomous driving. The MRIU comprises a communication module to communicate and exchange data with a vehicle or a cloud. The MRIU provides prediction, decision-making, and/or control functions for autonomous driving. The MRIU provides edge computing capability for autonomous vehicles to train and operate artificial intelligence-based intelligent driving models in a distributed fashion. Specifically, an edge computing unit conducts data fusion and data feature extraction, provides prediction, formulates control strategies, generates vehicle control instructions, and/or distributes vehicle control information and/or instructions for an autonomous vehicle.

Abstract: This invention presents a function allocation system for an autonomous vehicle (AV). During the operations of the AV, some or all of its automated driving capabilities or functions could be downgraded due to long-tail events or malfunctioning. The roadside intelligent infrastructure, or the cloud platform, could supplement some or all of AV's automated driving functions, including sensing, prediction and decision-making, and/or control functions. The function allocation system dynamically allocates these functions between AV and intelligent infrastructure, achieving a higher system intelligence level S than the downgraded vehicle intelligence level V. In addition, a function allocation system could dynamically allocate sensing, prediction and decision-making, and/or control functions between AV and a cloud platform. This invention also presents a function integration system or a fusion system for an AV.

Abstract: The invention provides a vehicle AI computing system (VACS) that supports autonomous driving through an Onboard Unit (OBU) for vehicle-based computing and distributed computing based on vehicle road-cloud. The vehicle-based computing can effectively complete various computational tasks by using onboard computing resources. The distributed computing allows the vehicle to work in collaboration with roadside units (RSUs) and/or the cloud to effectively complete various computational tasks. The VACS features an OBU with a sensing module, a communication module, and a data processing module that integrates data from vehicle sensors, RSUs, and the cloud. The OBU also includes a vehicle control module that helps control the vehicle based on the data of RSU and cloud. The VACS leverages high performance computation resources to implement end to end driving tasks including sensing, prediction, planning and decision making, and control.

Abstract: The invention provides an autonomous vehicle (AV) system with an artificial intelligence (AI) system for automated vehicle control and traffic operations. This AI system comprises a computation component configured to provide sensing, behavior prediction and management, decision making, and vehicle control for the vehicle. This AI system is configured to receive local knowledge, information, data, and models from a roadside unit (RSU) or a cloud to improve performance and efficiency of the vehicle. The AI system is configured to train models with heuristic parameters obtained from a local traffic control center/traffic control unit (TCC/TCU) or the cloud to provide an improved model. The AI system is configured to provide intelligence coordination to distribute intelligence among vehicles, RSUs and cloud. The system also provides localized self-evolving artificial intelligence.

Abstract: Provided herein is technology relating to intelligent transportation systems and automated vehicles and particularly, but not exclusively, to function allocation systems and methods for a connected automated vehicle highway system that provides transportation management and operations and vehicle control for connected and automated vehicles.