Abstract: There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the conference call, whereby the passenger can communicate with the other party via the conference call.

Abstract: There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the conference call, whereby the passenger can communicate with the other party via the conference call.

Abstract: There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the conference call, whereby the passenger can communicate with the other party via the conference call.

Abstract: There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the call, whereby the passenger can communicate with the other party via the call.

Abstract: There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the conference call, whereby the passenger can communicate with the other party via the conference call.

Abstract: A method of providing an onboard assistant for a vehicle, comprising: receiving sensor data from sensors of the vehicle; transforming the sensor data using a trained machine learning model to provide transformed sensor data; inferring from the transformed sensor data that a special condition for the vehicle requires intervention; and contacting an operator of the vehicle to inform the operator of the special condition and receive instructions for handling the special condition.

Abstract: A method of providing an onboard assistant for a vehicle, comprising: receiving sensor data from sensors of the vehicle; transforming the sensor data using a trained machine learning model to provide transformed sensor data; inferring from the transformed sensor data that a special condition for the vehicle requires intervention; and contacting an operator of the vehicle to inform the operator of the special condition and receive instructions for handling the special condition.

Abstract: Assistance can be provided to AV users through projection of graphical figures. A system may receive a request for assistance from a user of an AV. The system assigns the request to an agent who can assist the user. The system further provides a graphical representation (e.g., an avatar) of the agent to a device that can project the graphical representation to the user. The user can have a conversation with the graphical representation, e.g., based on information provided by the agent. The system can also provide an audio filter to the device for modifying an audio content presented by the device so that the modified audio content appears as if it is made by the graphical representation. The device may be a part of the AV or a client device of the user that can present VR, AR, or MR content. The device may be mobile.

Abstract: Assistance can be provided to users of AVs based on user sentiments. A system may receive a request for assistance from a user of an AV (e.g., a passenger of the AV). The system may also receive sensor data that is captured by a sensor suite of the AV from detecting the user, the AV, or another object. The system determines a sentiment of the user based on the sensor data. The system may input the sensor data into a machine learning model and the model outputs information indicating the user's sentiment. The system can determine who, when, or how to service the user's request based on the user's sentiment. The system may assign the user's request to an agent who can provide the assistance. The system can further provide guidance (e.g., suggested content of a conversation with the user) to the agent based on the user's sentiment.

Abstract: There is disclosed a method of providing rider service for an autonomous vehicle (AV) system, including operating an AV to provide a trip to a passenger; associating the passenger with a unique passenger identifier (UPID); receiving passenger metadata for the passenger according to the UPID; and responding to a rider service instance, comprising customizing the response according to the UPID and the passenger metadata.

Abstract: There is disclosed a method of providing rider service for an autonomous vehicle (AV) system, including operating an AV to provide a trip to a passenger; associating the passenger with a unique passenger identifier (UPID); receiving passenger metadata for the passenger according to the UPID; and responding to a rider service instance, comprising customizing the response according to the UPID and the passenger metadata.

Abstract: Systems and methods for targeted advertisements displayed on a vehicle. A dynamic advertising platform leverages various ridehail service modalities to present targeted advertisements to users and bystanders. The modalities can include ridehail applications, external vehicle screens, interior vehicle screens, and other in-car experience formats. The targeted advertisements can be selected based on various factors, which can be personalized based on the user as well as based on the advertising business's preferences.

Abstract: Systems and methods for augmented in-vehicle experiences. In particular, systems and methods for an immersive in-vehicle experience are provided, with customizable virtual and augmented reality options. Systems and techniques are provided for vehicles to perform real-time detection and augmentation of the real world environment, including tracked objects and buildings in the real world environment. The vehicles use intelligently matched vehicle sensor data, map data, and other source data for detection and augmentation of the environment. In some examples, procedurally generated three-dimensional (3D) environments are provided, which are based on a current ride route and surrounding real world environment.

Abstract: Systems and methods for augmented in-vehicle experiences. In particular, systems and methods for an immersive in-vehicle experience are provided, with customizable virtual and augmented reality options. Systems and techniques are provided for vehicles to perform real-time detection and augmentation of the real world environment, including tracked objects and buildings in the real world environment. The vehicles use intelligently matched vehicle sensor data, map data, and other source data for detection and augmentation of the environment.