Abstract: The technology uses augmented reality (AR) elements for enhanced wayfinding with autonomous vehicle pickups and drop-offs. The approach includes generating, for presentation in a first region of a client device UI, trip information regarding a trip. Map information associated with the trip is generated for presentation in a second UI region, including at least one of a pickup location for a rider, a walking path from a current location of the rider to the pickup location, a planned route of the vehicle to the pickup location, or a current location of the vehicle. An AR indicator is generated for presentation in the second UI region. Upon selection of the indicator, the system modifies the second region into a first section to display at least a portion of the map information and a second section to display an augmented reality view, or replace the map information with the AR view.

Abstract: The technology includes communicating the current status of a self-driving vehicle to users, such as passengers within the vehicle and other users awaiting pickup. Certain information about the trip and vehicle status is communicated depending on where the passenger is sitting within the vehicle or where the person awaiting pickup is located outside the vehicle. This includes disseminating the “monologue” of a vehicle operating in an autonomous driving mode to a user via an app on the user's device (e.g., mobile phone, tablet or laptop PC, wearable, or other computing device) and/or an in-vehicle user interface. The monologue includes current status information regarding driving decisions and related operations or actions. This alerts the user as to why the vehicle is taking (or not taking) a certain action, which reduces confusion and allows the user to focus on other matters.

Abstract: Aspects of the present disclosure relate to a vehicle for maneuvering an occupant of the vehicle to a destination autonomously as well as providing information about the vehicle and the vehicle's environment for display to the occupant. The information includes a representation of a scene depicting an external environment of the vehicle. The representation of the scene includes a visual representation of the vehicle and a visual representation of objects in an external environment of the vehicle.

Abstract: Aspects of the disclosure relate to providing sensor data on a display of a vehicle. For instance, data points generated by a lidar sensor may be received. The data points may be representative of one or more objects in an external environment of the vehicle. A scene including a representation of the vehicle from a perspective of a virtual camera, a first virtual object corresponding to at least one of the one or more objects, and a second virtual object corresponding to at least one object identified from pre-stored map information may be generated. Supplemental points corresponding to a surface of the at least one object identified from the pre-stored map information may be generated. A pulse including at least some of the data points generated by the sensor and the supplemental points may be generated. The scene may be displayed with the pulse on the display.

Abstract: Aspects of the disclosure relate providing a lane change notification when a vehicle is to perform a lane change. One or more computing devices may generate and display a video, where the video is generated from a perspective of a virtual camera at a default position and default pitch. The one or more computing devices may receive an indication that the vehicle is to perform a lane change from a first lane to a second lane and adjust, after the vehicle receives the indication, the default position and default pitch of the virtual camera to an updated position further above the vehicle relative to ground than the default position and an updated pitch directed more towards the ground than the default pitch. The video may be generated and displayed from the perspective of the virtual camera at the updated position and updated pitch.

Abstract: The technology includes communicating the current status of a self-driving vehicle to users, such as passengers within the vehicle and other users awaiting pickup. Certain information about the trip and vehicle status is communicated depending on where the passenger is sitting within the vehicle or where the person awaiting pickup is located outside the vehicle. This includes disseminating the “monologue” of a vehicle operating in an autonomous driving mode to a user via an app on the user's device (e.g., mobile phone, tablet or laptop PC, wearable, or other computing device) and/or an in-vehicle user interface. The monologue includes current status information regarding driving decisions and related operations or actions. This alerts the user as to why the vehicle is taking (or not taking) a certain action, which reduces confusion and allows the user to focus on other matters.

Abstract: Aspects of the present disclosure relate to a vehicle for maneuvering an occupant of the vehicle to a destination autonomously as well as providing information about the vehicle and the vehicle's environment for display to the occupant.

Abstract: Aspects of the disclosure relate to providing sensor data on a display of a vehicle. For instance, data points generated by a lidar sensor may be received. The data points may be representative of one or more objects in an external environment of the vehicle. A scene including a representation of the vehicle from a perspective of a virtual camera, a first virtual object corresponding to at least one of the one or more objects, and a second virtual object corresponding to at least one object identified from pre-stored map information may be generated. Supplemental points corresponding to a surface of the at least one object identified from the pre-stored map information may be generated. A pulse including at least some of the data points generated by the sensor and the supplemental points may be generated. The scene may be displayed with the pulse on the display.

Abstract: The technology includes communicating the current status of a self-driving vehicle to users, such as passengers within the vehicle and other users awaiting pickup. Certain information about the trip and vehicle status is communicated depending on where the passenger is sitting within the vehicle or where the person awaiting pickup is located outside the vehicle. This includes disseminating the “monologue” of a vehicle operating in an autonomous driving mode to a user via an app on the user's device (e.g., mobile phone, tablet or laptop PC, wearable, or other computing device) and/or an in-vehicle user interface. The monologue includes current status information regarding driving decisions and related operations or actions. This alerts the user as to why the vehicle is taking (or not taking) a certain action, which reduces confusion and allows the user to focus on other matters.