Abstract: The technology employs a holistic approach to passenger pickups and other wayfinding situations. This includes identifying where passengers are relative to the vehicle and/or the pickup location. Information synthesis from different sensors, agent behavior prediction models, and real-time situational awareness are employed to identify the likelihood that the passenger to be picked up is at a given location at a particular point in time, with sufficient confidence. The system can provide adaptive navigation by helping passengers understand their distance and direction to the vehicle, for instance using various cues via an app on the person's device. Rider support tools may be provided, which enable a remote agent to interact with a customer via that person's device, such as using the camera on the device to provide wayfinding support to enable the person to find their vehicle. Ride support may also use sensor information from the vehicle when providing wayfinding support.

Abstract: The technology employs a holistic approach to passenger pickups and other wayfinding situations. This includes identifying where passengers are relative to the vehicle and/or the pickup location. Information synthesis from different sensors, agent behavior prediction models, and real-time situational awareness are employed to identify the likelihood that the passenger to be picked up is at a given location at a particular point in time, with sufficient confidence. The system can provide adaptive navigation by helping passengers understand their distance and direction to the vehicle, for instance using various cues via an app on the person's device. Rider support tools may be provided, which enable a remote agent to interact with a customer via that person's device, such as using the camera on the device to provide wayfinding support to enable the person to find their vehicle. Ride support may also use sensor information from the vehicle when providing wayfinding support.

Abstract: Aspects of the disclosure relate to controlling an autonomous vehicle. For instance, dispatching instructions including a destination location and a trip plan identifying a selected route may be received. The route was selected by a user from a set of two or more routes. The trip plan may be used to determine whether to user the selected route or a new route. The autonomous vehicle may be controlled to the destination location based on the determination.

Abstract: The technology provides enhanced localization approaches using vehicle-obtained information in place of or to enhance global positioning information to localize a user's position. Such information can be shared with the user's client device in real-time prior to pickup or meeting at a selected location. This can supplement or replace inaccurate localization information available at the client device, and can be done as needed when the user is within a threshold range of one or more autonomous vehicles. A client device of a user can compute its position using the vehicle positioning information. The vehicle positioning approach may be performed when the user is within a certain range of one or more vehicles. Vehicle localization information may also be used to correct the client device's localization information. Here, using hyper-accurate vehicle positioning, one or more vehicles can compute pseudorange errors for each “visible” satellite in a global positioning service.

Abstract: Aspects of the disclosure provide for generating and using a model for identifying a plurality of pick up or drop off locations for a large venue point of interest. For instance, a large venue point of interest may be identified. The plurality may be identified for the large venue point of interest based on a combination of historical trip data and map information. The plurality may be associated with the large venue point of interest. The association may be stored in memory for later use. Thereafter, a request for a trip identifying the large venue point of interest may be received from a client computing device, and the plurality may be provided to the client computing device in response to the request. A pickup and drop off location of the plurality may be provided to an autonomous vehicle in order to cause the autonomous vehicle to transport a passenger to the pickup or drop off location.

Abstract: Aspects of the disclosure provide for arranging a trip in an autonomous vehicle without a driver. For instance, a request may be received from a client computing device associated with a first person to arrange the trip for a second person. The request may include a pickup location for the second person and a destination location for the second person. An authentication method may be identified for the trip. A signal may be sent to the autonomous vehicle in order to cause the autonomous vehicle to maneuver to the pickup location, authenticate the second person using the authentication method, and transport the second person to the destination location.

Abstract: The technology employs spatial audio information to enhance wayfinding for pickup, drop-off and in-vehicle situations. The spatial information has a directional component, and a sense of distance can also be incorporated into the audio information. Audio cues or other spatial information is provided via headphones worn by a user. The spatial audio gives the user direction information, which can help locate the vehicle. In addition, this approach can be used when the rider is in the vehicle prior to exiting. For instance, spatial audio can be provided to the rider to give them contextual information about the environment outside the vehicle prior to exiting, such as whether a bicyclist is approaching on the side they will be exiting. This contextual information can alert the rider to wait or otherwise be more situationally aware when departing the vehicle.

Abstract: The technology employs a holistic approach to passenger pickups and other wayfinding situations. This includes identifying where passengers are relative to the vehicle and/or the pickup location. Information synthesis from different sensors, agent behavior prediction models, and real-time situational awareness are employed to identify the likelihood that the passenger to be picked up is at a given location at a particular point in time, with sufficient confidence. The system can provide adaptive navigation by helping passengers understand their distance and direction to the vehicle, for instance using various cues via an app on the person's device. Rider support tools may be provided, which enable a remote agent to interact with a customer via that person's device, such as using the camera on the device to provide wayfinding support to enable the person to find their vehicle. Ride support may also use sensor information from the vehicle when providing wayfinding support.