Abstract: Aspects of the disclosure relate to a method of managing a fleet of autonomous vehicles providing trip services. The method includes receiving information identifying an intermediate destination and a final destination for a trip. In this example, the intermediate destination is a destination where an autonomous vehicle will drop off and wait for a passenger in order to continue the trip, and the final destination is a destination where the trip ends. The method also includes determining an amount of waiting time the vehicle is likely to be waiting for the passenger at the intermediate destination, determining how a vehicle of the fleet of autonomous vehicles should spend the amount of waiting time, and sending an instruction to the vehicle, based on the determination of how the vehicle should spend the amount of waiting time.

Abstract: Aspects of the disclosure provide for determining when to provide and providing secondary disengage alerts for a vehicle having autonomous and manual driving modes. For instance, while the vehicle is being controlled in the autonomous driving mode, user input is received at one or more user input devices of the vehicle. In response to receiving the user input, the vehicle may be transitioned from the autonomous driving mode to a manual driving mode and provide a primary disengage alert to an occupant of the vehicle regarding the transition. Whether to provide a secondary disengage alert may be determined based on at least circumstances of the user input. After the transition, the secondary disengage alert may be provided based on the determination.

Abstract: Aspects of the present disclosure relate to a vehicle for maneuvering an occupant of the vehicle to a destination autonomously as well as providing information about the vehicle and the vehicle's environment for display to the occupant. The information includes a representation of a scene depicting an external environment of the vehicle. The representation of the scene includes a visual representation of the vehicle and a visual representation of objects in an external environment of the vehicle.

Abstract: Aspects of the disclosure provide a method of facilitating communications from an autonomous vehicle to a user. For instance, a method may include, while attempting to pick up the user and prior to the user entering an vehicle, inputting a current location of the vehicle and map information into a model in order to identify a type of communication action for communicating a location of the vehicle to the user; enabling a first communication based on the type of the communication action; determining whether the user has responded to the first communication from received sensor data; and enabling a second communication based on the determination of whether the user has responded to the communication.

Abstract: Aspects of the disclosure provide a method of facilitating communications from an autonomous vehicle to a user. For instance, a method may include, while attempting to pick up the user and prior to the user entering an vehicle, inputting a current location of the vehicle and map information into a model in order to identify a type of communication action for communicating a location of the vehicle to the user; enabling a first communication based on the type of the communication action; determining whether the user has responded to the first communication from received sensor data; and enabling a second communication based on the determination of whether the user has responded to the communication.

Abstract: Aspects of the disclosure provide for determining when to provide and providing secondary disengage alerts for a vehicle having autonomous and manual driving modes. For instance, while the vehicle is being controlled in the autonomous driving mode, user input is received at one or more user input devices of the vehicle. In response to receiving the user input, the vehicle may be transitioned from the autonomous driving mode to a manual driving mode and provide a primary disengage alert to an occupant of the vehicle regarding the transition. Whether to provide a secondary disengage alert may be determined based on at least circumstances of the user input. After the transition, the secondary disengage alert may be provided based on the determination.

Abstract: Assessing a likelihood of a person experiencing a fatigue event when the person tasked with monitoring a vehicle operating in an autonomous driving mode may include receiving a set of response times for a psychomotor vigilance test administered to the person. The test may include a plurality of trials which involve a person lifting a finger from a user input device. Whether the person passed or failed each trial of the set of trials may be determined. A model trained using data from prior psychomotor vigilance tests administered to the person may be identified for the person. Results of the determinations of whether the person passed or failed each trial of the set of trials may be input into the model in order to determine a value representative of a likelihood of a fatigue event. An intervention response may be initiated based on the value.

Abstract: Aspects of the disclosure provide for determining when to provide and providing secondary disengage alerts for a vehicle having autonomous and manual driving modes. For instance, while the vehicle is being controlled in the autonomous driving mode, user input is received at one or more user input devices of the vehicle. In response to receiving the user input, the vehicle may be transitioned from the autonomous driving mode to a manual driving mode and provide a primary disengage alert to an occupant of the vehicle regarding the transition. Whether to provide a secondary disengage alert may be determined based on at least circumstances of the user input. After the transition, the secondary disengage alert may be provided based on the determination.

Abstract: Aspects of the disclosure relate to a method of managing a fleet of autonomous vehicles providing trip services. The method includes receiving information identifying an intermediate destination and a final destination for a trip. In this example, the intermediate destination is a destination where an autonomous vehicle will drop off and wait for a passenger in order to continue the trip, and the final destination is a destination where the trip ends. The method also includes determining an amount of waiting time the vehicle is likely to be waiting for the passenger at the intermediate destination, determining how a vehicle of the fleet of autonomous vehicles should spend the amount of waiting time, and sending an instruction to the vehicle, based on the determination of how the vehicle should spend the amount of waiting time.

Abstract: Aspects of the disclosure provide a method of facilitating communications from an autonomous vehicle to a user. For instance, a method may include, while attempting to pick up the user and prior to the user entering an vehicle, inputting a current location of the vehicle and map information into a model in order to identify a type of communication action for communicating a location of the vehicle to the user; enabling a first communication based on the type of the communication action; determining whether the user has responded to the first communication from received sensor data; and enabling a second communication based on the determination of whether the user has responded to the communication.

Abstract: Aspects of the disclosure relate providing a lane change notification when a vehicle is to perform a lane change. One or more computing devices may generate and display a video, where the video is generated from a perspective of a virtual camera at a default position and default pitch. The one or more computing devices may receive an indication that the vehicle is to perform a lane change from a first lane to a second lane and adjust, after the vehicle receives the indication, the default position and default pitch of the virtual camera to an updated position further above the vehicle relative to ground than the default position and an updated pitch directed more towards the ground than the default pitch. The video may be generated and displayed from the perspective of the virtual camera at the updated position and updated pitch.

Abstract: Assessing a likelihood of a person experiencing a fatigue event when the person tasked with monitoring a vehicle operating in an autonomous driving mode may include receiving a set of response times for a psychomotor vigilance test administered to the person. The test may include a plurality of trials which involve a person lifting a finger from a user input device. Whether the person passed or failed each trial of the set of trials may be determined. A model trained using data from prior psychomotor vigilance tests administered to the person may be identified for the person. Results of the determinations of whether the person passed or failed each trial of the set of trials may be input into the model in order to determine a value representative of a likelihood of a fatigue event. An intervention response may be initiated based on the value.

Abstract: Aspects of the present disclosure relate to a vehicle for maneuvering an occupant of the vehicle to a destination autonomously as well as providing information about the vehicle and the vehicle's environment for display to the occupant.

Abstract: Aspects of the disclosure provide a method of facilitating communications from an autonomous vehicle to a user. For instance, a method may include, while attempting to pick up the user and prior to the user entering an vehicle, inputting a current location of the vehicle and map information into a model in order to identify a type of communication action for communicating a location of the vehicle to the user; enabling a first communication based on the type of the communication action; determining whether the user has responded to the first communication from received sensor data; and enabling a second communication based on the determination of whether the user has responded to the communication.

Abstract: Aspects of the disclosure relate to a method of managing a fleet of autonomous vehicles providing trip services. The method includes receiving information identifying an intermediate destination and a final destination for a trip. In this example, the intermediate destination is a destination where an autonomous vehicle will drop off and wait for a passenger in order to continue the trip, and the final destination is a destination where the trip ends. The method also includes determining an amount of waiting time the vehicle is likely to be waiting for the passenger at the intermediate destination, determining how a vehicle of the fleet of autonomous vehicles should spend the amount of waiting time, and sending an instruction to the vehicle, based on the determination of how the vehicle should spend the amount of waiting time.

Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver.

Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle.

Abstract: Aspects of the disclosure provide for determining when to provide and providing secondary disengage alerts for a vehicle having autonomous and manual driving modes. For instance, while the vehicle is being controlled in the autonomous driving mode, user input is received at one or more user input devices of the vehicle. In response to receiving the user input, the vehicle may be transitioned from the autonomous driving mode to a manual driving mode and provide a primary disengage alert to an occupant of the vehicle regarding the transition. Whether to provide a secondary disengage alert may be determined based on at least circumstances of the user input. After the transition, the secondary disengage alert may be provided based on the determination.

Abstract: Aspects of the disclosure provide a method of facilitating communications from an autonomous vehicle to a user. For instance, a method may include, while attempting to pick up the user and prior to the user entering an vehicle, inputting a current location of the vehicle and map information into a model in order to identify a type of communication action for communicating a location of the vehicle to the user; enabling a first communication based on the type of the communication action; determining whether the user has responded to the first communication from received sensor data; and enabling a second communication based on the determination of whether the user has responded to the communication.

Abstract: Aspects of the disclosure provide for determining when to provide and providing secondary disengage alerts for a vehicle having autonomous and manual driving modes. For instance, while the vehicle is being controlled in the autonomous driving mode, user input is received at one or more user input devices of the vehicle. In response to receiving the user input, the vehicle may be transitioned from the autonomous driving mode to a manual driving mode and provide a primary disengage alert to an occupant of the vehicle regarding the transition. Whether to provide a secondary disengage alert may be determined based on at least circumstances of the user input. After the transition, the secondary disengage alert may be provided based on the determination.