Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a surfel map to generate long range localization. One of the methods includes obtaining, for a particular location of a vehicle having a camera and a detection sensor, surfel data including a plurality of surfels. Each surfel in the surfel data has a respective location and corresponds to a different respective detected surface in an environment. Image data captured by the camera is obtained. It is determined that a region of interest for detecting objects for a vehicle planning process is outside a detectable region for the detection sensor. In response, it is determined that the image data for the region of interest matches surfel color data for the surfels corresponding to the region of interest. In response, the vehicle planning process is performed with the region of interest designated as having no unexpected objects.

Abstract: Aspects of the technology relate to providing service area maps for an autonomous vehicle transportation service having a fleet of vehicles. For instance, each vehicle of the fleet is associated with a polygon corresponding to a service area for that vehicle. A first location may be received from a client computing device, and a set of vehicles of the fleet of vehicles that are currently available to provide transportation services may be identified based on the first location. The polygons associated with each of the set of vehicles may be used to determine a first polygon having a geographic area. A first portion of map information corresponding to the geographic area of the first polygon may be identified, and the first portion may be provided to the client computing device for display to a user such that the portion represents a currently available service area for the user.

Abstract: Aspects of the disclosure relate to validating map data using challenge questions. For instance, an attributes to be validated may be identified from the map data. At least one challenge question may be selected from a plurality of predetermined challenge questions based on the attribute. An image may be retrieved based on image information associated with the at least one challenge question. The image and the at least one challenge question may be provided for display. In response to the providing, operator input identifying an answer to the at least one challenge question may be received. This answer may be then used to validate the attribute.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a surfel map to generate long range localization. One of the methods includes obtaining, for a particular location of a vehicle having a camera and a detection sensor, surfel data including a plurality of surfels. Each surfel in the surfel data has a respective location and corresponds to a different respective detected surface in an environment. Image data captured by the camera is obtained. It is determined that a region of interest for detecting objects for a vehicle planning process is outside a detectable region for the detection sensor. In response, it is determined that the image data for the region of interest matches surfel color data for the surfels corresponding to the region of interest. In response, the vehicle planning process is performed with the region of interest designated as having no unexpected objects.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a surfel map to generate a prediction for a state of an environment. One of the methods includes obtaining surfel data comprising a plurality of surfels, wherein each surfel corresponds to a respective different location in an environment, and each surfel has associated data that comprises an uncertainty measure; obtaining sensor data for one or more locations in the environment, the sensor data having been captured by one or more sensors of a first vehicle; determining one or more particular surfels corresponding to respective locations of the obtained sensor data; and combining the surfel data and the sensor data to generate a respective object prediction for each of the one or more locations of the obtained sensor data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a surfel map to generate long range localization. One of the methods includes obtaining, for a particular location of a vehicle having a camera and a detection sensor, surfel data including a plurality of surfels. Each surfel in the surfel data has a respective location and corresponds to a different respective detected surface in an environment. Image data captured by the camera is obtained. It is determined that a region of interest for detecting objects for a vehicle planning process is outside a detectable region for the detection sensor. In response, it is determined that the image data for the region of interest matches surfel color data for the surfels corresponding to the region of interest. In response, the vehicle planning process is performed with the region of interest designated as having no unexpected objects.

Abstract: Aspects of the technology relate to providing service area maps for an autonomous vehicle transportation service having a fleet of vehicles. For instance, each vehicle of the fleet is associated with a polygon corresponding to a service area for that vehicle. A first location may be received from a client computing device, and a set of vehicles of the fleet of vehicles that are currently available to provide transportation services may be identified based on the first location. The polygons associated with each of the set of vehicles may be used to determine a first polygon having a geographic area. A first portion of map information corresponding to the geographic area of the first polygon may be identified, and the first portion may be provided to the client computing device for display to a user such that the portion represents a currently available service area for the user.

Abstract: Aspects of the technology relate to providing service area maps for an autonomous vehicle transportation service having a fleet of vehicles. For instance, each vehicle of the fleet is associated with a polygon corresponding to a service area for that vehicle. A first location may be received from a client computing device, and a set of vehicles of the fleet of vehicles that are currently available to provide transportation services may be identified based on the first location. The polygons associated with each of the set of vehicles may be used to determine a first polygon having a geographic area. A first portion of map information corresponding to the geographic area of the first polygon may be identified, and the first portion may be provided to the client computing device for display to a user such that the portion represents a currently available service area for the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing data characterizing a first region in an environment to generate a prediction characterizing a second region in the environment. One of the methods includes obtaining surfel data comprising a plurality of surfels; obtaining sensor data for a plurality of locations in a first region of the environment; determining, from the surfel data, a plurality of first surfels corresponding to respective locations in the first region of the environment; determining, using the first surfels and the sensor data, a difference between i) a first representation of the first region of the environment corresponding to the first surfels and ii) a second representation of the first region of the environment corresponding to the sensor data; and generating a respective object prediction for one or more locations in a second region of the environment.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a surfel map to generate a prediction for a state of an environment. One of the methods includes obtaining surfel data comprising a plurality of surfels, wherein each surfel corresponds to a respective different location in an environment, and each surfel has associated data that comprises an uncertainty measure; obtaining sensor data for one or more locations in the environment, the sensor data having been captured by one or more sensors of a first vehicle; determining one or more particular surfels corresponding to respective locations of the obtained sensor data; and combining the surfel data and the sensor data to generate a respective object prediction for each of the one or more locations of the obtained sensor data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a surfel map to generate long range localization. One of the methods includes obtaining, for a particular location of a vehicle having a camera and a detection sensor, surfel data including a plurality of surfels. Each surfel in the surfel data has a respective location and corresponds to a different respective detected surface in an environment. Image data captured by the camera is obtained. It is determined that a region of interest for detecting objects for a vehicle planning process is outside a detectable region for the detection sensor. In response, it is determined that the image data for the region of interest matches surfel color data for the surfels corresponding to the region of interest. In response, the vehicle planning process is performed with the region of interest designated as having no unexpected objects.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing data characterizing a first region in an environment to generate a prediction characterizing a second region in the environment. One of the methods includes obtaining surfel data comprising a plurality of surfels; obtaining sensor data for a plurality of locations in a first region of the environment; determining, from the surfel data, a plurality of first surfels corresponding to respective locations in the first region of the environment; determining, using the first surfels and the sensor data, a difference between i) a first representation of the first region of the environment corresponding to the first surfels and ii) a second representation of the first region of the environment corresponding to the sensor data; and generating a respective object prediction for one or more locations in a second region of the environment.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for autonomous driving with surfel maps. In some implementations, a three-dimensional representation of a real-world environment is obtained. Each of the surfels can correspond to a respective point of plurality of points in a three-dimensional space of the real-world environment. Input sensor data is received from multiple sensors installed on the autonomous vehicle. A pedestrian is detected from the input sensor data. A determination is made that the pedestrian is located behind a barrier. A driving plan is updated based on determining that the pedestrian is located behind a barrier.

Abstract: Aspects of the disclosure relate to validating map data using challenge questions. For instance, an attributes to be validated may be identified from the map data. At least one challenge question may be selected from a plurality of predetermined challenge questions based on the attribute. An image may be retrieved based on image information associated with the at least one challenge question. The image and the at least one challenge question may be provided for display. In response to the providing, operator input identifying an answer to the at least one challenge question may be received. This answer may be then used to validate the attribute.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a surfel map to generate a prediction for a state of an environment. One of the methods includes obtaining surfel data comprising a plurality of surfels, wherein each surfel corresponds to a respective different location in an environment, and each surfel has associated data that comprises an uncertainty measure; obtaining sensor data for one or more locations in the environment, the sensor data having been captured by one or more sensors of a first vehicle; determining one or more particular surfels corresponding to respective locations of the obtained sensor data; and combining the surfel data and the sensor data to generate a respective object prediction for each of the one or more locations of the obtained sensor data.

Abstract: Aspects of the disclosure relate to validating map data using challenge questions. For instance, an attributes to be validated may be identified from the map data. At least one challenge question may be selected from a plurality of predetermined challenge questions based on the attribute. An image may be retrieved based on image information associated with the at least one challenge question. The image and the at least one challenge question may be provided for display. In response to the providing, operator input identifying an answer to the at least one challenge question may be received. This answer may be then used to validate the attribute.

Abstract: Aspects of the technology relate to providing service area maps for an autonomous vehicle transportation service having a fleet of vehicles. For instance, each vehicle of the fleet is associated with a polygon corresponding to a service area for that vehicle. A first location may be received from a client computing device, and a set of vehicles of the fleet of vehicles that are currently available to provide transportation services may be identified based on the first location. The polygons associated with each of the set of vehicles may be used to determine a first polygon having a geographic area. A first portion of map information corresponding to the geographic area of the first polygon may be identified, and the first portion may be provided to the client computing device for display to a user such that the portion represents a currently available service area for the user.

Abstract: Aspects of the disclosure relate to validating map data using challenge questions. For instance, an attributes to be validated may be identified from the map data. At least one challenge question may be selected from a plurality of predetermined challenge questions based on the attribute. An image may be retrieved based on image information associated with the at least one challenge question. The image and the at least one challenge question may be provided for display. In response to the providing, operator input identifying an answer to the at least one challenge question may be received. This answer may be then used to validate the attribute.

Abstract: Systems, methods and computer readable media for persistent conversations are described. In some implementations, a method can include receiving a communication message sent from a first user to at least one other user, and generating a persistent conversation object having a conversation content section and conversation state information. The method can also include storing the communication message in the conversation content section of the persistent conversation object, and forwarding the communication message to the at least one other user. The method can further include updating the conversation state information to reflect the receiving, storing and forwarding of the communication message.

Abstract: Systems, methods and computer readable media for persistent conversations are described. In some implementations, a method can include receiving a communication message sent from a first user to at least one other user and generating a persistent conversation object having a conversation content section and conversation state information. The method can also include storing the communication message in the conversation content section of the persistent conversation object and forwarding the communication message to the at least one other user. The method can further include updating the conversation state information to reflect the receiving, storing and forwarding of the communication message.