Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining the likelihood that a particular event would occur during a navigation interaction using simulations generated by sampling from agent data.

Abstract: Aspects of the disclosure relate providing a lane change notification when a vehicle is to perform a lane change. One or more computing devices may generate and display a video, where the video is generated from a perspective of a virtual camera at a default position and default pitch. The one or more computing devices may receive an indication that the vehicle is to perform a lane change from a first lane to a second lane and adjust, after the vehicle receives the indication, the default position and default pitch of the virtual camera to an updated position further above the vehicle relative to ground than the default position and an updated pitch directed more towards the ground than the default pitch. The video may be generated and displayed from the perspective of the virtual camera at the updated position and updated pitch.

Abstract: In an example method, a vehicle configured to operate in an autonomous mode could have a radar system used to aid in vehicle guidance. The method could include transmitting at least two signal pulses. The method further includes, for each transmitted signal pulse, receiving a reflection signal associated with reflection of the respective transmitted signal pulse. Each reflection signal may be received when the apparatus is in a different respective location. Additionally, the method includes processing the received reflection signals to determine target information relating to one or more targets in an environment of the vehicle. Also, the method includes correlating the target information with at least one object of a predetermined map of the environment of the vehicle to provide correlated target information. Yet further, the method includes storing the correlated target information for the at least one object in an electronic database.

Abstract: Example implementations are provided for an arrangement of co-aligned rotating sensors. One example device includes a light detection and ranging (LIDAR) transmitter that emits light pulses toward a scene according to a pointing direction of the device. The device also includes a LIDAR receiver that detects reflections of the emitted light pulses reflecting from the scene. The device also includes an image sensor that captures an image of the scene based on at least external light originating from one or more external light sources. The device also includes a platform that supports the LIDAR transmitter, the LIDAR receiver, and the image sensor in a particular relative arrangement. The device also includes an actuator that rotates the platform about an axis to adjust the pointing direction of the device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using comfort scales to assess the performance of autonomous vehicles. One of the methods includes receiving data representing a traffic encounter between a vehicle and a pedestrian. A plurality of comfort scale ratings of the encounter assigned by a rater belonging to a first rater pool are received. An input element is generated for a rating transformation model configured to predict how comfort scale ratings assigned by a particular rater pool would have been assigned by a representative rater belonging to a reference rater pool. An inference pass is performed over the rating transformation model using the input element to obtain a plurality of transformed comfort scale ratings for the reference rater pool.

Abstract: Sensor data identifying an emergency vehicle approaching the autonomous vehicle may be received. A predicted trajectory for the emergency vehicle may be received. Whether the autonomous vehicle is impeding the emergency vehicle may be determined based on the predicted trajectory and map information identifying a road on which the autonomous vehicle is currently traveling. Based on a determination that the autonomous vehicle is impeding the emergency vehicle, the autonomous vehicle may be controlled in an autonomous driving mode in order to respond to the emergency vehicle.

Abstract: Assessing a likelihood of a person experiencing a fatigue event when the person tasked with monitoring a vehicle operating in an autonomous driving mode may include receiving a set of response times for a psychomotor vigilance test administered to the person. The test may include a plurality of trials which involve a person lifting a finger from a user input device. Whether the person passed or failed each trial of the set of trials may be determined. A model trained using data from prior psychomotor vigilance tests administered to the person may be identified for the person. Results of the determinations of whether the person passed or failed each trial of the set of trials may be input into the model in order to determine a value representative of a likelihood of a fatigue event. An intervention response may be initiated based on the value.

Abstract: Aspects of the disclosure relate to determining whether a feature of map information. For example, data identifying an object detected in a vehicle's environment and including location coordinates is received. This information is used to identify a corresponding feature from pre-stored map information based on a map location of the corresponding feature. The corresponding feature is defined as a curve and associated with a tag identifying a type of the corresponding object. A tolerance constraint is identified based on the tag. The curve is divided into two or more line segments. Each line segment has a first position. The first position of a line segment is changed in order to determine a second position based on the location coordinates and the tolerance constraint. A value is determined based on a comparison of the first position to the second position. This value indicates a likelihood that the corresponding feature has changed.

Abstract: Aspects of the disclosure relate to controlling a vehicle in an autonomous driving mode. For instance, a trajectory is identified. The trajectory defines a future desired path for the vehicle and includes a control requirement having a corresponding point in time. A command for achieving the control requirement is generated. A fixed delay value corresponding to a delay caused by transmission of the command to an actuator of the vehicle is generated. A variable delay value corresponding to a delay caused by an amount of time to change a physical state of the actuator to a desired state according to the command is generated. The command is then sent to the actuator based on the fixed delay value, the variable delay value, and so that the actuator causes the vehicle to move according to the command.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining respective importance scores for a plurality of agents in a vicinity of an autonomous vehicle navigating through an environment. The respective importance scores characterize a relative impact of each agent on planned trajectories generated by a planning subsystem of the autonomous vehicle. In one aspect, a method comprises providing different states of an environment as input to the planning subsystem and obtaining as output from the planning subsystem corresponding planned trajectories. Importance scores for the one or more agents that are in one state but not in the other are determined based on a measure of difference between the planned trajectories.

Abstract: A method includes detecting, by a sensing system of an autonomous vehicle (AV) executing a trip from a first location to a second location, a signal from a source external to the AV to stop the AV, and analyzing the signal to determine whether the AV is to be stopped in response to the signal. Responsive to determining that the AV is to be stopped, the method includes causing a vehicle control system of the AV to stop the AV at a third location, determining that one or more parking brakes are to be engaged, and causing the vehicle control system to automatically engage the one or more parking brakes.

Abstract: A vehicle may receive one or more images of an environment of the vehicle. The vehicle may also receive a map of the environment. The vehicle may also match at least one feature in the one or more images with corresponding one or more features in the map. The vehicle may also identify a given area in the one or more images that corresponds to a a portion of the map that is within a threshold distance to the one or more features. The vehicle may also compress the one or more images to include a lower amount of details in areas of the one or more images other than the given area. The vehicle may also provide the compressed images to a remote system, and responsively receive operation instructions from the remote system.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for associating a new measurement of an object surrounding a vehicle with a maintained track. One of the methods includes receiving an object track for a particular object, receiving a new measurement characterizing a new object at a new time step, and determining whether the new object is the same as the particular object, comprising: generating a representation of the new object at the new and preceding time steps; generating a representation of the particular object at the new and preceding time steps; processing a first network input comprising the representations using a first neural network to generate an embedding of the first network input; and processing the embedding of the first network input using a second neural network to generate a predicted likelihood that the new object and the particular object are the same.

Abstract: Methods and devices for actively modifying a field of view of an autonomous vehicle in view of constraints are disclosed. In one embodiment, an example method is disclosed that includes causing a sensor in an autonomous vehicle to sense information about an environment in a first field of view, where a portion of the environment is obscured in the first field of view. The example method further includes determining a desired field of view in which the portion of the environment is not obscured and, based on the desired field of view and a set of constraints for the vehicle, determining a second field of view in which the portion of the environment is less obscured than in the first field of view. The example method further includes modifying a position of the vehicle, thereby causing the sensor to sense information in the second field of view.

Abstract: An article including a durable, optically transparent, and superhydrophobic coating is described. In one aspect, the present disclosure provides an article comprising a substrate, and disposed adjacent the substrate, a layer comprising graphitic carbon, diamond-like carbon, and aerogel. In another aspect, the present disclosure provides a method for preparing a coated substrate, comprising providing a carbon layer disposed on a substrate and having a textured surface; and disposing aerogel adjacent to at least a portion of the textured surface.

Abstract: A method is provided that involves mounting a transmit block and a receive block in a LIDAR device to provide a relative position between the transmit block and the receive block. The method also involves locating a camera at a given position at which the camera can image light beams emitted by the transmit block and can image the receive block. The method also involves obtaining, using the camera, a first image indicative of light source positions of one or more light sources in the transmit block and a second image indicative of detector positions of one or more detectors in the receive block. The method also involves determining at least one offset based on the first image and the second image. The method also involves adjusting the relative position between the transmit block and the receive block based at least in part on the at least one offset.

Abstract: Aspects of the disclosure relate to validating map data using challenge questions. For instance, an attributes to be validated may be identified from the map data. At least one challenge question may be selected from a plurality of predetermined challenge questions based on the attribute. An image may be retrieved based on image information associated with the at least one challenge question. The image and the at least one challenge question may be provided for display. In response to the providing, operator input identifying an answer to the at least one challenge question may be received. This answer may be then used to validate the attribute.

Abstract: A method and system to provide timebase synchronization for multiple processors in a multi-processor sensor system, where each processor operates according to a respective reference clock, and where the processors' respective reference clocks are off sync from each other. An example method includes simultaneously injecting a synchronization pulse respectively into the multiple processors. Further, the method includes recording for each processor, according to the processor's respective reference clock, a respective synchronization-pulse timestamp of the simultaneously injected synchronization pulse, comparing the respective synchronization-pulse timestamps recorded for the processors, and, based on the comparing, computing for each processor a respective time offset. Additionally, the method includes using the per-processor computed time offsets as a basis to provide a synchronized timebase across the processors.

Abstract: The technology relates to enhancing or extending the field of view of sensors for vehicles configured to operate in an autonomous driving mode. One or more mirrors are used to reflect or redirect beams emitted from onboard sensors that would otherwise be wasted, for instance due to obstruction by a portion of the vehicle or because they are emitted at high pitch angles to the side. The mirrors are also used to redirect incoming beams from the external environment toward one or more of the onboard sensors. Using mirrors for such redirection can reduce or eliminate blind spots around the vehicle. A calibration system may be employed to account for mirror movement due to vibration or wind drag. Each mirror may be a front surface mirror. The mirrors may be positioned on the vehicle body, on a faring, or extending from a sensor housing on the vehicle.

Abstract: A camera module includes a housing with an opening and a portion that surrounds the opening, wherein the portion of the housing is transparent to near infrared (NIR) light. A fisheye lens is disposed within the opening such that a portion of the fisheye lens protrudes through the opening. An image sensor is disposed within the housing and optically coupled to the fisheye lens. The image sensor is sensitive to visible light and NIR light. A plurality of NIR light emitters is disposed within the housing. The NIR light emitters are configured to emit NIR light through the NIR-transparent portion of the housing. The NIR-transparent portion of the housing may include a light-diffusing structure, such as a pattern of microlenses formed on an inner surface of the NIR-transparent portion of the housing, to spread out the NIR light emitted by the NIR light emitters.