Abstract: This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle.

Abstract: The technology relates to an exterior sensor system for a vehicle configured to operate in an autonomous driving mode. The technology includes a close-in sensing (CIS) camera system to address blind spots around the vehicle. The CIS system is used to detect objects within a few meters of the vehicle. Based on object classification, the system is able to make real-time driving decisions. Classification is enhanced by employing cameras in conjunction with lidar sensors. The specific arrangement of multiple sensors in a single sensor housing is also important to object detection and classification. Thus, the positioning of the sensors and support components are selected to avoid occlusion and to otherwise prevent interference between the various sensor housing elements.

Abstract: The technology involves an in-vehicle communication system with a console that is positioned within the cabin of the vehicle, for instance between the front seats so that passengers in the second row can view and access it. The console is configured to provide contextual information to passengers. The console includes a monitor assembly that has a display screen and a notification region. The notification region includes one or more displayable icons and at least one receptacle for a communication device of a passenger. The notification region has a first section comprising an outer cover layer with a first series of masking, diffuser and illuminating layers to selectively illuminate the one or more displayable icons. The notification region has a second section comprising the outer cover layer with a second series of masking, diffuser and illuminating layers to selectively illuminate the at least one receptacle for the communication device.

Abstract: Aspects of the disclosure relate to arranging a pick up and drop off locations between a driverless vehicle and a passenger. As an example, a method of doing so may include receiving a request for a vehicle from a client computing device, wherein the request identifies a first location. Pre-stored map information and the first location are used to identify a recommended point according to a set of heuristics. Each heuristic of the set of heuristics has a ranking such that the recommended point corresponds to a location that satisfies at least one of the heuristics having a first rank and such that no other location satisfies any other heuristic of the set of heuristics having a higher rank than the first rank. The pre-stored map information identifying a plurality of pre-determined locations for the vehicle to stop, and the recommended point is one of the plurality of pre-determined locations.

Abstract: Example methods and systems for detecting weather conditions using vehicle onboard sensors are provided. An example method includes receiving laser data collected for an environment of a vehicle, and the laser data includes a plurality of laser data points. The method also includes associating, by a computing device, laser data points of the plurality of laser data points with one or more objects in the environment, and determining given laser data points of the plurality of laser data points that are unassociated with the one or more objects in the environment as being representative of an untracked object. The method also includes based on one or more untracked objects being determined, identifying by the computing device an indication of a weather condition of the environment.

Abstract: This technology relates to a system for clearing a sensor cover. The system may be comprised of a first sensor that rotates within a sensor cover, a plurality of second sensors that are fixed relative to the sensor cover, a first wiper that is configured to clear the sensor cover of debris, and a motor. The motor may rotate the first wiper in a first direction at a first predetermined rotation rate defined at least in part by a second predetermined rotation rate of the first sensor.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating vehicle intent predictions using a neural network. One of the methods includes obtaining an input characterizing one or more vehicles in an environment; generating, from the input, features of each of the vehicles; and for each of the vehicles: processing the features of the vehicle using each of a plurality of intent-specific neural networks, wherein each of the intent-specific neural networks corresponds to a respective intent from a set of intents, and wherein each intent-specific neural network is configured to process the features of the vehicle to generate an output for the corresponding intent.

Abstract: A system includes multiple microphone arrays positioned at different locations on a roof of an autonomous vehicle. Each microphone array includes two or more microphones. Internal clocks of each microphone array are synchronized by a processor and used to generate timestamps indicating when microphones capture a sound. Based on the timestamps, the processor is configured to localize a source of the sound.

Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance first sensor data for a first vehicle is identified. The first sensor data is defined in both a global coordinate system and a local coordinate system for the first vehicle. A second vehicle is identified based on a second location of the second vehicle within a threshold distance of the first vehicle within the first timeframe. The second vehicle is associated with second sensor data that is further associated with a label identifying a location of an object, and the location of the object is defined in a local coordinate system of the second vehicle. A conversion from the local coordinate system of the second vehicle to the local coordinate system of the first vehicle may be determined and used to transfer the label from the second sensor data to the first sensor data.

Abstract: This technology relates to a system for cooling sensor components. The cooling system may include a sensor which has a sensor housing, a motor, a main vent, and a side vent. Internal sensor components may be positioned within the sensor housing. The motor may be configured to rotate the sensor housing around an axis. The rotation of the sensor housing may pull air into an interior portion of the sensor housing through the main vent, and the air pulled into the interior portion of the sensor housing may be exhausted out of the interior portion of the sensor housing through the side vent.

Abstract: Example radar systems are presented herein. A radar system may include radiating elements configured to radiate electromagnetic energy and arranged symmetrically in a linear array. The radiating elements comprise a set of radiating doublets and a set of radiating singlets. The radar system also includes a waveguide configured to guide electromagnetic energy between each of the plurality of radiating elements and a waveguide feed. The waveguide feed is coupled to the second side of the waveguide at a center location between a first half of the plurality of radiating elements and a second half of the plurality of radiating elements. The waveguide feed is configured to transfer electromagnetic energy between the waveguide and a component external to the waveguides. The radar system may also include a power dividing network defined by the waveguide and configured to divide the electromagnetic energy transferred by the waveguide feed based on a taper profile.

Abstract: Aspects of the disclosure provide systems and methods for recognizing an assigned passenger. For instance, dispatching instructions to pick up a passenger at a pickup location are received. The instructions include authentication information for authenticating a client computing device associated with the passenger. A vehicle is maneuvered in an autonomous driving mode towards the pickup location. The client device is then authenticated. After authentication, a set of pedestrians within a predetermined distance of the vehicle are identified from sensor information generated by a sensor of the vehicle and location information is received over a period of time from the client device. The received location information is used to estimate a velocity of the passenger. This estimated velocity is used to identify a subset of set of pedestrians that is likely to be the passenger. The vehicle is stopped to allow the passenger to enter the vehicle based on the subset.

Abstract: Aspects of the technology employ sensors having high speed rotating mirror assemblies. For instance, the sensors may be Lidar sensors configured to detect people and other objects in an area of interest. A given mirror assembly may have a triangular or other geometric cross-sectional shape. The reflective faces of the mirror assembly may connect along edges or corners. In order to minimize wind drag and torque issues, the corners are rounded, filleted, beveled, chamfered or otherwise truncated. Such truncation may extend the length of the mirror side. The mirror assembly may employ one or more beam stops, light baffles and/or acoustic/aerodynamic baffles. These sensors may be employed with self-driving or manual driven vehicles or other equipment. The sensors may also be used in and around buildings.

Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data for a vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for the vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. A determination may be made as to whether the object is a static object. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing an initial representation of an environment to generate an updated representation that includes representations of one or more objects there were obscured in the initial representation. One of the methods includes obtaining initial surfel data comprising a plurality of surfels; determining a plurality of non-static surfels from the plurality of surfels; obtaining guidance data that characterizes a prediction for static surfaces in one or more first regions of the environment that were obscured by the plurality of non-static surfels in the initial surfel data; and processing the guidance data and the initial surfel data to generate final surfel data that comprises, for each first region of the environment, a plurality of predicted surfels that represent static surfaces in the first region that are partially or wholly obscured by objects represented by respective non-static surfels.

Abstract: The present application discloses embodiments that relate to an electromagnetic apparatus. In one aspect, the present apparatus includes a circuit board configured to propagate an electromagnetic signal. The apparatus also includes a waveguide configured to propagate an electromagnetic signal. The apparatus further includes a coupling port configured to couple a signal between the circuit board and the waveguide, where the coupling port has dimensions based on a desired impedance of the port.

Abstract: An apparatus for measuring retro-reflectivity of a target object in an outdoor environment includes a modulator to modulate a first optical signal based on a specified modulation value, an optical emitter, coupled to the modulator, to emit the first optical signal along an optical path towards the target object, and an optical detector positioned collinearly with respect to the optical emitter. The optical detector detects a second optical signal that is retro-reflected from the target object. The apparatus includes a lock-in amplifier coupled to the modulator and the optical detector. The lock-in amplifier receives a first electrical signal from the modulator and a second electrical signal from the optical detector, and generates, based on the first electrical signal and the second electrical signal, a third electrical signal indicative of the retro-reflectivity of the target object.