Abstract: Example embodiments described herein involve a system for testing a light-emitting module. The light-emitting module may include a mounting platform configured to hold a light-emitting module for a camera. The mounting platform may also be configured to rotate. The system may further include a housing holding a plurality of photodiodes arranged in an array over at least a 90 degree arc of a hemisphere. The system may also include a controller configured to control the photodiodes and the rotation of the mounting platform.

Abstract: The technology relates to cargo vehicles. National, regional and/or local regulations set requirements for operating cargo vehicles, including how to distribute and secure cargo, and how often the cargo should be inspected during a trip. However, such regulations have been focused on traditional human-driven vehicles. Aspects of the technology address various issues involved with securement and inspection of cargo before a trip, as well as monitoring during the trip so that corrective action may be taken as warranted. For instance, imagery and other sensor information may be used to enable proper securement of cargo before starting a trip. Onboard sensors along the vehicle monitor the cargo and securement devices/systems during the trip to identify issues as they arise. Such information is used by the onboard autonomous driving system (or a human driver) to take corrective action depending on the nature of the issue.

Abstract: The technology relates to route planning and performing driving operations in autonomous vehicles, such as cargo trucks, articulating buses, as well as other vehicles. A detailed kinematic model of the vehicle in evaluated in conjunction with roadgraph and other information to determine whether a route or driving operation is feasible for the vehicle. This can include evaluating a hierarchical set of driving rules and whether current driving conditions impact any of the rules. Driving trajectories and cost can be evaluated when pre-planning a route for the vehicle to follow. This can include determining an ideal trajectory for the vehicle to take a particular driving action. Pre-planned routes may be shared with a fleet of vehicles, and can be modified based on information obtained by different vehicles of the fleet.

Abstract: The technology relates to partially redundant equipment architectures for vehicles able to operate in an autonomous driving mode. Aspects of the technology employ fallback configurations, such as two or more fallback sensor configurations that provide some minimum amount of field of view (FOV) around the vehicle. For instance, different sensor arrangements are logically associated with different operating domains of the vehicle. Fallback configurations for computing resources and/or power resources are also provided. Each fallback configuration may have different reasons for being triggered, and may result in different types of fallback modes of operation. Triggering conditions may relate, e.g., to a type of failure, fault or other reduction in component capability, the current driving mode, environmental conditions in the vicinity of vehicle or along a planned route, or other factors.

Abstract: Aspects of the present disclosure relate to a vehicle having one or more computing devices that may receive instructions to pick up a passenger at a location, determine when the vehicle is within a first distance of the location, provide a first notification that the vehicle is within the first distance, and stop the vehicle. When the vehicle is stopped, the computing device may initiate a countdown. When a client computing device associated with the passenger has not been authenticated, the computing devices may provide a second notification based on a first amount of time remaining in the countdown and a third notification indicating that the trip is cancelled based on a second amount of time remaining in the countdown less than the first amount of time. Once the third notification is provided, the computing devices move the vehicle from the where the vehicle is stopped without the passenger.

Abstract: Example embodiments relate to multiple operating modes to expand dynamic range. An example embodiment includes a camera system. The camera system may include a first image sensor having a first dynamic range corresponding to a first range of luminance levels in a scene. The system may also include a second image sensor having a second dynamic range corresponding to a second range of luminance levels in the scene. The camera system may further include a processor coupled to the first image sensor and the second image sensor. The processor may be configured to execute instructions to identify objects of a first type in a first image of the scene captured by the first image sensor and identify objects of a second object type in a second image of the scene captured by the second image sensor.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for the generation and use of a surfel map with semantic labels. One of the methods includes receiving a surfel map that includes a plurality of surfels, wherein each surfel has associated data that includes one or more semantic labels; obtaining sensor data for one or more locations in the environment, the sensor data having been captured by one or more sensors of a first vehicle; determining one or more surfels corresponding to the one or more locations of the obtained sensor data; identifying one or more semantic labels for the one or more surfels corresponding to the one or more locations of the obtained sensor data; and performing, for each surfel corresponding to the one or more locations of the obtained sensor data, a label-specific detection process for the surfel.

Abstract: Example methods and systems for calibrating sensors using road map data are provided. An autonomous vehicle may use various vehicle sensors to assist in navigation. Within examples, the autonomous vehicle may calibrate vehicle sensors through performing a comparison or analysis between information about the environment received by sensors with similar information provided by map data (e.g., a road map). The autonomous vehicle may compare object locations as provided by the sensors and as shown by map data. Based on the comparison, the autonomous vehicle may adjust various sensors to accurately reflect the information as provided by the road map. In some instances, the autonomous vehicle may adjust the position, height, orientation, direction-of-focus, scaling, or other parameters of a sensor based on the information provided by a road map.

Abstract: A rotary joint includes a shaft having a first end, a second end, and a cavity. The rotary joint includes a first waveguide section having a first proximal end and a first distal end. The first proximal end of the first waveguide section is positioned within the cavity and secured to the inner surface of the shaft. The rotary joint includes a second waveguide section that includes a second proximal end and a second distal end. The second proximal end of the second waveguide section is positioned within the cavity of the shaft and unsecured to the inner surface of the shaft to form a radial gap between an outer surface of the second proximal end and a laterally adjacent portion of the inner surface of the shaft. The shaft and the first waveguide section are configured to rotate about the rotational axis and relative to the second waveguide section.

Abstract: Aspects of the disclosure relate to analyzing head movements in a test driver tasked with monitoring the driving of a vehicle operating in an autonomous driving mode. For instance, a sensor may be used to capture sensor data of a test driver's head for a period of time. The sensor data may be analyzed to determine whether the test driver's head moved sufficiently enough to suggest that the test driver is engaged in monitoring the driving of the vehicle. Based on the determination of whether the test driver's head moved sufficiently enough, an intervention response may be initiated.

Abstract: A method and apparatus are provided for determining whether a driving environment has changed relative to previously stored information about the driving environment. The apparatus may include an autonomous driving computer system configured to detect one or more vehicles in the driving environment, and determine corresponding trajectories for those detected vehicles. The autonomous driving computer system may then compare the determined trajectories to an expected trajectory of a hypothetical vehicle in the driving environment. Based on the comparison, the autonomous driving computer system may determine whether the driving environment has changed and/or a probability that the driving environment has changed, relative to the previously stored information about the driving environment.

Abstract: In one example, a LIDAR device includes a light sources that emits light and a transmit lens that directs the emitted light to illuminate a region of an environment with a field-of-view defined by the transmit lens. The LIDAR device also includes a receive lens that focuses at least a portion of incoming light propagating from the illuminated region of the environment along a predefined optical path. The LIDAR device also includes an array of light detectors positioned along the predefined optical path. The LIDAR device also includes an offset light detector positioned outside the predefined optical path. The LIDAR device also includes a controller that determines whether collected sensor data from the array of light detectors includes data associated with another light source different than the light source of the device based on output from the offset light detector.

Abstract: The technology employs a holistic approach to passenger pickups and other wayfinding situations. This includes identifying where passengers are relative to the vehicle and/or the pickup location. Information synthesis from different sensors, agent behavior prediction models, and real-time situational awareness are employed to identify the likelihood that the passenger to be picked up is at a given location at a particular point in time, with sufficient confidence. The system can provide adaptive navigation by helping passengers understand their distance and direction to the vehicle, for instance using various cues via an app on the person's device. Rider support tools may be provided, which enable a remote agent to interact with a customer via that person's device, such as using the camera on the device to provide wayfinding support to enable the person to find their vehicle. Ride support may also use sensor information from the vehicle when providing wayfinding support.

Abstract: A system includes a memory device and a processing device, operatively coupled to the memory device, to obtain a set of predicted behavior data including data indicative of one or more predicted object behaviors for one or more respective objects in an environment of an autonomous vehicle, obtain a set of observed behavior data including data indicative of one or more observed object behaviors of the one or more objects, determine, based on a comparison of the set of predicted behavior data and the set of observed behavior data, whether a set of incorrect object behavior predictions exists within the set of predicted behavior data, and upon determining that the set of incorrect object behavior predictions exists, initiate, based on at least a generated subset of the set of incorrect object behavior predictions, one or more operations to address the set of incorrect object behavior predictions.

Abstract: The present disclosure relates to optical devices and systems, specifically those related to light detection and ranging (LIDAR) systems. An example device includes a shaft defining a rotational axis. The shaft includes a first material having a first coefficient of thermal expansion. The device also includes a rotatable mirror disposed about the shaft. The rotatable mirror includes a multi-sided structure having an exterior surface and an interior surface. The multi-sided structure includes a second material having a second coefficient of thermal expansion. The second coefficient of thermal expansion is different from the first coefficient of thermal expansion. The multi-sided structure also includes a plurality of reflective surfaces disposed on the exterior surface of the multi-sided structure. The multi-sided structure yet further includes one or more support members coupled to the interior surface and the shaft.

Abstract: The technology provides an interior camera sensing system for self-driving vehicles. The sensor system includes image sensors and infrared illuminators to see the vehicle's cabin and storage areas in all ambient lighting conditions. The system can monitor the vehicle for safety purposes, to detect the cleanliness of the cabin and storage areas, as well as to detect whether packages or other objects have been inadvertently left in the vehicle. The cameras are arranged to focus on selected regions in the vehicle cabin and the system carries out certain actions in response to information evaluated for those regions. The interior space is divided into multiple zones assigned different coverage priorities. Regardless of elude size or configuration, certain actions are performed according to various ride checklists and the imagery detected by the interior cameras. The checklists include pre-ride, mid-ride, and post-ride checklists.

Abstract: One example device includes a rotor platform that rotates about an axis of rotation. The device also includes a rotor coil comprising a first plurality of conductive loops disposed along a planar mounting surface of the rotor platform. The device also includes a stator platform and a stator coil comprising a second plurality of conductive loops disposed along a planar mounting surface of the stator platform. The rotor coil and the stator coil are coaxially arranged about the axis of rotation. The stator coil remains within a first predetermined distance to the rotor coil in response to rotation of the rotor platform. The device also includes a magnetic core extending along the axis of rotation and through the stator coil. The magnetic core remains within a second predetermined distance to the stator coil in response to rotation of the rotor platform.

Abstract: A system includes an array of photodiode sensors positioned on an autonomous vehicle. Each photodiode sensor in the array of photodiode sensors is oriented in a different direction and configured to generate electrical current signals in response to detecting a flashing light in a surrounding environment of the autonomous vehicle. The system also includes a processor coupled to the array of photodiode sensors. The processor is configured to determine a location of a source of the flashing light relative to the autonomous vehicle based on electrical current signals from at least one photodiode sensor in the array of photodiode sensors. The processor is also configured to generate a command to maneuver the autonomous vehicle based on the location of the source relative to the autonomous vehicle.