Abstract: A system may include a first sensor of a first type and a second sensor of a second different type and having a detector. A field of view of the second sensor may be formed by a plurality of regions of interest (ROIs) defined by the detector. Control circuitry of the system may be configured to perform operations including obtaining, from the first sensor, first sensor data representing an environment, and determining, based on the first sensor data, information associated with a feature of interest within the environment. The operations may also include determining, based on the information, a particular ROI that corresponds to an expected position of the feature at a later time, obtaining a plurality of ROI sensor data from the particular ROI instead of obtaining full-resolution sensor data, and analyzing the plurality of ROI sensor data to determine one or more attributes of the feature.

Abstract: The technology relates to a seamless interface between an autonomous vehicle service provider and one or more ridesharing, ride-hailing or delivery partner companies, in order to provide timely, efficient rider or delivery services and support. A partner trip application programming interface (API) provides robust features to the ridesharing or ride-hailing partner companies and also supports delivery of meals, groceries, packages or other cargo. For instance, the API may be employed with delivery partners (e.g., food, package or bulk cargo delivery), and/or for concierge services (e.g., a hotel or medical provider or an e-commerce specialist that coordinates deliveries). The technology supports both ad hoc and scheduled trips. Agents for different partners may schedule trips to or from specific stores or other (geofenced) locations, and observe and manage trips for an entire enterprise. Permissions can be tailored for each agent.

Abstract: The present disclosure relates to contaminant detection systems and related optical systems and methods. An example contaminant detection system includes an optical coupler configured to couple light into and/or out of an optical element. The contaminant detection system also includes a plurality of light-emitter devices configured to emit emission light toward the optical coupler. The contaminant detection system additionally includes a plurality of detector devices configured to detect at least a portion of the emission light by way of the optical element and the optical coupler. The plurality of detector devices is also configured to provide detector signals indicative of a presence of a contaminant on the optical element.

Abstract: One example method involves obtaining a plurality of scans of a field-of-view (FOV) of a light detection and ranging (LIDAR) device disposed inside a housing. Obtaining each scan of the plurality of scans comprises: transmitting, through a plurality of sections of the housing, a plurality of light pulses emitted from the LIDAR device in different directions toward the housing; and detecting a plurality of returning light pulses comprising reflected portions of the transmitted plurality of light pulses that are reflected back toward the LIDAR device. The method also involves detecting an obstruction that at least partially occludes the LIDAR device from scanning the FOV through the housing based on the plurality of scans.

Abstract: An apparatus includes a lens assembly that includes at least one lens that defines an optical axis. The apparatus also includes a substrate, an image sensor disposed on the substrate, and an actuator coupled to the substrate and configured to adjust a position of the substrate relative to the lens assembly to move the image sensor along the optical axis. The apparatus additionally includes a capacitive position sensor that includes a first capacitive plate coupled to the substrate and a second capacitive plate coupled to the lens assembly. The capacitive position sensor may be configured to generate a capacitance measurement indicative of the position of the substrate relative to the lens assembly. The apparatus further includes circuitry configured to control the actuator based on (i) the capacitance measurement and (ii) a target position of the image sensor relative to the lens assembly.

Abstract: Aspects of the disclosure provide for controlling an autonomous vehicle. For instance, a first probability distribution may be generated for the vehicle at a first future point in time using a generative model for predicting expected behaviors of objects and a set of characteristics for the vehicle at an initial time expected to be perceived by an observer. Planning system software of the vehicle may be used to generate a trajectory for the vehicle to follow. A second probability distribution may be generated for a second future point in time using the generative model based on the trajectory and a set of characteristics for the vehicle at the first future point expected to be perceived by the observer. A surprise assessment may be generated by comparing the first probability distribution to the second probability distribution. The vehicle may be controlled based on the surprise assessment.

Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing a conditional behavior prediction for one or more agents. The system obtains context data characterizing an environment. The context data includes data characterizing a plurality of agents, including a query agent and one or more target agents, in the environment at a current time point. The system further obtains data identifying a planned future trajectory for the query agent after the current time point, and for each target agent in the set, processes the context data and the data identifying the planned future trajectory using a first neural network to generate a conditional trajectory prediction output that defines a conditional probability distribution over possible future trajectories of the target agent after the current time point given that the query agent follows the planned future trajectory for the query agent after the current time point.

Abstract: The technology relates to assisting large self-driving vehicles, such as cargo vehicles, as they maneuver towards and/or park at a destination facility. This may include a given vehicle transitioning between different autonomous driving modes. Such a vehicles may be permitted to drive in a fully autonomous mode on certain roadways for the majority of a trip, but may need to change to a partially autonomous mode on other roadways or when entering or leaving a destination facility such as a warehouse, depot or service center. Large vehicles such as cargo truck may have limited room to maneuver in and park at the destination, which may also prevent operation in a fully autonomous mode. Here, information from the destination facility and/or a remote assistance service can be employed to aid in real-time semi-autonomous maneuvering.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for selecting locations in an environment of a vehicle where objects are likely centered and determining properties of those objects. One of the methods includes receiving an input characterizing an environment external to a vehicle. For each of a plurality of locations in the environment, a respective first object score that represents a likelihood that a center of an object is located at the location is determined. Based on the first object scores, one or more locations from the plurality of locations are selected as locations in the environment at which respective objects are likely centered. Object properties of the objects that are likely centered at the selected locations are also determined.

Abstract: A computing system may operate a LIDAR device to emit and detect light pulses in accordance with a time sequence including standard detection period(s) that establish a nominal detection range for the LIDAR device and extended detection period(s) having durations longer than those of the standard detection period(s). The system may then make a determination that the LIDAR detected return light pulse(s) during extended detection period(s) that correspond to particular emitted light pulse(s). Responsively, the computing system may determine that the detected return light pulse(s) have detection times relative to corresponding emission times of particular emitted light pulse(s) that are indicative of one or more ranges. Given this, the computing system may make a further determination of whether or not the one or more ranges indicate that an object is positioned outside of the nominal detection range, and may then engage in object detection in accordance with the further determination.

Abstract: The technology relates to assisting large self-driving vehicles, such as cargo vehicles, as they maneuver towards and/or park at a destination facility. This may include a given vehicle transitioning between different autonomous driving modes. Such a vehicles may be permitted to drive in a fully autonomous mode on certain roadways for the majority of a trip, but may need to change to a partially autonomous mode on other roadways or when entering or leaving a destination facility such as a warehouse, depot or service center. Large vehicles such as cargo truck may have limited room to maneuver in and park at the destination, which may also prevent operation in a fully autonomous mode. Here, information from the destination facility and/or a remote assistance service can be employed to aid in real-time semi-autonomous maneuvering.

Abstract: An example circuit includes a light detector and a biasing capacitor having (i) a first terminal that applies to the light detector an output voltage that can either bias or debias the light detector and (ii) a second terminal for controlling the output voltage. The circuit includes a first transistor connected to the second terminal of the biasing capacitor and configured to drive the output voltage to a first voltage level above a biasing threshold of the light detector and thereby biasing the light detector. The circuit includes a second transistor connected to the second terminal of the biasing capacitor and configured to drive the output voltage to a second voltage level below the biasing threshold of the light detector and thereby debiasing the light detector. The second voltage is a non-zero voltage that corresponds to a charge level of the biasing capacitor.

Abstract: A method for determining runout error includes generating a first magnetic field to interact with a second magnetic field generated by four or more poles of a magnet ring mounted to a first platform. The interaction may cause the first platform to rotate relative to a second platform. The method may further include receiving, from a magnetic field sensor, data including respective boundaries between neighboring poles of the four or more poles relative to a corresponding nominal boundary defined by substantially uniform boundary spacing. The method may include determining a magnetic field pattern from the data and, based on the pattern, determining an angular position of the four or more poles. The method may further include determining an angular difference between the determined angular position and a nominal angular position. The method may also include determining a runout error based on an amplitude of the angular difference.

Abstract: The technology involves an in-vehicle communication system with a console that is positioned within the cabin of the vehicle, for instance between the front seats so that passengers in the second row can view and access it. The console is configured to provide contextual information to passengers. The console includes a monitor assembly that has a display screen and a notification region. The notification region includes one or more displayable icons and at least one receptacle for a communication device of a passenger. The notification region has a first section comprising an outer cover layer with a first series of masking, diffuser and illuminating layers to selectively illuminate the one or more displayable icons. The notification region has a second section comprising the outer cover layer with a second series of masking, diffuser and illuminating layers to selectively illuminate the at least one receptacle for the communication device.

Abstract: A method and apparatus is provided for controlling the operation of an autonomous vehicle. According to one aspect, the autonomous vehicle may track the trajectories of other vehicles on a road. Based on the other vehicle's trajectories, the autonomous vehicle may generate a pool of combined trajectories. Subsequently, the autonomous vehicle may select one of the combined trajectories as a representative trajectory. The representative trajectory may be used to change at least one of the speed or direction of the autonomous vehicle.

Abstract: A laser diode firing circuit for a light detection and ranging device is disclosed. The firing circuit includes a laser diode coupled in series to a transistor, such that current through the laser diode is controlled by the transistor. The laser diode is configured to emit a pulse of light in response to current flowing through the laser diode. The firing circuit includes a capacitor that is configured to charge via a charging path that includes an inductor and to discharge via a discharge path that includes the laser diode. The transistor controlling current through the laser diode can be a Gallium nitride field effect transistor.

Abstract: This technology relates to a display mounted messaging system. The display mounted messaging system may include a light emitting diode (LED) display attached to a housing of a sensor. The housing of the sensor may rotate. The display mounted messaging system may also include an LED controller which is configured to selectively activate and deactivate at least one LED in the LED display, to provide a message in the direction of an intended recipient.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating realistic full-scene point clouds. One of the methods includes obtaining an initial scene point cloud characterizing an initial scene in an environment; obtaining, for each of one or more objects, an object point cloud that characterizes the object; and processing a first input comprising the initial scene point cloud and the one or more object point clouds using a first neural network that is configured to process the first input to generate a final scene point cloud that characterizes a transformed scene that has the one or more objects added to the initial scene.

Abstract: The present disclosure relates to limitation of noise on light detectors using an aperture. One example embodiment includes a system. The system includes a lens disposed relative to a scene and configured to focus light from the scene onto a focal plane. The system also includes an aperture defined within an opaque material disposed at the focal plane of the lens. The aperture has a cross-sectional area. In addition, the system includes an array of light detectors disposed on a side of the focal plane opposite the lens and configured to intercept and detect diverging light focused by the lens and transmitted through the aperture. A cross-sectional area of the array of light detectors that intercepts the diverging light is greater than the cross-sectional area of the aperture.