Abstract: One example system comprises a LIDAR sensor that rotates about an axis to scan an environment of the LIDAR sensor. The system also comprises one or more cameras that detect external light originating from one or more external light sources. The one or more cameras together provide a plurality of rows of sensing elements. The rows of sensing elements are aligned with the axis of rotation of the LIDAR sensor. The system also comprises a controller that operates the one or more cameras to obtain a sequence of image pixel rows. A first image pixel row in the sequence is indicative of external light detected by a first row of sensing elements during a first exposure time period. A second image pixel row in the sequence is indicative of external light detected by a second row of sensing elements during a second exposure time period.

Abstract: This technology relates to system for clearing a sensor cover. The system may include a sprayer, a support, and a positioning device. The sprayer may be mounted to the support and direct a flow of fluid to the sensor cover. The positioning device may be configured to adjust the position of the sprayer on the support. The system may include a nozzle and the nozzle may be positioned to direct the flow of fluid to an area of the sensor cover. The system may include additional sprayers.

Abstract: An apparatus includes a first platform and a second platform configured to rotate relative to the first platform about an axis. A magnet ring is mounted to the first platform and centered around the axis. The magnet ring includes four or more magnetized poles positioned such that each respective boundary between neighboring poles is shifted relative to a corresponding nominal boundary defined by a uniform spacing of boundaries of the poles around the magnet ring. The shifted boundaries of the poles define a characteristic shift pattern for the magnet ring. A magnetic field sensor is connected to the second platform. Circuitry is configured to (i) determine a magnetic field pattern generated by the poles based on data generated by the sensor and (ii) determine a rotational position of the first platform relative to the second platform by correlating the magnetic field pattern to the characteristic shift pattern.

Abstract: The present disclosure relates to optical systems and methods for their manufacture. An example method includes coupling a first surface of a light-emitter substrate to a reference surface of a carrier substrate. The method also includes registering a mold structure with respect to the reference surface of the carrier substrate. Furthermore, the method includes using the mold structure to form an optical material over at least a portion of the light-emitter substrate. The optical material is shaped according to a shape of the mold structure and includes at least one registration feature. The method also includes coupling an optical lens element to the optical material such that the optical lens element is registered to the at least one registration feature.

Abstract: Aspects of the disclosure relate to determining a sign type of an unfamiliar sign. The system may include one or more processors. The one or more processors may be configured to receive an image and identify image data corresponding to a traffic sign in the image. The image data corresponding to the traffic sign may be input in a sign type model. The processors may determine that the sign type model was unable to identify a type of the traffic sign and determine one or more attributes of the traffic sign. The one or more attributes of the traffic sign may be compared to known attributes of other traffic signs and based on this comparison, a sign type of the traffic sign may be determined. The vehicle may be controlled in an autonomous driving mode based on the sign type of the traffic sign.

Abstract: The disclosure describes a system that includes a self-driving system for operating a vehicle autonomously, one or more optical transmitters mounted on the vehicle, and one or more computing devices in communication with the self-driving system and the one or more optical transmitters. The one or more computing devices are configured to operate the self-driving system to cause the vehicle to approach a designated location in proximity of a structure on which one or more receivers are mounted and determine that the one or more optical transmitters have an alignment with the one or more receivers. Then, the one or more computing devices are configured to operate the one or more optical transmitters to establish an optical communication link with the one or more receivers and transmit data to the one or more receivers over the optical communication link.

Abstract: The present disclosure relates to a target, a method, and a system for calibrating a camera. One example embodiment includes a target. The target includes a first pattern of fiducial markers. The target also includes a second pattern of fiducial markers. The first pattern of fiducial markers is a scaled version of the second pattern of fiducial markers, such that a calibration image captured of the target simulates multiple images of a single pattern captured at multiple calibration perspectives.

Abstract: Example radar systems are presented herein. A radar system may include radiating elements configured to radiate electromagnetic energy and arranged symmetrically in a linear array. The radiating elements comprise a set of radiating doublets and a set of radiating singlets. The radar system also includes waveguide configured to guide electromagnetic energy between each of the plurality of radiating elements and a waveguide feed. The waveguide feed is coupled to the second side of the waveguide at a center location between a first half of the plurality of radiating elements and a second half of the plurality of radiating elements. The waveguide feed is configured to transfer electromagnetic energy between the waveguide and a component external to the waveguides. The radar system may also include a power dividing network defined by the waveguide and configured to divide the electromagnetic energy transferred by the waveguide feed based on a taper profile.

Abstract: Example implementations may relate to sun-aware vehicle routing. In particular, a computing system of a vehicle may determine an expected position of the sun relative to a geographic area. Based on the expected position, the computing system may make a determination that travel of the vehicle through certain location(s) within the geographic area is expected to result in the sun being proximate to an object within a field of view of the vehicle's image capture device. Responsively, the computing system may generate a route for the vehicle in the geographic area based at least on the route avoiding travel of the vehicle through these certain location(s), and may then operate the vehicle to travel in accordance with the generated route. Ultimately, this may help reduce or prevent situations where quality of image(s) degrades due to sunlight, which may allow for use of these image(s) as basis for operating the vehicle.

Abstract: Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating in a rewind mode. In the rewind mode, the system may be configured to provide information to a remote assistance operated based on a remote-assistance triggering criteria being met, such as determining that the autonomous vehicle has been stopped for a period of time. When the triggering criteria is met, the remote assistance system may provide data from the time leading up to when the remote-assistance triggering criteria was met that was capture of the environment of autonomous vehicle to the remote assistance operator. Based on viewing the data, the remote assistance operator may provide and input to the system that causes a command to be issued to the autonomous vehicle.

Abstract: The present disclosure provides methods and apparatuses that enable a radar system to transmit radar signals into lanes on a roadway in which a vehicle may turn. For example, when a car is making a protected right turn, that is a right turn when there is another vehicle traveling in the same direction in a lane adjacent to the lane of the turning vehicle, a traditional radar may have its view of the lane in which it is turning obscured by the vehicle in the lane adjacent to the lane of the turning vehicle. By using radar deflectors strategically located near the front of the vehicle, the radar signals may be deflected at angles to avoid being obstructed by the vehicle in the lane adjacent to the lane of the turning vehicle.

Abstract: Aspects of the disclosure relate to detecting sidewalks adjacent to roads. In this regard, a set of potential sidewalk areas adjacent to one or more roads in a vehicle's vicinity may be determined based on map data. Topology data for the set of potential sidewalk areas may be generated based on sensor data received from a perception system of the vehicle. The set of potential sidewalks may be filtered to remove areas unlikely to include a sidewalk. The vehicle may be operated based on the filtered set of potential sidewalk areas, which may include taking precautionary measures when within a predetermined distance from any of the filtered set of potential sidewalks.

Abstract: Example systems and methods allow for reporting and sharing of information reports relating to driving conditions within a fleet of autonomous vehicles. One example method includes receiving information reports relating to driving conditions from a plurality of autonomous vehicles within a fleet of autonomous vehicles. The method may also include receiving sensor data from a plurality of autonomous vehicles within the fleet of autonomous vehicles. The method may further include validating some of the information reports based at least in part on the sensor data. The method may additionally include combining validated information reports into a driving information map. The method may also include periodically filtering the driving information map to remove outdated information reports. The method may further include providing portions of the driving information map to autonomous vehicles within the fleet of autonomous vehicles.

Abstract: Methods and devices for detecting traffic signals and their associated states are disclosed. In one embodiment, an example method includes a scanning a target area using one or more sensors of a vehicle to obtain target area information. The vehicle may be configured to operate in an autonomous mode, and the target area may be a type of area where traffic signals are typically located. The method may also include detecting a traffic signal in the target area information, determining a location of the traffic signal, and determining a state of the traffic signal. Also, a confidence in the traffic signal may be determined. For example, the location of the traffic signal may be compared to known locations of traffic signals. Based on the state of the traffic signal and the confidence in the traffic signal, the vehicle may be controlled in the autonomous mode.

Abstract: Methods and devices for using a relationship between activities of different traffic signals in a network to improve traffic signal state estimation are disclosed. An example method includes determining that a vehicle is approaching an upcoming traffic signal. The method may further include determining a state of one or more traffic signals other than the upcoming traffic signal. Additionally, the method may also include determining an estimate of a state of the upcoming traffic signal based on a relationship between the state of the one or more traffic signals other than the upcoming traffic signal and the state of the upcoming traffic signal.

Abstract: The present disclosure relates to optical systems, vehicles, and methods that are configured to illuminate and image a wide field of view of an environment. An example optical system includes a camera having an optical axis and an outer lens element disposed along the optical axis. The optical system also includes a plurality of illumination modules, each of which includes at least one light-emitter device configured to emit light along a respective emission axis and a secondary optical element optically coupled to the at least one light-emitter device. The secondary optical element is configured to provide a light emission pattern having an azimuthal angle extent of at least 170 degrees so as to illuminate a portion of an environment of the optical system.

Abstract: Aspects of the disclosure relate to a system that includes a memory storing a queue for arranging tasks, a plurality of self-driving systems for controlling an autonomous vehicle, and one or more processors. The one or more processors may receive a non-passenger task request with a priority level of the non-passenger task request. When the non-passenger task request is accepted, the one or more processors may insert the task in the queue based on the priority level of the task request. Then, the one or more processors may provide instructions to one or more self-driving systems according to the non-passenger task request. Having received updates of the status of the autonomous vehicle, the one or more processors may determine that the task is completed based on the updates. After determining that the task is completed, the one or more processors may remove the task from the queue.

Abstract: Aspects of the disclosure relate to training and using a phrase recognition model to identify phrases in images. As an example, a selected phrase list may include a plurality of phrases is received. Each phrase of the plurality of phrases includes text. An initial plurality of images may be received. A training image set may be selected from the initial plurality of images by identifying the phrase-containing images that include one or more phrases from the selected phrase list. Each given phrase-containing image of the training image set may be labeled with information identifying the one or more phrases from the selected phrase list included in the given phrase-containing images. The model may be trained based on the training image set such that the model is configured to, in response to receiving an input image, output data indicating whether a phrase of the plurality of phrases is included in the input image.

Abstract: Aspects of the disclosure relate to detecting and responding to objects in a vehicle's environment. For example, an object may be identified in a vehicle's environment, the object having a heading and location. A set of possible actions for the object may be generated using map information describing the vehicle's environment and the heading and location of the object. A set of possible future trajectories of the object may be generated based on the set of possible actions. A likelihood value of each trajectory of the set of possible future trajectories may be determined based on contextual information including a status of the detected object. A final future trajectory is determined based on the determined likelihood value for each trajectory of the set of possible future trajectories. The vehicle is then maneuvered in order to avoid the final future trajectory and the object.

Abstract: The disclosure relate to detecting performance regressions in software used to control autonomous vehicles. For instance, a simulation may be run using a first version of the software. While the simulation is running, CPU and memory usage by one or more functions of the first version of the software may be sampled. The sampled CPU and memory usage may be compared to CPU or memory usage by each of the one or more functions in a plurality of simulations each running a corresponding second version of the software. Based on the comparisons, an anomaly corresponding to a performance regression in the first version of the software relating to one of the one or more functions may be identified. In response to detecting the anomaly, the first version of the software and the one of the one or more functions may be flagged for review.