Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can include returns associated with highly reflective objects that cause glare. In some examples, a depth of a sensed surface is determined from the sensor data and additional pixels at the same depth are identified. The subset of pixels at the depth are filtered by comparing a measured intensity value to a threshold intensity value for the depth. Other threshold intensity values can be applied to subsets of pixels at different depths.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. The sensor may generate first image data at a first configuration and second image data at a second configuration. A disambiguated depth of a surface may be determined from the first image data and the second image data. If the disambiguated depth is greater than a nominal maximum depth of the sensor in the first configuration, an intensity of the surface may be determined from the first image data. If the intensity meets or exceeds a threshold intensity, the surface may be determined to be beyond the nominal maximum depth. If the intensity is less than the threshold intensity, an actual depth of the surface may be determined form the second image data as a distance less than the nominal maximum depth.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can return unreliable pixels, e.g., in the case of over-exposure or saturation. In some examples, multiple exposures captured at different exposure times can be used to determine an overall saturation value or metric representative of the sensor data. The saturation value may be used to control parameters of the sensor. For instance, the saturation value may be used to determine power control parameters for the sensor, e.g., to reduce over- and/or under-exposure.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can include saturated pixels, e.g., due to over-exposure, sensing highly-reflective objects, and/or excessive ambient light. In some examples, parameters associated with power of a time-of-flight sensor can be altered based on characteristics of the saturated pixels, as well as information about non-saturated pixels neighboring the saturated pixels. For example, the neighboring pixels may provide information about whether saturation is due to ambient light, e.g., sunlight, or due to emitted light from the sensor.

Abstract: A vehicle computing system may implement techniques to emit warning sounds from a vehicle to notify other entities in an environment with the vehicle of the vehicle operation. A vehicle computing system may be configured to emit warning sounds based on a speed associated with the vehicle. The vehicle computing system may determine a planned vehicle trajectory and that a speed corresponding to the planned vehicle trajectory is associated with the warning sound emission. The vehicle computing system may determine a time that the vehicle will be at the speed and may emit the warning sound substantially at the time. In some examples, the vehicle computing system may emit a different sound prior to the time and may transition to the warning sound associated with the speed at the time. By warning other entities of the vehicle operation, the warning sound emission system may improve the safety of vehicle operation.

Abstract: A LIDAR sensor assembly includes a laser light source to emit laser light, and a light sensor to produce a light signal in response to sensing reflections of the laser light emitted by the laser light source from a reference surface that is fixed in relation to the LIDAR sensor assembly. A controller of the LIDAR sensor assembly can process a plurality of samples of reflected light signals, process the samples to remove erroneous readings, and then provide accurate distance measurement. The system can use low-pass filters, or other components, to filter the plurality of samples to enable the “actual,” or primary, reflected light signal (i.e., light signal reflected off of a surface in an environment external to the sensor assembly, as opposed to extraneous, internal reflections off of lenses or other components or noise) to be identified and an accurate time of flight to be calculated.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can return pixels subject to over-exposure or saturation, which may be from stray light. In some examples, multiple exposures captured at different exposure times can be used to determine a saturation value for sensor data. The saturation value may be used to determine a threshold intensity against which intensity values of a primary exposure are compared. A filtered data set can be obtained based on the comparison.

Abstract: A time delay of arrival (TDOA) between a time that a light pulse was emitted to a time that a pulse reflected off an object was received at a light sensor may be determined for saturated signals by using an edge of the saturated signal, rather than a peak of the signal, for the TDOA calculation. The edge of the saturated signal may be accurately estimated by fitting a first polynomial curve to data points of the saturated signal, defining an intermediate magnitude threshold based on the polynomial curve, fitting a second polynomial curve to data points near an intersection of the first polynomial curve and the intermediate threshold, and identifying an intersection of the second polynomial curve and the intermediate threshold as the rising edge of the saturated signal.

Abstract: Techniques for adaptive cross-correlation are discussed. A first signal is received from a first audio sensor associated with a vehicle and a second signal is received from a second audio sensor associated with the vehicle. Techniques may include determining, based at least in part on the first signal, a first transformed signal in a frequency domain. Additionally, the techniques include determining, based at least in part on the second signal, a second transformed signal in the frequency domain. A parameter can be determined based at least in part on a characteristic associated with at least one of the vehicle, an environment proximate the vehicle, or one or more of the first or second signal. Cross-correlation data can be determined based at least in part on one or more of the first transformed signal, the second transformed signal, or the parameter.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can return unreliable pixels, e.g., in the case of over- or under-exposure. In some examples, parameters associated with power of a time-of-flight sensor can be altered based on a number of unreliable pixels in measured data and/or based on intensity values of the measured data. For example, unreliable pixels can be determined using phase frame information captured at a receiver of the sensor.

Abstract: The described techniques relate to a simulation system that multiplexes sensor data from multiple sensors and outputs the multiplexed sensor data in channels corresponding to the multiple sensors to appropriate vehicle systems at an appropriate time based on encoded timestamp data. In examples, a multiplexer may receive sensor datasets associated with different sensors. The multiplexer may encode the different sensor datasets with timestamp data and supplemental data to generate an encoded dataset. The multiplexer may output the encoded dataset to a video output port to transmit the encoded dataset to a demultiplexer. The demultiplexer receives the encoded dataset from the video output port, and separates the encoded dataset into channels corresponding to the sensors from which the sensor data was received. The demultiplexer may output the datasets in the respective channels at a time (or times) indicated in the timestamp data and according to the supplemental data.

Abstract: Techniques are disclosed for adding time data to scan lines of an image frame. In some examples, an image sensor may perform a rolling shutter image capture to produce the scan lines. Data captured by another sensor may be associated with at least a portion of a scan line based at least in part on the time data added to the scan line in some examples. Furthermore, techniques are disclosed for synchronizing data capture by multiple sensors. For example, a rolling shutter image capture performed by an image sensor may be synchronized with a data capture performed by another sensor.

Abstract: Techniques for facilitating a robust clock synchronization across a computer network that presumes network jitter exists are discussed herein. A first device and a second device transceive a plurality of sets of time-synchronization messages to synchronize a synchronization clock of the second device to a first clock of the first device. The second device calculates a smoothing of time delay data of a plurality of sets. The time delay data is associated with a transmission duration of time-synchronization messages of the sets of the plurality. The second device sets a synchronization clock based on a time at the first device and the smoothed time delay data.

Abstract: Techniques for adaptive cross-correlation are discussed. A first signal is received from a first audio sensor associated with a vehicle and a second signal is received from a second audio sensor associated with the vehicle. Techniques may include determining, based at least in part on the first signal, a first transformed signal in a frequency domain. Additionally, the techniques include determining, based at least in part on the second signal, a second transformed signal in the frequency domain. A parameter can be determined based at least in part on a characteristic associated with at least one of the vehicle, an environment proximate the vehicle, or one or more of the first or second signal. Cross-correlation data can be determined based at least in part on one or more of the first transformed signal, the second transformed signal, or the parameter.

Abstract: Techniques are disclosed for adding time data to scan lines of an image frame. In some examples, an image sensor may perform a rolling shutter image capture to produce the scan lines. Data captured by another sensor may be associated with at least a portion of a scan line based at least in part on the time data added to the scan line in some examples. Furthermore, techniques are disclosed for synchronizing data capture by multiple sensors. For example, a rolling shutter image capture performed by an image sensor may be synchronized with a data capture performed by another sensor.

Abstract: Techniques for facilitating a robust clock synchronization across a computer network that presumes network jitter exists are discussed herein. A first device and a second device transceive a plurality of sets of time-synchronization messages to synchronize a synchronization clock of the second device to a first clock of the first device. The second device calculates a smoothing of time delay data of a plurality of sets. The time delay data is associated with a transmission duration of time-synchronization messages of the sets of the plurality. The second device sets a synchronization clock based on a time at the first device and the smoothed time delay data.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. The sensor may generate first image data at a first configuration and second image data at a second configuration. A disambiguated depth of a surface may be determined from the first image data and the second image data. If the disambiguated depth is greater than a nominal maximum depth of the sensor in the first configuration, an intensity of the surface may be determined from the first image data. If the intensity meets or exceeds a threshold intensity, the surface may be determined to be beyond the nominal maximum depth. If the intensity is less than the threshold intensity, an actual depth of the surface may be determined form the second image data as a distance less than the nominal maximum depth.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can include returns associated with highly reflective objects that cause glare. In some examples, a depth of a sensed surface is determined from the sensor data and additional pixels at the same depth are identified. The subset of pixels at the depth are filtered by comparing a measured intensity value to a threshold intensity value for the depth. Other threshold intensity values can be applied to subsets of pixels at different depths.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can include noise. In some examples, the sensor data is filtered by comparing a measured intensity value to a threshold intensity value. The threshold intensity value can be determined on a per-pixel basis using depth information and/or intensity information for a corresponding image frame.

Abstract: A time delay of arrival (TDOA) between a time that a light pulse was emitted to a time that a pulse reflected off an object was received at a light sensor may be determined for saturated signals by using an edge of the saturated signal, rather than a peak of the signal, for the TDOA calculation. The edge of the saturated signal may be accurately estimated by fitting a first polynomial curve to data points of the saturated signal, defining an intermediate magnitude threshold based on the polynomial curve, fitting a second polynomial curve to data points near an intersection of the first polynomial curve and the intermediate threshold, and identifying an intersection of the second polynomial curve and the intermediate threshold as the rising edge of the saturated signal.