Abstract: Provided are methods for processing raw data for sensors with multiple color channels, which can include receiving raw image data associated with an image sensor, wherein the raw image data includes a plurality of groups of pixels including a first group of pixels associated with a first filter and a second group of pixels associated with a second filter. The methods may also include generating, from the raw image data, a plurality of wavelength-based data groups including a first wavelength-based data group and a second wavelength-based data group. The first wavelength-based data group may include first pixels corresponding to the first group of pixels and the second wavelength-based data group may include second pixels corresponding to the second group of pixels. The methods may also include encoding the first wavelength-based data group and the second wavelength-based data group. Systems and computer program products are also provided.

Abstract: Provided are methods for cascade camera image signal processing (ISP) tuning, which can include receiving first image data at a first time associated with a first image sensor of a camera, generating at least one tuned first ISP block parameter for at least one first ISP block based on the first image data and first tuning criterion, receiving second image data at a second time, and generating at least one tuned second ISP block parameter for at least one second ISP block based on the second image data and second tuning criterion. Some methods described also include tuning parameters of at least one ISP block of a camera after receiving tuned parameters. Some methods describe also include generating an image using ISP blocks tuned using various tuning criteria. Systems and computer program products are also provided.

Abstract: Provided are devices for camera cleaning and flare reduction for vehicles, which can include a cleaning device for cleaning a transparent window of a housing containing a camera system. The devices can include optical panels with different properties that can be moved in front of the transparent window for flare reduction. Methods are provided which can include analyzing at least one image to determine a presence of an optical flare within the at least one image, and, based on detecting the optical flare, causing at least one optical panel to be moved into a position in front of a lens of the imaging device. Computer program products are also provided.

Abstract: Aspects and implementations of the present disclosure address shortcomings of the existing technology by enabling lidar-assisted segmentation and identification of particulate matter in autonomous vehicle (AV) applications, by: obtaining, by a sensing system of the AV, a plurality of return points, each return point having one or more velocity values and one or more coordinates of a reflecting region that reflects a signal emitted by the sensing system, identifying, in view of the one or more velocity values of each of a first set of the return points of the plurality of return points, that the first set of the return points is associated with a particulate matter in an environment of the AV, and causing a driving path of the AV to be determined in view of the particulate matter.

Abstract: Aspects and implementations of the present disclosure address shortcomings of the existing technology by enabling lidar-assisted segmentation and identification of particulate matter in autonomous vehicle (AV) applications, by: obtaining, by a sensing system of the AV, a plurality of return points, each return point having one or more velocity values and one or more coordinates of a reflecting region that reflects a signal emitted by the sensing system, identifying, in view of the one or more velocity values of each of a first set of the return points of the plurality of return points, that the first set of the return points is associated with a particulate matter in an environment of the AV, and causing a driving path of the AV to be determined in view of the particulate matter.

Abstract: Simulated degraded sensor data may be generated for use in training a model. For instance, first sensor data collected by a sensor of a perception system of an autonomous vehicle may be received and converted into the simulated degraded sensor data for a particular degrading condition, such as a weather-related degrading condition. Then, the simulated degraded sensor data may be used to train a model for evaluating performance of the perception system to detect objects external to the autonomous vehicle under one or more conditions.

Abstract: Aspects of the disclosure relate to systems for cleaning a LIDAR sensor. For example, the LIDAR sensor may include a housing and internal sensor components housed within the housing. The housing may also have a sensor input surface through which light may pass. The internal sensor components may be configured to generate light of a particular wavelength. In order to clean the LIDAR sensor, a cleaning fluid may be used. The cleaning fluid may be configured to be opaque to the particular wavelength. In this regard, when the cleaning fluid is applied to the sensor input surface, the cleaning fluid absorbs light of the particular wavelength.

Abstract: A method of making measurements includes providing a sensor with at least one solid state electronic spin; irradiating the sensor with radiation from an electromagnetic radiation source that manipulates the solid state electronic spins to produce spin-dependent fluorescence, wherein the spin-dependent fluorescence decays as a function of relaxation time; providing a target material in the proximity of the sensor, wherein, thermally induced currents (Johnson noise) present in the target material alters the fluorescence decay of the solid state electronic spins as a function of relaxation time; and determining a difference in the solid state spins spin-dependent fluorescence decay in the presence and absence of the target material and correlating the difference with a property of the sensor and/or target material.

Abstract: A method of making measurements includes providing a sensor with at least one solid state electronic spin; irradiating the sensor with radiation from an electromagnetic radiation source that manipulates the solid state electronic spins to produce spin-dependent fluorescence, wherein the spin-dependent fluorescence decays as a function of relaxation time; providing a target material in the proximity of the sensor, wherein, thermally induced currents (Johnson noise) present in the target material alters the fluorescence decay of the solid state electronic spins as a function of relaxation time; and determining a difference in the solid state spins spin-dependent fluorescence decay in the presence and absence of the target material and correlating the difference with a property of the sensor and/or target material.