Abstract: Systems and methods for night vision combining sensor image types. Some implementations may include obtaining a long wave infrared image from a long wave infrared sensor; detecting an object in the long wave infrared image; identifying a region of interest associated with the object; adjusting a control parameter of a near infrared sensor based on data associated with the region of interest; obtaining a near infrared image captured using the adjusted control parameter of the near infrared sensor; and determining a classification of the object based on data of the near infrared image associated with the region of interest.

Abstract: Disclosed are devices and methods that may be used for the calibration of sensors of a vehicle. A calibration system disclosed herein includes a trigger device configured to detect a first sensing event. The calibration system further includes a plurality of sensor targets. Additionally, the calibration system includes a processor configured to reveal the plurality of sensor targets within a given region in response to the first sensing event. The calibration system may be configured to detect light from a LIDAR striking a light sensors. In response to detecting the light from the LIDAR, a plurality of lights, both visible and infrared, may be illuminated to correspond with a position and timing of the LIDAR pulse.

Abstract: A method includes obtaining multiple images captured by pixel sensors of an image sensor, analyzing, using neural network circuitry integrated in the image sensor, the multiple images for object detection, generating, for each of the multiple images using the neural network circuitry integrated in the image sensor, neural network output data related to results of the analysis of the multiple images for object detection, and transmitting, from the image sensor, the neural network output data for each of the multiple images and image data for a subset of the multiple images instead of image data of each of the multiple images.

Abstract: A image sensor includes a first integrated circuit layer including pixel sensors that are grouped based on position into pixel sensor groups, a second integrated circuit layer in electrical communication with the first integrated circuit layer, the second integrated circuit layer including image processing circuitry groups that are configured to each receive pixel information from a corresponding pixel sensor group, the image processing circuitry groups further configured to perform image processing operations on the pixel information to provide processed pixel information during operation of the image sensor, a third integrated circuit layer in electrical communication with the second integrated circuit layer, and the third integrated circuit layer including neural network circuitry groups that are configured to each receive the processed pixel information from a corresponding image processing circuitry group and perform analysis for object detection on the processed pixel information during operation of the

Abstract: A method includes determining temperature values for roadway areas ahead of a vehicle, determining lubricant state values for the roadway areas, and determining lubricant thickness values for the roadway areas. The method also includes determining a tire-road friction estimate for each of the roadway areas using the temperature values, the lubricant state values, and the lubricant thickness values, and defining a friction map that relates the tire-road friction estimates to the roadway areas. The method also includes determining a motion plan based at least in part on the friction map, and controlling the vehicle based on the motion plan.

Abstract: An object detection system includes an infrared light source and an imaging system that generates an image from a portion of the infrared spectrum characterized by full absorption of solar radiation. A control system detects an object using the image, determines a command based on a location of the object, and sends a command to one or more vehicle systems. Another object detection system includes an imaging system that generates a first image based on a visible spectrum and a second image based an infrared spectrum. A control system receives a disparity indication associated with object detection and sends a command to one or more vehicle systems to implement a disparity response based on the disparity indication. The disparity indication includes information that an object is not detected within the first image and that the object is detected within the second image.

Abstract: A machine vision system having a first camera configured to be coupled to a vehicle. The camera includes an optical stack having a color filter array with a plurality of sections. Each section includes a first white filter portion, a yellow filter portion, a magenta filter portion, and a second white filter portion.

Abstract: An imaging device can include an image sensor, a control unit coupled to the image sensor, and a light blocking element coupled to the control unit. The control unit can be configured to adjust the light blocking element in response to image information received from the image sensor. The light blocking element can be configured to regulate light received at the image sensor.

Abstract: Systems and methods for night vision combining sensor image types. Some implementations may include obtaining a long wave infrared image from a long wave infrared sensor; detecting an object in the long wave infrared image; identifying a region of interest associated with the object; adjusting a control parameter of a near infrared sensor based on data associated with the region of interest; obtaining a near infrared image captured using the adjusted control parameter of the near infrared sensor; and determining a classification of the object based on data of the near infrared image associated with the region of interest.

Abstract: A machine vision system having a first camera configured to be coupled to a vehicle, The camera includes an optical stack having a color filter array with a plurality of sections. Each section includes a first white filter portion, a yellow filter portion, a magenta filter portion, and a second white filter portion.

Abstract: An imaging device can include an image sensor, a control unit coupled to the image sensor, and a light blocking element coupled to the control unit. The control unit can be configured to adjust the light blocking element in response to image information received from the image sensor. The light blocking element can be configured to regulate light received at the image sensor.

Abstract: A method and apparatus of digital image processing that provides pixel based image correction. The method and apparatus provide a digital processing cell that includes first and second processing modules. Each processing module includes a gate array. The gate array includes a digital video processing module and a switch portion configured to couple the digital video processing module to at least one of primary and secondary video buses and to couple the digital video processing module to at least one of primary and secondary neighborhood buses. An image processing system includes a plurality of such digital processing cells and an image sensor that outputs image data. The digital processing cells process the output image data.

Abstract: An encoder includes a linear offset amplifier, a linear analog to digital converter coupled to the linear offset amplifier, a switched offset amplifier, a switched analog to digital converter coupled to the switched offset amplifier, and a video controller. The video controller is coupled to both the linear and switched analog to digital converters. The video controller is configured to set both gains and offsets of the linear and switched analog to digital converters so that the gain and offset of the linear analog to digital converter is different than the gain and offset of the switched analog to digital converter.