Abstract: A lidar system may include a programmable configuration memory, configured to receive configuration values for controlling histogramming operations performed by the lidar system. The lidar system may also include an array controller, configured or programmed or set to read the configuration values and send control signals according to the configuration values in the programmable configuration memory. The lidar system may also include a sensor array, where the sensor array includes a plurality of pixels. Each pixel in the plurality of pixels may include a photosensor, summation circuitry, and a memory device. Each of the plurality of pixels may be configured to generate histogram data by collecting photon counts during a plurality of time bins for each of a plurality of laser cycles.

Abstract: Circuits, methods, and apparatus that can reduce clock induced current and voltage transients and emissions in lidar pixel arrays. A pixel array can include an array of pixels, where at any given time, different pixels in the pixel array perform different tasks and are clocked by clock signals having different phases or delays relative to each other. This temporal dispersion of tasks and clock signals can spread clock induced current and voltage transients and emissions throughout a clock cycle, thereby reducing their maximum amplitude.

Abstract: Techniques described herein provide memory redundancy. For example, the memory block for each pixel can be partitioned into multiple memory bins, and the number of memory bins can be larger than the number of time bins. Once a faulty memory cell is identified, an address associated with the memory bin that has the faulty memory cell can be skipped by an address generator. As such, the faulty memory cell is not used to store time-of-fight (ToF) information.

Abstract: Systems and methods are provided for processing lidar data. The lidar data can be obtained in a particular manner that allows reconstruction of rectilinear images for which image processing can be applied from image to image. For instance, kernel-based image processing techniques can be used. Such processing techniques can use neighboring lidar and/or associated color pixels to adjust various values associated with the lidar signals. Such image processing of lidar and color pixels can be performed by dedicated circuitry, which may be on a same integrated circuit. Further, lidar pixels can be correlated to each other. For instance, classification techniques can identify lidar and/or associated color pixels as corresponding to the same object. The classification can be performed by an artificial intelligence (AI) coprocessor. Image processing techniques and classification techniques can be combined into a single system.

Abstract: A stereoscopic imager system, comprising: a sensor array comprising a first plurality of photosensors and a second plurality of photosensors spaced apart from the first plurality of photosensors by a gap, the first plurality of photosensors and the second plurality of photosensors being configured to detect ambient light in a scene; a moving component coupled to the sensor array and operable to move the sensor array between a first position and a second position within a full rotational image capturing cycle; and a system controller coupled to the sensor array and the moving component.

Abstract: An optical measurement system may improve the accuracy with which it estimates distances to surrounding objects by upgrading various aspects of its data path. Spatial resolution may be increased by subdividing histogram buckets or integration registers based on spatial location. Saturation at any point in the data path can be detected and used to stop counting photons in individual pixels, which can then be normalized after a measurement is over. Multiple peaks can be detected using recursive or iterative techniques to identify a largest remaining peak at each stage. Instead of iterating through the histogram memory multiple times, a threshold can be pre-calculated based on an estimated ambient noise level, and peaks can be detected in a single pass.

Abstract: Optical systems and methods for collecting distance information are disclosed. An example optical system includes a first transmitting optic, a plurality of illumination sources, a pixel array comprising at least a first column of pixels and a second column of pixels, each pixel in the first column of pixels being offset from an adjacent pixel in the first column of pixels by a first pixel pitch, the second column of pixels being horizontally offset from the first column of pixels by the first pixel pitch, the second column of pixels being vertically offset from the first column of pixels by a first vertical pitch; and a set of input channels interposed between the first transmitting optic and the pixel array.

Abstract: Systems and methods are provided for processing lidar data. The lidar data can be obtained in a particular manner that allows reconstruction of rectilinear images for which image processing can be applied from image to image. For instance, kernel-based image processing techniques can be used. Such processing techniques can use neighboring lidar and/or associated color pixels to adjust various values associated with the lidar signals. Such image processing of lidar and color pixels can be performed by dedicated circuitry, which may be on a same integrated circuit. Further, lidar pixels can be correlated to each other. For instance, classification techniques can identify lidar and/or associated color pixels as corresponding to the same object. The classification can be performed by an artificial intelligence (AI) coprocessor. Image processing techniques and classification techniques can be combined into a single system.

Abstract: An optical system for collecting distance information within a field is provided. The optical system may include lenses for collecting photons from a field and may include lenses for distributing photons to a field. The optical system may include lens tubes that collimate collected photons, optical filters that reject normally incident light outside of the operating wavelength, and pixels that detect incident photons. The optical system may further include illumination sources that output photons at an operating wavelength.

Abstract: An electronically scanning emitter array that includes a two-dimensional array of light emitters arranged in k emitter banks. Each of the k emitter banks can include a subset of the light emitters in the two-dimensional array and can be independently operable to emit light from its subset of emitters. The electronically scanning emitter array can further include first and second capacitor banks coupled to provide energy to the two-dimensional array of light emitters and emitter array driving circuitry coupled to the first and second capacitor banks and to the k emitter banks. Each of the first and second capacitor banks can include at least one capacitor.

Abstract: A coaxial lidar system includes one or more emitter channels and one or more sensor channels that share an optical module. A diffractive waveguide can be used to redirect received light from the shared optical module to the sensor channels.

Abstract: A multispectral sensor array can include a combination of ranging sensor channels (e.g., LIDAR sensor channels) and ambient-light sensor channels tuned to detect ambient light having a channel-specific property (e.g., color). The sensor channels can be arranged and spaced to provide multispectral images of a field of view in which the multispectral images from different sensors are inherently aligned with each other to define an array of multispectral image pixels. Various optical elements can be provided to facilitate imaging operations. Light ranging/imaging systems incorporating multispectral sensor arrays can operate in rotating and/or static modes.

Abstract: Methods are provided for using a light ranging system. A computing system receives, from light ranging devices, ranging data including distance vectors to environmental surfaces. A distance vector can correspond to a pixel of a three-dimensional image stream. The system can identify a pose of a virtual camera relative to the light ranging devices. The light ranging devices are separated from the pose by first vectors that are used to translate some of the distance vectors using the first vectors. The system may determine colors associated with the translated distance vectors and display pixels of the three-dimensional image stream using the colors at pixel positions specified by the translated distance vectors. The system may use one or more models with the ranging data to provide semantic labels that describe a region that has been, or is likely to be, in a collision.

Abstract: A multispectral sensor array can include a combination of ranging sensor channels (e.g., LIDAR sensor channels) and ambient-light sensor channels tuned to detect ambient light having a channel-specific property (e.g., color). The sensor channels can be arranged and spaced to provide multispectral images of a field of view in which the multispectral images from different sensors are inherently aligned with each other to define an array of multispectral image pixels. Various optical elements can be provided to facilitate imaging operations. Light ranging/imaging systems incorporating multispectral sensor arrays can operate in rotating and/or static modes.

Abstract: A multispectral sensor array can include a combination of ranging sensor channels (e.g., LIDAR sensor channels) and ambient-light sensor channels tuned to detect ambient light having a channel-specific property (e.g., color). The sensor channels can be arranged and spaced to provide multispectral images of a field of view in which the multispectral images from different sensors are inherently aligned with each other to define an array of multispectral image pixels. Various optical elements can be provided to facilitate imaging operations. Light ranging/imaging systems incorporating multispectral sensor arrays can operate in rotating and/or static modes.

Abstract: Systems and methods are provided for processing lidar data. The lidar data can be obtained in a particular manner that allows reconstruction of rectilinear images for which image processing can be applied from image to image. For instance, kernel-based image processing techniques can be used. Such processing techniques can use neighboring lidar and/or associated color pixels to adjust various values associated with the lidar signals. Such image processing of lidar and color pixels can be performed by dedicated circuitry, which may be on a same integrated circuit. Further, lidar pixels can be correlated to each other. For instance, classification techniques can identify lidar and/or associated color pixels as corresponding to the same object. The classification can be performed by an artificial intelligence (AI) coprocessor. Image processing techniques and classification techniques can be combined into a single system.

Abstract: A light ranging system including a shaft having a longitudinal axis; a light ranging device configured to rotate about the longitudinal axis of the shaft, the light ranging device including a light source configured to transmit light pulses to objects in a surrounding environment, and detector circuitry configured to detect reflected portions of the light pulses that are reflected from the objects in the surrounding environment and to compute ranging data based on the reflected portion of the light pulses; a base subsystem that does not rotate about the shaft; and an optical communications subsystem configured to provide an optical communications channel between the base subsystem and the light ranging device, the optical communications subsystem including one or more turret optical communication components connected to the detector circuitry and one or more base optical communication components connected to the base subsystem.

Abstract: Optical systems and methods for collecting distance information are disclosed. An example optical system includes a first transmitting optic, a plurality of illumination sources, a pixel array comprising at least a first column of pixels and a second column of pixels, each pixel in the first column of pixels being offset from an adjacent pixel in the first column of pixels by a first pixel pitch, the second column of pixels being horizontally offset from the first column of pixels by the first pixel pitch, the second column of pixels being vertically offset from the first column of pixels by a first vertical pitch; and a set of input channels interposed between the first transmitting optic and the pixel array.

Abstract: Methods are provided for using a light ranging system of a vehicle. A computing system receives, from light ranging devices, ranging data including distance vectors to environmental surfaces. A distance vector can correspond to a pixel of a three-dimensional image stream. The system can identify a pose of a virtual camera relative to the light ranging devices. The light ranging devices are separated from the pose by first vectors that are used to translate some of the distance vectors using the first vectors. The system may determine colors associated with the translated distance vectors and display pixels of the three-dimensional image stream using the colors at pixel positions specified by the translated distance vectors. The system may use one or more vehicle models with the ranging data to provide semantic labels that describe a region that has been, or is likely to be, in a collision.

Abstract: An optical system for performing distance measurements comprising: a bulk transmitter optic having a focal plane; an illumination source comprising a plurality of light emitters aligned to project discrete beams of light through the bulk transmitter optic into a field ahead of the optical system; and a micro-optic channel array disposed between the illumination source and the bulk transmitter optic, the micro-optic channel array defining a plurality of micro-optic channels, each micro-optic channel including a micro-optic lens spaced apart from a light emitter in the plurality of light emitters with the micro-optic lens positioned to receive a light cone from the light emitter and configured to generate a reduced-size spot image of the emitter at a location that is displaced from the emitter and that coincides with the focal plane of the bulk transmitter optic