Abstract: In accordance with some embodiments, various examples of systems, methods, and media for single photon depth imaging with improved efficiency using learned compressive representations are provided. For example, systems and methods herein may detect a photon arrival based on a signal from a detector at a given position and time bin. A compressed histogram comprising K stored values, representing bins of the compressed histogram based on K values in a code word calculated based on the time bin and position and K coding tensors. Such systems and methods may be utilized for, among other uses, determining depth in a scene being imaged by the detector.

Abstract: In accordance with some embodiments, systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data are provided. In some embodiments, the system comprises: first detectors configured to detect a level of photons proportional to incident photon flux; second detectors configured to detect arrival of individual photons; a processor programmed to: receive, from the first detectors, first values indicative of photon flux from a scene with a first resolution; receive, from the second detectors, second values indicative of photon flux from the scene with a lower resolution; provide a first encoder of a trained machine learning model first flux values based on the first values, provide the second encoder of the model second flux values; receive, as output, values indicative of photon flux from the scene; and generate a high dynamic range image based on the third plurality of values.

Abstract: In accordance with some embodiments, systems, methods, and media for single photon depth imaging with improved efficiency using compressive histograms are provided. In some embodiments, the system comprises: a light source; a detector configured to detect arrival of individual photons; a processor programmed to: detect a photon arrival; determine a time bin i of the photon arrival in a range from 1 to N a total number of time bins; update a compressed histogram comprising K stored values representing bins of the compressed histogram based on K values in a code word represented by an ith column of a coding matrix C having dimension K×N, with each column different than each other column, and each column corresponds to a single time bin i; and estimate a depth value based on the K values.

Abstract: In accordance with some embodiments, systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data are provided. In some embodiments, the system comprises: first detectors configured to detect a level of photons proportional to incident photon flux; second detectors configured to detect arrival of individual photons; a processor programmed to: receive, from the first detectors, first values indicative of photon flux from a scene with a first resolution; receive, from the second detectors, second values indicative of photon flux from the scene with a lower resolution; provide a first encoder of a trained machine learning model first flux values based on the first values, provide the second encoder of the model second flux values; receive, as output, values indicative of photon flux from the scene; and generate a high dynamic range image based on the third plurality of values.

Abstract: In accordance with some embodiments, systems, methods, and media for high dynamic range imaging using single-photon and conventional image sensor data are provided. In some embodiments, the system comprises: first detectors configured to detect a level of photons proportional to incident photon flux; second detectors configured to detect arrival of individual photons; a processor programmed to: receive, from the first detectors, first values indicative of photon flux from a scene with a first resolution; receive, from the second detectors, second values indicative of photon flux from the scene with a lower resolution; provide a first encoder of a trained machine learning model first flux values based on the first values, provide the second encoder of the model second flux values; receive, as output, values indicative of photon flux from the scene; and generate a high dynamic range image based on the third plurality of values.

Abstract: A method, apparatus and device for camera calibration, and a storage medium. A camera to be calibrated for performing depth estimation on a scene is determined. A first correlation function for characterizing a correlation between a sensor modulation signal of the camera to be calibrated and a first modulated light emission signal is determined. A second correlation function for characterizing an actual correlation function produced by the camera to be calibrated is determined. A calibrated impulse response based on the first correlation function and the second correlation function is determined. The camera to be calibrated is calibrated based on the calibrated impulse response, to obtain the calibrated camera.

Abstract: In accordance with some embodiments, systems, methods and media for encoding and decoding signals used in time-of-flight imaging are provided. In some embodiments, a method for estimating the depth of a scene is provided, comprising: causing a light source to emit modulated light toward the scene based on a modulation function; causing the image sensor to generate a first value based on the modulated light and a first demodulation function of K modulation functions; causing the image sensor to generate a second value; causing the image sensor to generate a third value; and determining a depth estimate for the portion of the scene based on the first value, the second value, the third value, and three correlation functions each including at least one half of a trapezoid wave.