Abstract: An apparatus comprising a light projector, a sensor and a processor. The light projector may be configured to toggle a light pattern. The sensor may be configured to generate pixel data. The processor may be configured to process the pixel data arranged as video frames, extract IR images with the light pattern, IR images without the light pattern and RGB images from the video frames, generate a control signal in response to the IR images with the light pattern and the RGB images, calculate an IR interference measurement in response to the IR images without the light pattern and the RGB images and select a mode of operation for an IR channel control and an RGB channel control in response to the IR interference measurement. The control signal may be configured to adjust an exposure for the sensor.

Abstract: An apparatus comprising an interface, a light projector and a processor. The interface may be configured to receive pixel data. The light projector may be configured to generate a structured light pattern. The processor may be configured to process the pixel data arranged as video frames comprising the structured light pattern, perform computer vision operations to detect a size of a face area of the video frames, determine a scale ratio in response to the size of the face area, extract the structured light pattern from the video frames, generate a downscaled structured light image and generate a depth map in response to the downscaled structured light image and a downscaled reference image. A downscale operation may be performed in response to the scale ratio to generate the downscaled structured light image. The scale ratio may enable the generation of the downscaled structured light image with sufficient depth pixels.

Abstract: An apparatus comprising an interface, a light projector and a processor. The interface may be configured to receive pixel data. The light projector may be configured to generate a structured light pattern. The processor may be configured to process the pixel data arranged as video frames comprising the structured light pattern, perform computer vision operations to detect a size of a face area of the video frames, determine a scale ratio in response to the size of the face area, extract the structured light pattern from the video frames, generate a downscaled structured light image and generate a depth map in response to the downscaled structured light image and a downscaled reference image. A downscale operation may be performed in response to the scale ratio to generate the downscaled structured light image. The scale ratio may enable the generation of the downscaled structured light image with sufficient depth pixels.

Abstract: An apparatus comprising a light projector, a sensor and a processor. The light projector may be configured to toggle a light pattern. The sensor may be configured to generate pixel data. The processor may be configured to process the pixel data arranged as video frames, extract IR images with the light pattern, IR images without the light pattern and RGB images from the video frames, generate a control signal in response to the IR images with the light pattern and the RGB images, calculate an IR interference measurement in response to the IR images without the light pattern and the RGB images and select a mode of operation for an IR channel control and an RGB channel control in response to the IR interference measurement. The control signal may be configured to adjust an exposure for the sensor.

Abstract: A system comprising a plurality of capture devices and a calibration device. The capture devices may each comprise a warp table. The calibration device may be configured to store a plurality of configured warp tables in a warp table pool, perform a full calibration for one of the capture devices to generate the configured warp tables, initiate a quick calibration for the capture devices and apply one of the configured warp tables to the capture devices as the warp table. The calibration device may apply one of the configured warp tables to the capture devices by selecting one of the configured warp tables from the warp table pool in response to the quick calibration. If the quick calibration fails, the calibration device may generate a new configured warp table for the warp table pool in response to the full calibration and select the new configured warp table.

Abstract: A system comprising a plurality of capture devices and a calibration device. The capture devices may each comprise a warp table. The calibration device may be configured to store a plurality of configured warp tables in a warp table pool, perform a full calibration for one of the capture devices to generate the configured warp tables, initiate a quick calibration for the capture devices and apply one of the configured warp tables to the capture devices as the warp table. The calibration device may apply one of the configured warp tables to the capture devices by selecting one of the configured warp tables from the warp table pool in response to the quick calibration. If the quick calibration fails, the calibration device may generate a new configured warp table for the warp table pool in response to the full calibration and select the new configured warp table.

Abstract: An apparatus comprising an interface, a light projector and a processor. The interface may be configured to receive pixel data. The light projector may be configured to generate a structured light pattern. The processor may be configured to process the pixel data arranged as video frames comprising the structured light pattern, perform computer vision operations to detect a size of a face area of the video frames, determine a scale ratio in response to the size of the face area, extract the structured light pattern from the video frames, generate a downscaled structured light image and generate a depth map in response to the downscaled structured light image and a downscaled reference image. A downscale operation may be performed in response to the scale ratio to generate the downscaled structured light image. The scale ratio may enable the generation of the downscaled structured light image with sufficient depth pixels.

Abstract: A system comprising a plurality of capture devices and a calibration device. The capture devices may each comprise a warp table. The calibration device may be configured to store a plurality of configured warp tables in a warp table pool, perform a full calibration for one of the capture devices to generate the configured warp tables, initiate a quick calibration for the capture devices and apply one of the configured warp tables to the capture devices as the warp table. The calibration device may apply one of the configured warp tables to the capture devices by selecting one of the configured warp tables from the warp table pool in response to the quick calibration. If the quick calibration fails, the calibration device may generate a new configured warp table for the warp table pool in response to the full calibration and select the new configured warp table.