Abstract: A depth camera system uses a structured light illuminator and multiple sensors such as infrared light detectors, such as in a system which tracks the Motion of a user in a field of view. One sensor can be optimized for shorter range detection while another sensor is optimized for longer range detection. The sensors can have a different baseline distance from the illuminator, as well as a different spatial resolution, exposure time and sensitivity. In one approach, depth values are obtained from each sensor by matching to the structured light pattern, and the depth values are merged to obtain a final depth map which is provided as an input to an application. The merging can involve unweighted averaging, weighted averaging, accuracy measures and/or confidence measures. In another approach, additional depth values which are included in the merging are obtained using stereoscopic matching among pixel data of the sensors.

Abstract: Techniques are provided for de-aliasing depth images. The depth image may have been generated based on phase differences between a transmitted and received modulated light beam. A method may include accessing a depth image that has a depth value for a plurality of locations in the depth image. Each location has one or more neighbor locations. Potential depth values are determined for each of the plurality of locations based on the depth value in the depth image for the location and potential aliasing in the depth image. A cost function is determined based on differences between the potential depth values of each location and its neighboring locations. Determining the cost function includes assigning a higher cost for greater differences in potential depth values between neighboring locations. The cost function is substantially minimized to select one of the potential depth values for each of the locations.

Abstract: A depth camera and an optional visual camera are used in conjunction with a computing device and projector to display a presentation and automatically correct the geometry of the projected presentation. Interaction with the presentation (switching slides, pointing, etc.) is achieved by utilizing gesture recognition/human tracking based on the output of the depth camera and (optionally) the visual camera. Additionally, the output of the depth camera and/or visual camera can be used to detect occlusions between the projector and the screen (or other target area) in order to adjust the presentation to not project on the occlusion and, optionally, reorganize the presentation to avoid the occlusion.

Abstract: Compatibility between a depth image consumer and a depth image producer is provided by receiving a native depth image having an unsupported type that is not supported by a depth image consumer, and processing the native depth image into an emulation depth image having a supported type that is supported by the depth image consumer. This emulation depth image is then output to the depth image consumer.

Abstract: Compatibility between a depth image consumer and a plurality of different depth image producers is provided by receiving a native depth image having unsupported depth camera parameters that are not compatible with a depth image consumer, and converting the native depth image to a virtual depth image having supported virtual depth camera parameters that are compatible with the depth image consumer. This virtual depth image is then output to the depth image consumer.