Abstract: A method for obtaining gestural input from a user of a computer system. In this method, an image of the user is acquired, and a runtime representation of a geometric model of the user is computed based on the image. The runtime representation is compared against stored data, which includes a plurality of stored metrics each corresponding to a measurement made on an actor performing a gesture. With each stored metric is associated a stored representation of a geometric model of the actor performing the associated gesture. The method returns gestural input based on the stored metric associated with a stored representation that matches the runtime representation.

Abstract: Techniques are provided for re-orienting a field of view of a depth camera having one or more sensors. The depth camera may have one or more sensors for generating a depth image and may also have an RGB camera. In some embodiments, the field of view is re-oriented based on the depth image. The position of the sensor(s) may be altered to change the field of view automatically based on an analysis of objects in the depth image. The re-orientation process may be repeated until a desired orientation of the sensor is determined. Input from the RGB camera might be used to validate a final orientation of the depth camera, but is not required to during the process of determining new possible orientation of the field of view.

Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may also be removed to isolate one or more voxels associated with a foreground object such as a human target. A location or position of one or more extremities of the isolated human target may be determined and a model may be adjusted based on the location or position of the one or more extremities.