Abstract: The location of a user's head, for purposes such as head tracking or motion input, can be determined using a two-step process. In a first step, at least one image is captured including a representation of at least a portion of the user, with distance information also being obtained. The distance information can be used to segment the at least one image into a foreground portion, which then can be analyzed to recognize a head and shoulder signature of a user. In a second step, a contour of the foreground portion can be determined, and a center point of that contour determined. The distances from the center point to locations along the contour can be used to locate transition points associated with the head and shoulders. A center point of the portion of the contour between the transition points gives an approximation of the relative head position.