Abstract: A method for determining the position of a controller device, comprises: receiving dimensions of the display input by a user of the computer-based system; capturing successive images of the display at the controller device; determining a position of the controller device relative to the display based on the dimensions of the display and a perspective distortion of the display in the captured successive images of the display; providing the determined position of the controller to the computer-based system to interface with the interactive program to cause an action by the interactive program.

Abstract: Methods and systems for interfacing a controller device with an interactive program executing at a computer are presented. A controller includes a camera for capturing images of a display. The position of the controller is determined based on the perspective distortion, size, location and orientation of the display in the captured images. The controller may additionally include an IR projector and an IR camera. The IR projector generates an IR beam, which creates a projection on a surface. The IR camera captures IR images of the projection. The distance of the controller from the surface and its relative orientation are determined based on analysis of the IR images.