Abstract: A computing device has an input configured to receive data captured by at least one capture device where the data depicts at least part of an object moving in an environment. The computing device has a tracker configured to track a real-world position and orientation of the object using the captured data. A processor at the computing device is configured to compute and output feedback about performance of the tracker, where the feedback encourages a user to adjust movement of the object for improved tracking of the object by the tracker.

Abstract: A computing device has an input configured to receive data captured by at least one capture device where the data depicts at least part of an object moving in an environment. The computing device has a tracker configured to track a real-world position and orientation of the object using the captured data. A processor at the computing device is configured to compute and output feedback about performance of the tracker, where the feedback encourages a user to adjust movement of the object for improved tracking of the object by the tracker.

Abstract: A user interface comprises a display controller configured to render graphical data on a display, and a memory configured to receive captured sensor data depicting at least one hand of a user operating the user interface without touching the user interface. A tracker is configured to compute, from the captured sensor data, values of pose parameters of a three dimensional model of the hand, the pose parameters comprising position and orientation of each of a plurality of joints of the hand. A processor is configured to compute at least one position on the display from the pose parameters and to update the graphical data on the basis of the position.

Abstract: Apparatus is described which has a memory configured to receive captured sensor data depicting at least one hand of a user operating the control system. The apparatus has a tracker configured to compute, from the captured sensor data, values of pose parameters of a three dimensional (3D) model of the hand, the pose parameters comprising position and orientation of each of a plurality of joints of the hand A physics engine stores data about at least one virtual entity. The physics engine is configured to compute an interaction between the virtual entity and the 3D model of the hand based at least on the values of the pose parameters and data about the 3D model of the hand A feedback engine is configured to trigger feedback to the user about the computed interaction, the feedback being any one or more of visual feedback, auditory feedback, haptic feedback.