Abstract: The invention provides a method and apparatus for use as a control device for controlling a computing system. The method includes a hybrid sensing system comprised of computer-vision-based pattern recognition and electronic signal transmission. The control device is embedded with a designated color light pattern and an electronic signal transmitter. The color light pattern within the field of sight of a video image capturing device is detected and identified by a computing system. Methods for configuring the color light pattern are included. The control device can be handheld or attached to a human body. The movement of the color light pattern in the 3-dimensional space will provide 3-dimensional positional information of a virtual pointer to the computing system. The activation of the electronic signal transmitter by pressing a control button on the control device will trigger input commands to the computing system.

Abstract: A video image based tracking method and apparatus for identifying and tracking encoded color surface. Encoded color patterns are integrated with tangible objects such as tangible toys or tangible input objects so that they can be used as a tangible input device for a computing system to control virtual multimedia objects and trigger game interactions. The color pattern within the field of sight of a video image capturing device is identified and tracked and by a computing system. Method to configure the color pattern is included. A great number of encoded patterns can be created. Method to identify the encoded color pattern is included. Method to estimate the 6-DOF (degree-of-freedoms) orientation and coordinates information of the tangible object with encoded color pattern is included. Multiple encoded color patterns can be identified and tracked simultaneously.