Abstract: This application discloses active movement based and other video games which may be played over the internet as well in the home or elsewhere. One or two or more persons can play, generally using one or more cameras to determine the relation of an object or a part of a person to a video display on which game related graphics are displayed. Determination of object position and orientation in up to 6 degrees of freedom is disclosed, at data rates sufficient to make game play rewarding.

Abstract: A method for determining a gesture illuminated by a light source utilizes the light source to provide illumination through a work volume above the light source. A camera is positioned to observe and determine the gesture performed in the work volume.

Abstract: Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: The invention provides a method for providing human input to a computer which allows a user to interact with a display connected to the computer. The method includes the steps of placing a first target on a first portion of the user's body, using an electro-optical sensing means, sensing data related to the location of the first target and data related to the location of a second portion of the user's body, the first and second portions of the user's body being movable relative to each other, providing an output of the electro-optical sensing means to the input of the computer, determining the location of the first target and the location of the second portion of the user's body, and varying the output of the computer to the display based upon the determined locations for contemporaneous viewing by the user.

Abstract: Methods and apparatus for interactively and dynamically undertaking exercise are disclosed which utilize camera means to provide 2D or 3D data relating to locations or movements of exercise undertaken by a person. This data is analyzed by a computer and in a typical example an instructor's image is displayed and both visual and audio assistance to the person is provided via a computer program either resident locally or remotely located. Applications to exercise involving treadmills, bicycles, dance, weight lifting and other exercises are disclosed.

Abstract: A method for enhancing a well-being of a small child or baby utilizes at least one TV camera positioned to observe one or more points on the child or an object associated with the child. Signals from the TV camera are outputted to a computer, which analyzes the output signals to determine a position or movement of the child or child associated object. The determined position or movement is then compared to preprogrammed criteria in the computer to determine a correlation or importance, and thereby to provide data to the child.

Abstract: Method and apparatus are disclosed to enable rapid TV camera and computer based sensing in many practical applications, including, but not limited to, handheld devices, cars, and video games. Several unique forms of social video games are disclosed.

Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: Method and apparatus are disclosed to enable rapid TV camera and computer based sensing in many practical applications, including, but not limited to, handheld devices, cars, and video games. Several unique forms of social video games are disclosed.

Abstract: Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

Abstract: Disclosed are new methods and apparatus particularly suited for applications in a vehicle, to provide a wide range of information, and the safe input of data to a computer controlling the vehicle subsystems or “Telematic” communication using for example GM's “ONSTAR” or cellular based data sources. Preferred embodiments utilize new programmable forms of tactile touch screens and displays employing tactile physical selection or adjustment means which utilize direct optical data input. A revolutionary form of dashboard or instrument panel results which is stylistically attractive, lower in cost, customizable by the user, programmable in both the tactile and visual sense, and with the potential of enhancing interior safety and vehicle operation. Non-automotive applications of the invention are also disclosed, for example means for general computer input using touch screens and home automation systems.

Abstract: Disclosed are new methods and apparatus particularly suited for applications in a vehicle, to provide a wide range of information, and the safe input of data to a computer controlling the vehicle subsystems or “Telematic” communication using for example GM's “ONSTAR” or cellular based data sources. Preferred embodiments utilize new programmable forms of tactile touch screens and displays employing tactile physical selection or adjustment means which utilize direct optical data input. A revolutionary form of dashboard or instrument panel results which is stylistically attractive, lower in cost, customizable by the user, programmable in both the tactile and visual sense, and with the potential of enhancing interior safety and vehicle operation. Non-automotive applications of the invention are also disclosed, for example means for general computer input using touch screens and home automation systems.

Abstract: A method for enhancing a well-being of a small child or baby utilizes at least one TV camera positioned to observe one or more points on the child or an object associated with the child. Signals from the TV camera are outputted to a computer, which analyzes the output signals to determine a position or movement of the child or child associated object. The determined position or movement is then compared to preprogrammed criteria in the computer to determine a correlation or importance, and thereby to provide data to the child.

Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: The invention provides a method for providing human input to a computer which allows a user to interact with a display connected to the computer. The method includes the steps of placing a first target on a first portion of the user's body, using an electro-optical sensing means, sensing data related to the location of the first target and data related to the location of a second portion of the user's body, the first and second portions of the user's body being movable relative to each other, providing an output of the electro-optical sensing means to the input of the computer, determining the location of the first target and the location of the second portion of the user's body, and varying the output of the computer to the display based upon the determined locations for contemporaneous viewing by the user.

Abstract: This application discloses active movement based and other video games which may be played over the internet as well in the home or elsewhere. One or two or more persons can play, generally using one or more cameras to determine the relation of an object or a part of a person to a video display on which game related graphics are displayed. Determination of object position and orientation in up to 6 degrees of freedom is disclosed, at data rates sufficient to make game play rewarding.

Abstract: Disclosed herein are new forms of computer inputs particularly using TV cameras, and providing affordable methods and apparatus for unique game play, such as rear projection devices for pinball and common board games using machine vision to determine the location of objects and/or features of objects. Particular embodiments employing fast and reliable acquisition and tracking of game related objects and their motion are disclosed, together with numerous applications. Also disclosed are related embodiments for instrumentation and control systems, such as those used in homes and cars.

Abstract: Disclosed are new methods and apparatus particularly suited for applications in a vehicle, to provide a wide range of information, and the safe input of data to a computer controlling the vehicle subsystems or “Telematic” communication using for example GM's “ONSTAR” or cellular based data sources. Preferred embodiments utilize new programmable forms of tactile touch screens and displays employing tactile physical selection or adjustment means which utilize direct optical data input. A revolutionary form of dashboard or instrument panel results which is stylistically attractive, lower in cost, customizable by the user, programmable in both the tactile and visual sense, and with the potential of enhancing interior safety and vehicle operation. Non-automotive applications of the invention are also disclosed, for example means for general computer input using touch screens and home automation systems.

Abstract: The invention provides a method for providing human input to a computer which allows a user to interact with a display connected to the computer. The method includes the steps of placing a first target on a first portion of the user's body, using an electro-optical sensing means, sensing data related to the location of the first target and data related to the location of a second portion of the user's body, the first and second portions of the user's body being movable relative to each other, providing an output of the electro-optical sensing means to the input of the computer, determining the location of the first target and the location of the second portion of the user's body, and varying the output of the computer to the display based upon the determined locations for contemporaneous viewing by the user.