Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: Disclosed are methods and apparatus, which enable the reconfigurable control of vehicles, homes, computers and other applications. Physical controls and virtual displayed controls on single and multipoint touch screens are used, separately or in combination to enable higher visibility and understanding of control information and easier operation of controls, particularly useful in stressful situations. Some embodiments use optical sensors and rear projection of displayed embodiments, and are advantageous where curved screens are desired such as in a car.

Abstract: The disclosed invention concerns novel methods and apparatus for controlling computer systems using both touch screens and physical controls, and is useful in many applications such as vehicles, homes and the like. Physical controls and virtual displayed controls on single and multipoint touch screens are used, separately or in combination to enable higher visibility and understanding of control information and easier operation of controls, particularly useful in stressful situations.

Abstract: The invention provides a method for providing human input to a computer which allows a user to interact with a display connected to the computer. The method includes the steps of placing a first target on a first portion of the user's body, using an electro-optical sensing means, sensing data related to the location of the first target and data related to the location of a second portion of the user's body, the first and second portions of the user's body being movable relative to each other, providing an output of the electro-optical sensing means to the input of the computer, determining the location of the first target and the location of the second portion of the user's body, and varying the output of the computer to the display based upon the determined locations for contemporaneous viewing by the user.

Abstract: The invention provides a method for providing human input to a computer which allows a user to interact with a display connected to the computer. The method includes the steps of placing a first target on a first portion of the user's body, using an electro-optical sensing means, sensing data related to the location of the first target and data related to the location of a second portion of the user's body, the first and second portions of the user's body being movable relative to each other, providing an output of the electro-optical sensing means to the input of the computer, determining the location of the first target and the location of the second portion of the user's body, and varying the output of the computer to the display based upon the determined locations for contemporaneous viewing by the user.

Abstract: The invention provides a method for providing human input to a computer which allows a user to interact with a display connected to the computer. The method includes the steps of placing a first target on a first portion of the user's body, using an electro-optical sensing means, sensing data related to the location of the first target and data related to the location of a second portion of the user's body, the first and second portions of the user's body being movable relative to each other, providing an output of the electro-optical sensing means to the input of the computer, determining the location of the first target and the location of the second portion of the user's body, and varying the output of the computer to the display based upon the determined locations for contemporaneous viewing by the user.

Abstract: The disclosed invention concerns novel methods and apparatus for controlling computer systems using both touch screens and physical controls, and is useful in many applications such as vehicles, homes and the like. Physical controls and virtual displayed controls on single and multipoint touch screens are used, separately or in combination to enable higher visibility and understanding of control information and easier operation of controls, particularly useful in stressful situations.

Abstract: The disclosed invention concerns novel methods and apparatus for controlling computer systems using both touch screens and physical controls, and is useful in many applications such as vehicles, homes and the like. Physical controls and virtual displayed controls on single and multipoint touch screens are used, separately or in combination to enable higher visibility and understanding of control information and easier operation of controls, particularly useful in stressful situations.

Abstract: Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: Method and apparatus are disclosed to enable rapid TV camera and computer based sensing in many practical applications, including, but not limited to, handheld devices, cars, and video games. Several unique forms of social video games are disclosed.

Abstract: Method and apparatus is disclosed to enhance the quality and usefulness of picture taking and other image acquisition for pleasure or business purposes. In a preferred embodiment, stereo photogrammetry is combined with digital image acquisition to acquire or store scenes and poses of interest, and/or to interact with the subject in order to provide data to or from a computer. This data may be utilized to maximize the effectiveness of photographic sessions, particularly digital still photography or cine-photography. A further embodiment discloses associated displays and teaching apparatus.

Abstract: This case concerns applications of my Reconfigurable Tactile Display (RTD) invention, particularly illustrating method and apparatus in which there is no rigid connection between a projector/electro-optical sensor unit, and a screen and control surface unit used to display data and receive user touch or control inputs. In many embodiments, elimination of this rigid connection constraint allows applications where heretofore it has been difficult to provide workable or useful human interface systems. One example is in the headrest of an automobile, while another is a hospital bed where the invention provides a lightweight and very easy to clean input and viewing device for the patient.

Abstract: New methods and apparatus are provided for efficiently and safely providing controls and displays therefore, particularly, but necessarily to be used within the center stack region of a vehicle instrument panel. The apparatus utilizes, in most embodiments, a rear projection display and machine vision sensing of control position and, optionally, finger touch. A very stylistic and easy to use instrument panel results which can be programmed or otherwise provided in many different forms to suit different users or option package designs.

Abstract: The invention herein primarily concerns computer interfaces, particularly those that may be used by those persons who are not familiar and even adverse to computers as they are utilized today. It is particularly concerned with easy to use devices to facilitate the use by senior citizens, widows, and others to use email, computerized banking, and telehealth services. Preferred embodiments utilize TV cameras to sense information pasted to, entered on or pointed to on a page which operation may be done in the home, a vehicle, at work or the like. In a vehicle the invention offers a low cost and convenient method for passengers wearing seat belts to interact with rear sear located displays for entertainment, navigation and telematics.

Abstract: Methods and apparatus for interactively and dynamically undertaking exercise are disclosed which utilize camera means to provide 2D or 3D data relating to locations or movements of exercise undertaken by a person. This data is analyzed by a computer and in a typical example an instructor's image is displayed and both visual and audio assistance to the person is provided via a computer program either resident locally or remotely located. Applications to exercise involving treadmills, bicycles, dance, weight lifting and other exercises are disclosed.

Abstract: Disclosed are methods and apparatus, which enable the reconfigurable control of vehicles, homes, computers and other applications. Physical controls and virtual displayed controls on single and multipoint touch screens are used, separately or in combination to enable higher visibility and understanding of control information and easier operation of controls, particularly useful in stressful situations. Some embodiments use optical sensors and rear projection of displayed embodiments, and are advantageous where curved screens are desired such as in a car.

Abstract: Method and apparatus are disclosed to enable rapid TV camera and computer based sensing in many practical applications, including, but not limited to, handheld devices, cars, and video games. Several unique forms of social video games are disclosed.

Abstract: A method and apparatus are provided for controlling at least one function of a motor vehicle utilizing a member such as a touch pad or touch screen for receiving inputs of the driver thereof, which member is generally located on the dashboard of the vehicle and may be plastic and curvilinear and may contain actuation devices such as knobs, sliders and switches. A computer analyzes data inputted by the driver and an active tactile feedback signal may be provided to the touch member to signal the driver.

Abstract: Disclosed are methods and apparatus for motivating persons to undertake exercise, employing camera based computer monitoring of persons and/or exercise apparatus, and displays of video data, which may be derived from such monitored information.