Abstract: Disclosed are novel method and apparatus for monitoring and aiding persons in vehicles and at home, especially senior citizens and others whose capabilities may be diminished. Electro-optical sensing of both person's body portions and physical controls is utilized, following from both disclosure on my RTD (Reconfigurable Tactile Display) invention as well as other gesture and motion based inventions in regard to sensing of control inputs from physical control (e.g. knobs, switches) positions and persons gestures. Applications to vehicles and the home are disclosed as well as applications to areas such as operating rooms and other locations in the hospital where sterility is paramount. A unique self-sterilizing control panel is also disclosed.

Abstract: Disclosed are new methods and apparatus particularly suited for applications in a vehicle, to provide a wide range of information, and the safe input of data to a computer controlling the vehicle subsystems or “Telematic” communication using for example GM's “ONSTAR” or cellular based data sources. Preferred embodiments utilize new programmable forms of tactile touch screens and displays employing tactile physical selection or adjustment means which utilize direct optical data input. A revolutionary form of dashboard or instrument panel results which is stylistically attractive, lower in cost, customizable by the user, programmable in both the tactile and visual sense, and with the potential of enhancing interior safety and vehicle operation. Non-automotive applications of the invention are also disclosed, for example means for general computer input using touch screens and home automation systems.

Abstract: The invention concerns a system by which intelligent land vehicle, transportation and highway data can be usefully presented to, and acted on by, a driver of a vehicle, providing a bridge between the vehicles of today, and the automated vehicles of tomorrow. Preferred embodiments utilize displayed sensor based imagery the driver interacts with by touch, gesture or other methods in order to confirm or reject alert signals provided by sensors and to confirm or understand the operation of sensory systems of the vehicle. The driver may designate data displayed for further processing by onboard computers, for example to track certain conditions. An advantageous result is that sensing systems can be set to a higher level of sensitivity and control and a data bank can be built up of sensed data and human responses which can be used over time to improve performance and safety of the vehicle.

Abstract: Disclosed are methods and apparatus, which enable the reconfigurable control of vehicles, homes, computers and other applications. Physical controls and virtual displayed controls on single and multipoint touch screens are used, separately or in combination to enable higher visibility and understanding of control information and easier operation of controls, particularly useful in stressful situations. Some embodiments use optical sensors and rear projection of displayed embodiments, and are advantageous where curved screens are desired such as in a car.

Abstract: The invention concerns new computer aided methods and apparatus for designing objects, particularly 3D objects, and especially those having a sculpted form such as found in automobiles, boats, planes, furniture and certain fashion apparel items. Preferred embodiments employ optical sensing, of the designers' hands, fingers, or styling implements, as well as other sensors such as gyros accelerometers and the like as desired. The invention utilizes a specialized form of 3-D printing which produces data incorporating intermediate models for use in the design process. The invention we feel can enable a much larger segment of the population to design 3D objects as well as encourage a high degree of collaboration via the internet or other means.

Abstract: Disclosed are novel method and apparatus for monitoring and aiding persons in vehicles and at home, especially senior citizens and others whose capabilities may be diminished. Electro-optical sensing of both person's body portions and physical controls is utilized, following from both disclosure on my RTD (Reconfigurable Tactile Display) invention as well as other gesture and motion based inventions in regard to sensing of control inputs from physical control (e.g. knobs, switches) positions and persons gestures. Applications to vehicles and the home are disclosed as well as applications to areas such as operating rooms and other locations in the hospital where sterility is paramount. A unique self-sterilizing control panel is also disclosed.

Abstract: Persons recovering from injuries or surgeries today generally undertake physical therapy to regain usage of their muscles, joints and other portions of their body. Unfortunately such treatments often do not fully restore the patient's function, at least within constraints of the funds available. Added costs are also incurred by patients for transportation, time off work and the like. Disclosed are systems and methods to provide greatly improved and much more cost effective physical therapy regimens utilizing an interactive approach which makes possible physical therapy at home in a controlled manner. The physical therapist using the system instructs the patient and this instruction is incorporated into an intelligent camera-based system usable by the patient in the home or workplace. Dialog may take place between the patient and therapist using the system and the internet. Other features of the system increase motivation of the patient to perform the exercises prescribed.

Abstract: The disclosed invention primarily relates to methods for assisting and motivating persons with respect to various exercise and rehabilitation regimens they might undertake, mentally as well as physically. The invention also has potential application to for diagnosis and/or treatment of certain mental and physical disorders, and in other situations where a form of companionship may be provided the user. In addition the invention herein provides an enjoyable means of social interaction with others providing further motivation for physical and mental activity represented.

Abstract: Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

Abstract: A method for enhancing a well-being of a small child or baby utilizes at least one TV camera positioned to observe one or more points on the child or an object associated with the child. Signals from the TV camera are outputted to a computer, which analyzes the output signals to determine a position or movement of the child or child associated object. The determined position or movement is then compared to preprogrammed criteria in the computer to determine a correlation or importance, and thereby to provide data to the child.

Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: A method for enhancing a well-being of a small child or baby utilizes at least one TV camera positioned to observe one or more points on the child or an object associated with the child. Signals from the TV camera are outputted to a computer, which analyzes the output signals to determine a position or movement of the child or child associated object. The determined position or movement is then compared to preprogrammed criteria in the computer to determine a correlation or importance, and thereby to provide data to the child.

Abstract: New methods and apparatus are provided for efficiently and safely providing controls and displays therefore, particularly, but necessarily to be used within the center stack region of a vehicle instrument panel. The apparatus utilizes, in most embodiments, a rear projection display and machine vision sensing of control position and, optionally, finger touch. A very stylistic and easy to use instrument panel results which can be programmed or otherwise provided in many different forms to suit different users or option package designs.

Abstract: Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

Abstract: Disclosed are methods and apparatus for instructing persons using computer based programs and/or remote instructors. One or more video cameras obtain images of the student or other participant. In addition images are analyzed by a computer to determine the locations or motions of one or more points on the student. This location data is fed to computer program which compares the motions to known desired movements, or alternatively provides such movement data to an instructor, typically located remotely, who can aid in analyzing student performance. The invention preferably is used with a substantially life-size display, such as a projection display can provide, in order to make the information displayed a realistic partner or instructor for the student. In addition, other applications are disclosed to sports training, dance, and remote dating.

Abstract: A method and apparatus for interactive TV camera based games in which position or orientation of points on a player or of an object held by a player are determined and used to control a video display. Both single camera and stereo camera pair based embodiments are disclosed, preferably using stereo photogrammetry where multi-degree of freedom information is desired. Large video displays, preferably life-size may be used where utmost realism of the game experience is desired.

Abstract: Disclosed are new methods and apparatus particularly suited for applications in a vehicle, to provide a wide range of information, and the safe input of data to a computer controlling the vehicle subsystems or “Telematic” communication using for example GM's “ONSTAR” or cellular based data sources. Preferred embodiments utilize new programmable forms of tactile touch screens and displays employing tactile physical selection or adjustment means which utilize direct optical data input. A revolutionary form of dashboard or instrument panel results which is stylistically attractive, lower in cost, customizable by the user, programmable in both the tactile and visual sense, and with the potential of enhancing interior safety and vehicle operation. Non-automotive applications of the invention are also disclosed, for example means for general computer input using touch screens and home automation systems.

Abstract: Methods for controlling computers using touch input devices such as touch screens and touch pads are disclosed. These methods include several tactile features that allow reliable operation even in situations where the user has trouble seeing the display of an associated device, and are particularly valuable in stress situations such as encountered in vehicles or using certain mobile devices. Several novel methods of displaying and sensing information in these situations are also disclosed, as are many examples of apparatus useful in vehicles and the home.