Abstract: A system for providing interaction between a virtual human and a user, the system comprising: a tangible interface providing a physical interface between the user and the virtual human, an imaging system directed towards the physical interface to provide images of the user interacting with the tangible interface; a tracking system tracking at least one position or the user; a microphone capturing speech from the user; a simulation system receiving inputs from the tangible interface, the imaging system, the tracking system and the microphone, the simulation system generating output signals corresponding to the virtual human; and a display presenting the output signals to the user.

Abstract: A system for providing interaction between a virtual human and a user, the system comprising: a tangible interface providing a physical interface between the user and the virtual human, an imaging system directed towards the physical interface to provide images of the user interacting with the tangible interface; a tracking system tracking at least one position or the user; a microphone capturing speech from the user; a simulation system receiving inputs from the tangible interface, the imaging system, the tracking system and the microphone, the simulation system generating output signals corresponding to the virtual human; and a display presenting the output signals to the user.

Abstract: A system for providing interaction between a virtual human and a user, the system comprising: a tangible interface providing a physical interface between the user and the virtual human, an imaging system directed towards the physical interface to provide images of the user interacting with the tangible interface; a tracking system tracking at least one position or the user; a microphone capturing speech from the user; a simulation system receiving inputs from the tangible interface, the imaging system, the tracking system and the microphone, the simulation system generating output signals corresponding to the virtual human; and a display presenting the output signals to the user.

Abstract: A method of providing real-time feedback of task performance includes receiving sensor data from sensors coupled to an object. The sensor data is received in response to tasks performed on the object and references positional data with respect to a location on the object at which tasks are performed. The method also includes applying the sensor data to a model of performance measurements, which reflect a standard of performance. The method further includes identifying any deviations of the sensor data from data in the model, and outputting feedback in real-time. The feedback includes indicators signaling tasks performed are correctly implemented and indicators signaling tasks performed are incorrectly implemented. Corrective indicators include measures for modifying task performance to achieve an outcome that approaches or meets the standard of performance. The indicators correspond to one or more locations on the object as determined by the positional data.

Abstract: A method of providing real-time feedback of task performance includes receiving sensor data from sensors coupled to an object. The sensor data is received in response to tasks performed on the object and references positional data with respect to a location on the object at which tasks are performed. The method also includes applying the sensor data to a model of performance measurements, which reflect a standard of performance. The method further includes identifying any deviations of the sensor data from data in the model, and outputting feedback in real-time. The feedback includes indicators signaling tasks performed are correctly implemented and indicators signaling tasks performed are incorrectly implemented. Corrective indicators include measures for modifying task performance to achieve an outcome that approaches or meets the standard of performance. The indicators correspond to one or more locations on the object as determined by the positional data.

Abstract: A system for providing interaction between a virtual human and a user, the system comprising: a tangible interface providing a physical interface between the user and the virtual human, an imaging system directed towards the physical interface to provide images of the user interacting with the tangible interface; a tracking system tracking at least one position or the user; a microphone capturing speech from the user; a simulation system receiving inputs from the tangible interface, the imaging system, the tracking system and the microphone, the simulation system generating output signals corresponding to the virtual human; and a display presenting the output signals to the user.