Abstract: A peer to peer communication system and method are provided to enable interfacing with an application running on a gaming engine for an avatar simulation or video conference. The system and method establish a real-time peer-to-peer communication link between remotely located users for transmission in real-time of audio, video, and data communications. The system and method capture incoming audio and video transmissions from input devices operable by the users while controlling one or more avatars, and transmit, in real time, synchronized audio, video, and data communications to the users over the communication link.

Abstract: A rating interface system and method are provided that allow human users to continuously rate the impact they or other human users and/or their avatars are having on themselves or others during interpersonal interactions, such as conversations or group discussions. The system and method provide time stamping of users' ratings data and audio and video data of an interaction, and correlate the ratings data with the audio and video data at selected time intervals for subsequent analysis.

Abstract: Aspects of systems and methods for evaluation of interpersonal interactions to predict real world performance are disclosed. In an example, a system includes an input device, a memory storing instructions, and a processor communicatively coupled with the input device and the memory. The processor is configured to receive ratings data corresponding to a first user from the input device indicating an assessment of the first user during an interpersonal interaction. The processor is configured to evaluate the ratings data corresponding to the first user in comparison to ratings data corresponding to a plurality of rated users. The processor is configured to output a result of the evaluated ratings data indicating a performance of the first user during the interpersonal interaction.

Abstract: Aspects of systems and methods for collaborating physical-virtual interfaces are disclosed. In an example, a method may include transmitting digital content to display in a virtual environment that includes one or more human inhabited characters, the digital content corresponding to content displayed on one or more interactive devices. The method may also include receiving first input data representing content markup of the digital content from a first user of the first interactive device. The method may also include determining an action state or an appearance state for a human inhabited character in response to the first data. The method may also include transmitting the first input data to display in the virtual environment and transmitting the human inhabited character to display in the virtual environment according to the action state or the appearance state.

Abstract: A peer to peer communication system and method are provided to enable interfacing with an application running on a gaming engine for an avatar simulation or video conference. The system and method establish a real-time peer-to-peer communication link between remotely located users for transmission in real-time of audio, video, and data communications. The system and method capture incoming audio and video transmissions from input devices operable by the users while controlling one or more avatars, and transmit, in real time, synchronized audio, video, and data communications to the users over the communication link.

Abstract: A rating interface system and method are provided that allow human users to continuously rate the impact they or other human users and/or their avatars are having on themselves or others during interpersonal interactions, such as conversations or group discussions. The system and method provide time stamping of users' ratings data and audio and video data of an interaction, and correlate the ratings data with the audio and video data at selected time intervals for subsequent analysis.

Abstract: Systems-and methods for automated control of human inhabited characters. In an example, control of human inhabited character may be achieved via a plurality of input devices, including, but not limited to, a microphone, a camera, or a hand-held controller, that can modify and trigger changes in the appearance and/or the behavioral response of a character during the live interactions with humans. In an example, a computing device may include a neural network that receives the input from the microphone and/or the camera and changes the appearance and/or the behavioral response of the character according to the input. Further, input from the hand-held controller may be used to adjust a mood of the character or, in other words, emphasize or deemphasize the changes to the appearance and/or the behavioral response of the character.

Abstract: A control system provides an interface for virtual characters, or avatars, during live avatar-human interactions. A human interactor can select facial expressions, poses, and behaviors of the virtual character using an input device mapped to menus on a display device.

Abstract: A control system provides an interface for virtual characters, or avatars, during live avatar-human interactions. A human interactor can select facial expressions, poses, and behaviors of the virtual character using an input device mapped to menus on a display device.

Abstract: A patient simulation system for healthcare training is provided. The system includes one or more interchangeable shells comprising a physical anatomical model of at least a portion of a patient's body, the shell adapted to be illuminated from behind to provide one or more dynamic images viewable on the outer surface of the shells; a support system adapted to receive the shells via a mounting system, wherein the system comprises one or more image units adapted to render the one or more dynamic images viewable on the outer surface of the shells; one or more interface devices located about the patient shells to receive input and provide output; and one or more computing units in communication with the image units and interface devices, the computing units adapted to provide an interactive simulation for healthcare training.

Abstract: A control system provides an interface for virtual characters, or avatars, during live avatar-human interactions. A human interactor can select facial expressions, poses, and behaviors of the virtual character using an input device mapped to menus on a display device.

Abstract: A patient simulation system for healthcare training is provided. The system includes one or more interchangeable shells comprising a physical anatomical model of at least a portion of a patient's body, the shell adapted to be illuminated from behind to provide one or more dynamic images viewable on the outer surface of the shells; a support system adapted to receive the shells via a mounting system, wherein the system comprises one or more image units adapted to render the one or more dynamic images viewable on the outer surface of the shells; one or more interface devices located about the patient shells to receive input and provide output; and one or more computing units in communication with the image units and interface devices, the computing units adapted to provide an interactive simulation for healthcare training.

Abstract: A patient simulation system for healthcare training is provided. The system includes one or more interchangeable shells comprising a physical anatomical model of at least a portion of a patient's body, the shell adapted to be illuminated from behind to provide one or more dynamic images viewable on the outer surface of the shells; a support system adapted to receive the shells via a mounting system, wherein the system comprises one or more image units adapted to render the one or more dynamic images viewable on the outer surface of the shells; one or more interface devices located about the patient shells to receive input and provide output; and one or more computing units in communication with the image units and interface devices, the computing units adapted to provide an interactive simulation for healthcare training.

Abstract: A system and method for controlling a humanoid robot from a remote location are provided. One or more sensing devices are used to sense positions and movements of a user at an inhabiter station. A computing device generates a virtual character based upon the sensed positions and movements of the user and provides a plurality of outputs for controlling the humanoid robot based upon motion of the virtual character. The computing device includes a master controller to generate the virtual character and its behaviors and to transmit instructions to control motion of the humanoid robot to a slave controller located at the humanoid robot, providing smooth and natural motion of the humanoid robot. The method permits switching between multiple virtual characters in a single scene to control and alter the behavior of one or more humanoid robots located in several geographic locations.

Abstract: A patient simulation system for healthcare training is provided. The system includes one or more interchangeable shells comprising a physical anatomical model of at least a portion of a patient's body, the shell adapted to be illuminated from behind to provide one or more dynamic images viewable on the outer surface of the shells; a support system adapted to receive the shells via a mounting system, wherein the system comprises one or more image units adapted to render the one or more dynamic images viewable on the outer surface of the shells; one or more interface devices located about the patient shells to receive input and provide output; and one or more computing units in communication with the image units and interface devices, the computing units adapted to provide an interactive simulation for healthcare training.

Abstract: A system is for monitoring a sterile field associated with a medical procedure. The system may include a sensor being adjacent an area where the medical procedure is to be performed. The sensor is configured to monitor at least the area, a patient for the medical procedure, and a medical technician for the medical procedure. The system may include a processor coupled to the sensor and configured to detect a sterile field event, and an associated location for the sterile field event, and an output device coupled to the processor and configured to generate an alert indicator when the sterile field event is detected, the alert indicator also including the associated location.

Abstract: A patient simulation system for healthcare training is provided. The system includes one or more interchangeable shells comprising a physical anatomical model of at least a portion of a patient's body, the shell adapted to be illuminated from behind to provide one or more dynamic images viewable on the outer surface of the shells; a support system adapted to receive the shells via a mounting system, wherein the system comprises one or more image units adapted to render the one or more dynamic images viewable on the outer surface of the shells; one or more interface devices located about the patient shells to receive input and provide output; and one or more computing units in communication with the image units and interface devices, the computing units adapted to provide an interactive simulation for healthcare training.

Abstract: A control system provides an interface for virtual characters, or avatars, during live avatar-human interactions. A human interactor can select facial expressions, poses, and behaviors of the virtual character using an input device mapped to menus on a display device.

Abstract: A low-cost, low-demand (physical and cognitive) interface for puppeteers that allows them to easily participate in the control of verbal and non-verbal activities of a set of virtual characters or avatars. The invention further provides a low-cost, unencumbered interface for participants that allows them to employ both natural movement and also verbal and non-verbal interaction with virtual characters. A network protocol supports real-time remote interaction even when dealing with relatively poor network connections; and an integrated after-action review system supports trainers in the processes of tagging and commenting on events, subsequently using these to assist reflection on the part of participants.

Abstract: A system is for monitoring a sterile field associated with a medical procedure. The system may include a sensor being adjacent an area where the medical procedure is to be performed. The sensor is configured to monitor at least the area, a patient for the medical procedure, and a medical technician for the medical procedure. The system may include a processor coupled to the sensor and configured to detect a sterile field event, and an associated location for the sterile field event, and an output device coupled to the processor and configured to generate an alert indicator when the sterile field event is detected, the alert indicator also including the associated location.