Abstract: An NUI system to provide user input to a computer system. The NUI system includes a logic machine and an instruction-storage machine. The instruction-storage machine holds instructions that, when executed by the logic machine, cause the logic machine to detect an engagement gesture from a human subject or to compute an engagement metric reflecting the degree of the subject's engagement. The instructions also cause the logic machine to direct gesture-based user input from the subject to the computer system as soon as the engagement gesture is detected or the engagement metric exceeds a threshold.

Abstract: Sensing devices including pliable e-textile pressure sensors are used in gloves intended to be worn against a user's hand, or a portion of a user's hand. Additional sensors, such as accelerometer(s), gyroscope(s) and geo-referencing sensor(s), may be incorporated in electronic devices that interface electronically with the pressure sensors and are mounted on or in proximity to a glove when in use. Systems and methods for storing, communicating, processing, analyzing and displaying data collected by sensor components for remote monitoring of conditions at hand surfaces, position and orientation data, movement data, and the like, are also disclosed. Sensors and sensor systems provide substantially real-time feedback relating to current body conditions, orientation and movement, and may provide notifications or alerts to users, coaches, etc., enabling early intervention when conditions indicate intervention is appropriate.

Abstract: An NUI system to provide user input to a computer system. The NUI system includes a logic machine and an instruction-storage machine. The instruction-storage machine holds instructions that, when executed by the logic machine, cause the logic machine to detect an engagement gesture from a human subject or to compute an engagement metric reflecting the degree of the subject's engagement. The instructions also cause the logic machine to direct gesture-based user input from the subject to the computer system as soon as the engagement gesture is detected or the engagement metric exceeds a threshold.

Abstract: A method of modeling a human subject includes receiving from a depth camera a depth map of a scene including the human subject. The human subject is modeled with a virtual skeleton including a plurality of virtual joints. Each virtual joint is defined with a three-dimensional position. Furthermore, each of the plurality of virtual joints is further defined with three orthonormal vectors. The three orthonormal vectors for each virtual joint provide an orientation of that virtual joint at the three-dimensional position defined for that virtual joint.