Abstract: The present invention includes provides secure, instant, and anonymous connections between two devices. The invention pairs a “cap” device with a capacitive touchscreen to a “cam” device with a camera sensor. For example, typical smartphones and tablets can be paired with each other, and these devices can be paired to even larger touchscreens, such as smart whiteboards and touchscreen monitors. The invention uses the cap device's touchscreen to detect and track the cam device, and displays color-modulated pairing data directly underneath the camera once the camera is touching the screen. The pairing data is used as configuration data for a bidirectional link, such as an ad-hoc WiFi or Bluetooth link. These links are established without requiring user configuration. As such, the present invention provides a unidirectional communication mechanism from the touchscreen to the camera, which is used to bootstrap a full bidirectional, high-speed link.

Abstract: An apparatus classifies touch events. The apparatus includes a touch sensitive surface configured to generate a touch event when an object touches the touch sensitive surface. The touch event entails a mechanical vibration upon contact with the surface. The apparatus includes a touch event detector configured to detect the onset of a touch, and a touch event classifier configured to classify the touch event to identify the object used for the touch event. The mechanical vibration is created via any one of finger parts including a tip, a pad, a fingernail, and a knuckle, each of which has a unique feature different from each other.

Abstract: Touch tracking systems and methods are described, which employ depth image information and infrared image information to robustly and accurately detect finger touches on surfaces within the touch tracking system's field of view, with accuracy exceeding the noise level of the depth image sensor. The disclosed embodiments require no prior calibration to the surface, and are capable of adapting to changes in the sensing environment. Various described embodiments facilitate providing reliable, low-cost touch tracking system for surfaces without requiring modification or instrumentation of the surface itself.

Abstract: The present invention includes provides secure, instant, and anonymous connections between two devices. The invention pairs a “cap” device with a capacitive touchscreen to a “cam” device with a camera sensor. For example, typical smartphones and tablets can be paired with each other, and these devices can be paired to even larger touchscreens, such as smart whiteboards and touchscreen monitors. The invention uses the cap device's touchscreen to detect and track the cam device, and displays color-modulated pairing data directly underneath the camera once the camera is touching the screen. The pairing data is used as configuration data for a bidirectional link, such as an ad-hoc WiFi or Bluetooth link. These links are established without requiring user configuration. As such, the present invention provides a unidirectional communication mechanism from the touchscreen to the camera, which is used to bootstrap a full bidirectional, high-speed link.

Abstract: The present invention relates generally to a system and method that bring together the advantages of computer games and the physical world to increase engagement, collaboration and learning. The system and method can be used with a myriad of physical setups and can be used for many different content areas in education. In one embodiment, a mixed reality interaction is facilitated with an EarthShake™ game presented on a display. The game is synchronized with a tangible interface comprising a physical object and a sensor capable of detecting a change in the condition of the physical object. The system and method help kids discover scientific and other learning principles while experimenting with real objects in a physical environment supported with audio and visual feedback. Students interactively make predictions, see results, grapple with disconfirming evidence and formulate explanations in forms of general principles.

Abstract: According to embodiments of the present invention are a system and method that use projected structured patterns of light and linear optical sensors for motion tracking. Sensors are capable of recovering two-dimensional location within the projection area, while several sensors can be combined for up to six degrees of freedom tracking. The structure patterns are based on m-sequences, in which any consecutive subsequence of m bits is unique. Both digital and static light sources can be used. The system and method of the present invention enables high-speed, high precision, and low-cost motion tracking for a wide range of applications.

Abstract: An electronic device includes a touch-sensitive surface, for example a touch pad or touch screen. The user interacts with the touch-sensitive surface, producing touch interactions. Some of these touch interactions may be detected as indicative of a grasp for manipulating a physical tool (e.g., the grasp for holding a pen). When these touch interactions are encountered, a corresponding virtual tool is instantiated. The virtual tool controls an action on the electronic device that is similar to an action that can be performed by the physical tool. For example, the virtual pen can be used to draw on the display, whereas the physical pen draws on paper. A representation of the virtual tool is also displayed on a display for the electronic device, possibly providing additional affordances, at a location that corresponds to a location of the detected touch interaction.

Abstract: An apparatus classifies touch events. The apparatus includes a touch sensitive surface configured to generate a touch event when an object touches the touch sensitive surface. The touch event entails a mechanical vibration upon contact with the surface. The apparatus includes a touch event detector configured to detect the onset of a touch, and a touch event classifier configured to classify the touch event to identify the object used for the touch event. The mechanical vibration is created via any one of finger parts including a tip, a pad, a fingernail, and a knuckle, each of which has a unique feature different from each other.

Abstract: An apparatus classifies touch events. The apparatus includes a touch sensitive surface configured to generate a touch event when an object touches the touch sensitive surface. The touch event entails a mechanical vibration upon contact with the surface. The apparatus includes a touch event detector configured to detect the onset of a touch, and a touch event classifier configured to classify the touch event to identify the object used for the touch event. The mechanical vibration is created via any one of finger parts including a tip, a pad, a fingernail, and a knuckle, each of which has a unique feature different from each other.

Abstract: An apparatus classifies touch events. The apparatus includes a touch sensitive surface configured to generate a touch event when an object touches the touch sensitive surface. The touch event entails a mechanical vibration upon contact with the surface. The apparatus includes a touch event detector configured to detect the onset of a touch, and a touch event classifier configured to classify the touch event to identify the object used for the touch event. The mechanical vibration is created via any one of finger parts including a tip, a pad, a fingernail, and a knuckle, each of which has a unique feature different from each other.

Abstract: An apparatus classifies touch events. The apparatus includes a touch sensitive surface configured to generate a touch event when an object touches the touch sensitive surface. The touch event entails a mechanical vibration upon contact with the surface. The apparatus includes a touch event detector configured to detect the onset of a touch, and a touch event classifier configured to classify the touch event to identify the object used for the touch event. The mechanical vibration is created via any one of finger parts including a tip, a pad, a fingernail, and a knuckle, each of which has a unique feature different from each other.

Abstract: According to embodiments of the present invention are a system and method that use projected structured patterns of light and linear optical sensors for motion tracking. Sensors are capable of recovering two-dimensional location within the projection area, while several sensors can be combined for up to six degrees of freedom tracking. The structure patterns are based on m-sequences, in which any consecutive subsequence of m bits is unique. Both digital and static light sources can be used. The system and method of the present invention enables high-speed, high precision, and low-cost motion tracking for a wide range of applications.

Abstract: The present invention relates generally to a system and method that bring together the advantages of computer games and the physical world to increase engagement, collaboration and learning. The system and method can be used with a myriad of physical setups and can be used for many different content areas in education. In one embodiment, a mixed reality interaction is facilitated with an EarthShake™ game presented on a display. The game is synchronized with a tangible interface comprising a physical object and a sensor capable of detecting a change in the condition of the physical object. The system and method help kids discover scientific and other learning principles while experimenting with real objects in a physical environment supported with audio and visual feedback. Students interactively make predictions, see results, grapple with disconfirming evidence and formulate explanations in forms of general principles.

Abstract: An electronic device includes a touch-sensitive surface, for example a touch pad or touch screen. The user interacts with the touch-sensitive surface, producing touch interactions. Some of these touch interactions may be detected as indicative of a grasp for manipulating a physical tool (e.g., the grasp for holding a pen). When these touch interactions are encountered, a corresponding virtual tool is instantiated. The virtual tool controls an action on the electronic device that is similar to an action that can be performed by the physical tool. For example, the virtual pen can be used to draw on the display, whereas the physical pen draws on paper. A representation of the virtual tool is also displayed on a display for the electronic device, possibly providing additional affordances, at a location that corresponds to a location of the detected touch interaction.

Abstract: An apparatus classifies touch events. The apparatus includes a touch sensitive surface configured to generate a touch event when an object touches the touch sensitive surface. The touch event entails a mechanical vibration upon contact with the surface. The apparatus includes a touch event detector configured to detect the onset of a touch, and a touch event classifier configured to classify the touch event to identify the object used for the touch event. The mechanical vibration is created via any one of finger parts including a tip, a pad, a fingernail, and a knuckle, each of which has a unique feature different from each other.