Abstract: A contact-based inductive sensing technique for contextual interactions on interactive fabrics is described. The technique recognizes conductive objects (mainly metallic) that are commonly found in households and workplaces, such as keys, coins, and electronic devices. An apparatus includes an array of a plurality of six by six spiral-shaped coils including conductive thread, sewn onto a four-layer fabric structure. The coil shape parameters were determined based on maximizing the sensitivity based on a new inductance approximation formula. Through a ten-participant study, the performance of sensing technique across 27 common objects was evaluated. A 93.9% real-time accuracy for object recognition resulted.

Abstract: The present disclosure relates to a system for eyes-free text entry. The system may include a wearable device having a display and processing circuitry configured to receive a haptic input provided to a keyboard mounted on a finger of a user, the haptic input being an indication of an alphabetical letter, generate a list of candidate words based on the received haptic input, each candidate t word of the list of candidate words being associated with a probability thereof, display the generated list of candidate words to the user via the display of the wearable device, receive a selection of a particular candidate word of the list of candidate words, and append the particular candidate to a present sentence structure, wherein the keyboard has a layout based on a spatial model reflecting spatial awareness, by the user, of key locations on the finger.

Abstract: A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface, identifies an action associated with the surface representation and gesture, and executes the action. Instrumenting the finger instead of the surface, allows a user to configure virtually any surface to accept touch input.

Abstract: The present disclosure relates to a system for eyes-free text entry. The system may include a wearable device having a display and processing circuitry configured to receive a haptic input provided to a keyboard mounted on a finger of a user, the haptic input being an indication of an alphabetical letter, generate a list of candidate words based on the received haptic input, each candidate word of the list of candidate words being associated with a probability thereof, display the generated list of candidate words to the user via the display of the wearable device, receive a selection of a particular candidate word of the list of candidate words, and append the particular candidate to a present sentence structure, wherein the keyboard has a layout based on a spatial model reflecting spatial awareness, by the user, of key locations on the finger.

Abstract: Aspects of the disclosure provide a sensing apparatus including a sensing device, a memory, and processing circuitry. The sensing device includes resonators having respective resonant frequencies. The resonators include an array of inductive coils positioned on a surface of the apparatus. The sensing device can output a signal indicating changes of the resonant frequencies caused by presence of an object proximate to the surface. The memory stores reference signals corresponding to reference objects. Each reference signal indicates changes of the resonant frequencies caused by the respective reference object proximate to the surface. The processing circuitry can receive, from the sensing device, a particular signal indicating changes of the resonant frequencies caused by presence of a particular object proximate to the surface. The processing circuitry compares the particular signal with the stored reference signals of the reference objects to determine an identity of the particular object.

Abstract: A disclosed circuit prototyping system includes a hardware interface module configured for electronically connecting to a physical electronic device, a virtual circuit design interface to construct a virtual circuit for a plurality of virtual circuit devices including a virtual counterpart of the physical electronic device, and a circuit simulator configured to simulate the virtual circuit including communicating data with the physical electronic device by way of communication with the hardware interface module.

Abstract: A wearable device for detecting eating episodes uses a contact microphone to provide audio signals through an analog front end to an analog-to-digital converter to digitize the audio and provide digitized audio to a processor; and a processor configured with firmware in a memory to extract features from the digitized audio. A classifier determines eating episodes from the extracted features. In embodiments, messages describing the detected eating episodes are transmitted to a cell phone, insulin pump, or camera configured to record video of the wearer's mouth.

Abstract: A disclosed circuit prototyping system includes a hardware interface module configured for electronically connecting to a physical electronic device, a virtual circuit design interface to construct a virtual circuit for a plurality of virtual circuit devices including a virtual counterpart of the physical electronic device, and a circuit simulator configured to simulate the virtual circuit including communicating data with the physical electronic device by way of communication with the hardware interface module.

Abstract: A self-powered module for gesture recognition is presented that utilizes small, low-cost photodiodes for both energy harvesting and gesture sensing. Operating in the photovoltaic mode, photodiodes harvest energy from ambient light. In the meantime, the instantaneously harvested power from individual photodiodes is monitored and exploited as a clue for sensing finger gestures in proximity. Harvested power from all photodiodes is aggregated to drive the whole gesture-recognition module including a micro-controller running the recognition algorithm. A robust, lightweight algorithm is provided to recognize finger gestures in the presence of ambient light fluctuations. Two prototypes are fabricated to facilitate user's interaction with smart glasses and smart watches.

Abstract: Systems and methods for providing graphical user interface elements optimized for touch-based input in connection with an application that is designed for conventional input received from a keyboard and a mouse. The touch-based graphical user interface elements are displayed when the computer system detects that a user is about to switch from conventional input devices to touch-sensitive input devices. The touch-based graphical user interface elements are hidden when the user provides input with the conventional input devices such that the touch-based graphical user interface elements do not distract from the applications normal operation. The display device includes a sensing capability that enables the computer system to detect when an object, such as a user's finger or a stylus, is proximate to, but not in contact with, the display device.

Abstract: A self-powered module for gesture recognition is presented that utilizes small, low-cost photodiodes for both energy harvesting and gesture sensing. Operating in the photovoltaic mode, photodiodes harvest energy from ambient light. In the meantime, the instantaneously harvested power from individual photodiodes is monitored and exploited as a clue for sensing finger gestures in proximity. Harvested power from all photodiodes is aggregated to drive the whole gesture-recognition module including a micro-controller running the recognition algorithm. A robust, lightweight algorithm is provided to recognize finger gestures in the presence of ambient light fluctuations. Two prototypes are fabricated to facilitate user's interaction with smart glasses and smart watches.

Abstract: Aspects of the disclosure provide a sensing apparatus including a sensing device, a memory, and processing circuitry. The sensing device includes resonators having respective resonant frequencies. The resonators include an array of inductive coils positioned on a surface of the apparatus. The sensing device can output a signal indicating changes of the resonant frequencies caused by presence of an object proximate to the surface. The memory stores reference signals corresponding to reference objects. Each reference signal indicates changes of the resonant frequencies caused by the respective reference object proximate to the surface. The processing circuitry can receive, from the sensing device, a particular signal indicating changes of the resonant frequencies caused by presence of a particular object proximate to the surface. The processing circuitry compares the particular signal with the stored reference signals of the reference objects to determine an identity of the particular object.

Abstract: An infrared (IR)-based gesture sensing and detection system that includes at least one IR sensor for sensing micro gestures of one or more heat-radiating bodies made within a gesture-sensing region located proximate to the IR sensor. Each unique micro gesture may be used as a control gesture for controlling one or more controllable devices. Non-limiting examples of controllable devices include smart wearable device, handheld computing devices, and smart appliances, among many others. In some embodiments, each IR sensor is a passive IR sensor based on a pyroelectric material, and the IR-based gesture sensing and detection system is configured to consume minimal power to operate.

Abstract: An infrared (IR)-based gesture sensing and detection system that includes at least one IR sensor for sensing micro gestures of one or more heat-radiating bodies made within a gesture-sensing region located proximate to the IR sensor. Each unique micro gesture may be used as a control gesture for controlling one or more controllable devices. Non-limiting examples of controllable devices include smart wearable device, handheld computing devices, and smart appliances, among many others. In some embodiments, each IR sensor is a passive IR sensor based on a pyroelectric material, and the IR-based gesture sensing and detection system is configured to consume minimal power to operate.

Abstract: A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface, identifies an action associated with the surface representation and gesture, and executes the action. Instrumenting the finger instead of the surface, allows a user to configure virtually any surface to accept touch input.

Abstract: A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface, identifies an action associated with the surface representation and gesture, and executes the action. Instrumenting the finger instead of the surface, allows a user to configure virtually any surface to accept touch input.

Abstract: A finger device initiates actions on a computer system when placed in contact with a surface. The finger device includes instrumentation that captures images and gestures. When in contact with a surface, the finger device captures images of the surface and gestures made on the surface. The finger device also transmits the images and gesture data to the computer system. An application on the computer system matches the images received from the finger device to a representation of the surface, identifies an action associated with the surface representation and gesture, and executes the action. Instrumenting the finger instead of the surface, allows a user to configure virtually any surface to accept touch input.

Abstract: Systems and methods for providing graphical user interface elements optimized for touch-based input in connection with an application that is designed for conventional input received from a keyboard and a mouse. The touch-based graphical user interface elements are displayed when the computer system detects that a user is about to switch from conventional input devices to touch-sensitive input devices. The touch-based graphical user interface elements are hidden when the user provides input with the conventional input devices such that the touch-based graphical user interface elements do not distract from the applications normal operation. The display device includes a sensing capability that enables the computer system to detect when an object, such as a user's finger or a stylus, is proximate to, but not in contact with, the display device.

Abstract: The peripheral input and output device embeds a touch-screen display onto a mouse. Users interact with the display of the mouse using direct touch, whilst also performing regular cursor-based mouse interactions. The resulting device has many unique capabilities, in particular for interacting with auxiliary windows, such as toolbars, palettes, pop-ups and dialog-boxes. By migrating these windows onto a peripheral computer mouse challenges such as screen real-estate use and window management can be alleviated.