Abstract: Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system can be included within unobtrusive headwear that performs eye tracking and controls screen display. The system can also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices.

Abstract: Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system can be included within unobtrusive headwear that performs eye tracking and controls screen display. The system can also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices.

Abstract: Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system can be included within unobtrusive headwear that performs eye tracking and controls screen display. The system can also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices.

Abstract: Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system can be included within unobtrusive headwear that performs eye tracking and controls screen display. The system can also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices.

Abstract: Apparatus, systems, and methods are provided for substantially continuous biometric identification (CBID) of an individual using eye signals in real time. The apparatus is included within a wearable computing device with identification of the device wearer based on iris recognition within one or more cameras directed at one or both eyes, and/or other physiological, anatomical and/or behavioral measures. Verification of device user identity can be used to enable or disable the display of secure information. Identity verification can also be included within information that is transmitted from the device in order to determine appropriate security measures by remote processing units. The apparatus may be incorporated within wearable computing that performs other functions including vision correction, head-mounted display, viewing the surrounding environment using scene camera(s), recording audio data via a microphone, and/or other sensing equipment.

Abstract: Apparatus, systems, and methods are provided for secure mobile communications (SMC) by an individual using biometric signals and identification in real time. The apparatus includes a wearable computing device where identification of the user is based on iris recognition, and/or other physiological and anatomical measures. Biometric identity measures can be combined with other security-based information such as passwords, date/time stamps, and device identification. Identity verification can be embedded within information that is transmitted from the device and/or to determine appropriate security measures. SMC addresses security issues associated with the transmission of eye-signal control and biometric identification data using secure interfaces with network devices within a system of systems (SoS) software architecture.

Abstract: Systems are presented herein, which may be implemented in a wearable device. The system is designed to allow a user to edit media images captured with the wearable device. The system employs eye tracking data to control various editing functions, whether prior to the time of capture, during the time of capture, or after the time of capture. Also presented are methods for determining which sections or regions of media images may be of greater interest to a user or viewer. The method employs eye tracking data to assign saliency to captured media. In both the system and the method, eye tracking data may be combined with data from additional sensors in order to enhance operation.

Abstract: Devices and methods are provided for eye-tracking, e.g., including a freeform optical assembly and/or a modular design. In an exemplary embodiment, a device and method are provided that includes a wearable device on a user's head, the wearable device including a scene camera oriented to capture images of the user's surroundings. The user may perform a predetermined action with the user's eye to activate a photo feature of the wearable device, gaze at a region within the user's surroundings, the wearable device determining a focal point and limited field-of-view for the camera imaging field based on the center point, and activate the camera to capture an image of the limited field-of-view centered around the focal point.

Abstract: Paper-based playback of media can be performed by electronically recording handwritten notes including pen strokes using a digital pen on a position-coded paper. A plurality of bounding areas is identified, e.g. by generating bounding areas around the pen strokes as they are developed. Each bounding box is provided with a time stamp which indexes a media file, which was recorded simultaneously with the handwritten notes. By placing the digital pen close to a handwritten note on the paper, the part of the media that was recorded when the specific note was written can be recalled. More specifically, the bounding box corresponding to the position of the digital pen is identified and the associated time stamp is used to find the media to recall. This paper-based playback of media can be performed in e.g. a stand-alone device or by a combination of a digital pen and a mobile phone.

Abstract: An interactive apparatus is disclosed. The interactive apparatus has an audio recording mode and an audio playback mode. Further, the interactive apparatus includes a writing tool for manually writing on an encoded writing medium, an audio input device for recording audio, an audio output device for playing the recorded audio. Moreover, the interactive apparatus has an optical unit for determining position on the encoded writing medium of the writing tool and for recognizing information on the encoded writing medium, wherein recognition of a recording-enabling graphical element on the encoded writing medium activates the audio recording mode and enables time-synchronization of creation of writing on the encoded writing medium with the writing tool and recording of the audio, and further wherein recognition of a playback-enabling graphical element on the encoded writing medium activates the audio playback mode and enables multiple techniques to control playback of the recorded audio.

Abstract: A method for audibly instructing a user to interact with a function. A function is associated with a user-written selectable item. The user-written selectable item is recognized on a surface. In response to recognizing the user-written selectable item, a first instructional message related to the operation of the function is audibly rendered without requiring further interaction from the user.

Abstract: A method and system for implementing a user interface for a device through user created graphical elements. The method includes recognizing a graphical element icon created by a user. Once recognized, a function related to the graphical element icon is accessed and an output in accordance with the function is provided. The function is persistently associated with the graphical element icon. Menu selection and navigation is implemented through interaction with the graphic element icon. A listing of options associated with the graphical element icon is audibly rendered. In response to a selection of one of the options, the selected option is invoked.

Abstract: A device user interface in which computer functionality is invoked by user interaction with dynamically generated interface regions of a writing surface. A computer system identifies a marking written on the writing surface or a user selection of an existing written marking. Adjacent to the marking, the computer system automatically generates one or more interface regions associated with the marking. User interaction with one of these regions automatically invokes computer functionality related to the interacted region. A different function may be invoked by each region. The computer system dynamically positions and may dynamically size the interface regions based on the position (and size) of the marking. Multiple markings yield multiple regions, with different regions associated with respective markings. In one embodiment, the regions are established in front of and/or after a written word. Regions may also be established on top of and/or below the written word, for example.

Abstract: A method, a user interface, and an educational content server for assisting a user in learning using interactive learning appliances are disclosed. The performance information of the user, which may be in the form of a user log file in an interactive learning appliance, may be received at a server computer from a site where the user is present. The performance information and profile information can then be presented in the user interface and used to generate an electronic content package. The electronic content package can then be received and loaded into the interactive learning appliance.

Abstract: A method for audibly instructing a user to interact with a function. A function is associated with a user-written selectable item. The user-written selectable item is recognized on a surface. In response to recognizing the user-written selectable item, a first instructional message related to the operation of the function is audibly rendered without requiring further interaction from the user.

Abstract: A method and system for implementing a user interface for a device through user created graphical elements. The method includes recognizing a graphical element icon created by a user. Once recognized, a function related to the graphical element icon is accessed and an output in accordance with the function is provided. The function is persistently associated with the graphical element icon. Menu selection and navigation is implemented through interaction with the graphic element icon. A listing of options associated with the graphical element icon is audibly rendered. In response to a selection of one of the options, the selected option is invoked.

Abstract: Paper-based playback of media can be performed by electronically recording handwritten notes including pen strokes using a digital pen on a position-coded paper. A plurality of bounding areas is identified, e.g. by generating bounding areas around the pen strokes as they are developed. Each bounding box is provided with a time stamp which indexes a media file, which was recorded simultaneously with the handwritten notes. By placing the digital pen close to a handwritten note on the paper, the part of the media that was recorded when the specific note was written can be recalled. More specifically, the bounding box corresponding to the position of the digital pen is identified and the associated time stamp is used to find the media to recall. This paper-based playback of media can be performed in e.g. a stand-alone device or by a combination of a digital pen and a mobile phone.

Abstract: The present invention relates to a novel interactive information system which can be used to make a traditional print medium such as a magazine, “interactive”. When the traditional print medium is placed on a print media receiving unit in a predetermined position, a user can interact with the traditional print medium. Printed matter elements on the printed medium can be made “selectable” by the user.

Abstract: The present invention relates to a novel interactive information system which can be used to make a traditional print medium such as a magazine, “interactive”. When the traditional print medium is placed on a print media receiving unit in a predetermined position, a user can interact with the traditional print medium. Printed matter elements on the printed medium can be made “selectable” by the user.

Abstract: An interactive apparatus is disclosed. The interactive apparatus has an audio recording mode and an audio playback mode. Further, the interactive apparatus includes a writing tool for manually writing on an encoded writing medium, an audio input device for recording audio, an audio output device for playing the recorded audio. Moreover, the interactive apparatus has an optical unit for determining position on the encoded writing medium of the writing tool and for recognizing information on the encoded writing medium, wherein recognition of a recording-enabling graphical element on the encoded writing medium activates the audio recording mode and enables time-synchronization of creation of writing on the encoded writing medium with the writing tool and recording of the audio, and further wherein recognition of a playback-enabling graphical element on the encoded writing medium activates the audio playback mode and enables multiple techniques to control playback of the recorded audio.