Abstract: In some implementations, invisible light is emitted toward a subject being imaged in a low-light environment. A camera having a first color image sensor captures an image of the subject. Image processing is used to correct distortion in the image caused by the invisible light, and an augmented color image is output.

Abstract: Direct and absolute pointing is provided for with respect to a two-dimensional information display surface, much like how one would point a laser pointer or flashlight at a desired point. The displayed control may be moved by manipulating the pointing device in three dimensions. The translational position of the pointing device may be measured in three dimensions. Also, the three-dimensional orientation of the pointing device may be measured. A computing device may receive this information from the pointing device and determine where the pointing device is pointing to. If the pointing device is pointing at a display, then the computing device may cause the control to be displayed at the position to which the pointing device is pointing. In addition, the control may be displayed at an orientation that depends upon the orientation of the pointing device.

Abstract: A security-enhanced login technique that provides a convenient and easy-to-use two factor technique to enhance the security of passwords without requiring any changes on the server side of a client-server network. The technique employs a convenient and easy-to-use two-factor technique to generate strong passwords for Web and other applications. In this technique, a convenient or personal device such as a mouse is used as the other factor besides a user password. A secret stored in the mouse or other personal device is hashed together with the password entered by a user and the server ID, to generate a strong, server-specific password which is used to authenticate the user to the server. This password enhancement operation is carried out inside the personal device.

Abstract: A multimodal system that employs a plurality of sensing modalities which can be processed concurrently to increase confidence in connection with authentication. The multimodal system and/or set of various devices can provide several points of information entry in connection with authentication. Authentication can be improved, for example, by combining face recognition, biometrics, speech recognition, handwriting recognition, gait recognition, retina scan, thumb/hand prints, or subsets thereof. Additionally, portable multimodal devices (e.g., a smartphone) can be used as credit cards, and authentication in connection with such use can mitigate unauthorized transactions.

Abstract: Architecture that combines capture and translation of concepts, goals, needs, locations, objects, locations, and items (e.g., sign text) into complete conversational utterances that take a translation of the item, and morph it with fluidity into sets of sentences that can be echoed to a user, and that the user can select to communicate speech (or textual utterances). A plurality of modalities that process images, audio, video, searches and cultural context, for example, which are representative of at least context and/or content, and can be employed to glean additional information regarding a communications exchange to facilitate more accurate and efficient translation. Gesture recognition can be utilized to enhance input recognition, urgency, and/or emotional interaction, for example. Speech can be used for document annotation. Moreover, translation (e.g., speech to speech, text to speech, speech to text, handwriting to speech, text or audio, . . .

Abstract: An input/output device is disclosed that includes an input-sensitive display screen and alphanumeric keys for entering characters. The input-sensitive display screen may be positioned proximate the alphanumeric keys and be capable of displaying graphical information and sensing user selection of the graphical information. The input-sensitive display screen may include a combination display/input region and a non-display input region. The touch sensitive display screen may be detachable from the alphanumeric region and may be operable in a detached configuration. The input/output device may usable with a method of input correction. The method may include displaying, on a secondary display, a first text unit, such as a character or a word, which corresponds with a second text unit shown on a primary display screen of a computing device. The method further involves receiving user selection of the first text unit and replacing the first text unit with a second text unit.

Abstract: Direct and absolute pointing is provided for with respect to a two-dimensional information display surface, much like how one would point a laser pointer or flashlight at a desired point. The displayed control may be moved by manipulating the pointing device in three dimensions. The translational position of the pointing device may be measured in three dimensions. Also, the three-dimensional orientation of the pointing device may be measured. A computing device may receive this information from the pointing device and determine where the pointing device is pointing to. If the pointing device is pointing at a display, then the computing device may cause the control to be displayed at the position to which the pointing device is pointing. In addition, the control may be displayed at an orientation that depends upon the orientation of the pointing device.

Abstract: An input/output device is disclosed that includes an input-sensitive display screen and alphanumeric keys for entering characters. The input-sensitive display screen may be positioned proximate the alphanumeric keys and be capable of displaying graphical information and sensing user selection of the graphical information. The input-sensitive display screen may include a combination display/input region and a non-display input region. The touch sensitive display screen may be detachable from the alphanumeric region and may be operable in a detached configuration. The input/output device may usable with a method of input correction. The method may include displaying, on a secondary display, a first text unit, such as a character or a word, which corresponds with a second text unit shown on a primary display screen of a computing device. The method further involves receiving user selection of the first text unit and replacing the first text unit with a second text unit.

Abstract: Direct and absolute pointing is provided for with respect to a two-dimensional information display surface, much like how one would point a laser pointer or flashlight at a desired point. The displayed control may be moved by manipulating the pointing device in three dimensions. The translational position of the pointing device may be measured in three dimensions. Also, the three-dimensional orientation of the pointing device may be measured. A computing device may receive this information from the pointing device and determine where the pointing device is pointing to. If the pointing device is pointing at a display, then the computing device may cause the control to be displayed at the position to which the pointing device is pointing. In addition, the control may be displayed at an orientation that depends upon the orientation of the pointing device.

Abstract: Optical tracking systems, method, and devices are described in which optical components detect light within a substantially planar region adjacent to a user device. Tracking logic may receive signals output by the optical components and determine coordinates associated with a movement of a pointing object through the substantially planar region. The tracking logic may then provide for translation of the coordinates into an action on a display, such as, for example, a movement of a cursor or other icon on the display.

Abstract: A multi-modal multi-lingual mobile device that facilitates intelligently automating an action. The device can automatically synchronize a user schedule based upon a user state, intention, preference and/or limitation. The device can employ sensors to automatically detect criteria by which to automatically implement an action. Moreover, the system can interrogate a user thus converging upon a user intention and/or preference. An analyzer component can intelligently evaluate the compiled criterion in order to automatically perform an action. The multi-modal multi-lingual mobile device can automatically facilitate identification of an individual. Other actions that are automatically performed can include modifying personal information manager data, translating languages into a language comprehendible to a user, etc. Implementation of these actions can be based at least in part upon an environmental factor, a conversation, a location factor and a temporal factor.

Abstract: In some implementations, invisible light is emitted toward a subject being imaged in a low-light environment. A camera having a first color image sensor captures an image of the subject. Image processing is used to correct distortion in the image caused by the invisible light, and an augmented color image is output.

Abstract: A method and system for visually tracking a point of contact of an optical output from a computer input device includes an internal camera configured to visually track the point of contact of the optical output against a surface and an optical source to transmit the optical output from the computer input device. The camera also transmits the position of the point of contact as a computer input. In one form, the computer applies the position of the point of contact as an input to an application operating on the computer, such as a gaming application. In one form, the camera can visually track the movement of the computer input device along a surface.

Abstract: Portable computing devices automatically interface with other computing devices to interact in a collaborative effort toward providing a single, seamless computing experience for a user. As a user walks into a room with a cellular telephone certain functionality and data can be automatically unloaded to a desktop computer or other device based on a user or device identification or state. For example, a conversation on a cellular telephone can be automatically migrated to a desktop telephone as a user sits down. As a user is about to leave a room for a meeting, the desktop computer can update the telephone with latest versions of certain files. Thus, devices can automatically aggregate and/or decouple to provide a user with a single computing experience. These portable devices can broadcast an extensible set of services to other devices as well as to a host computer or server.

Abstract: A system and process for helping users enter information in an Asian language is described. In some aspects, pinyin input for Chinese is described with respect to dedicated keys of a keyboard.

Abstract: A method, system, and device for adding modular tags, that can be associated with particular configurations, that can be attached to and/or read by a computer peripheral device and/or computer is described. A modular tag reader in a computer peripheral device and/or computer recognizes a modular tag and its associated software configuration, thereby directly initiating user intended actions without the user interacting with the software interfaces. A user can attach modular tags that are intuitively recognizable as performing a particular function, such as a color change, font size change, font style change, highlight operation, and application program initiation. Such modular tags are interpreted by a processor within the host computer and/or within the computer peripheral device to change a configuration in accordance with the tag.

Abstract: A security-enhanced login technique that provides a convenient and easy-to-use two factor technique to enhance the security of passwords without requiring any changes on the server side of a client-server network. The technique employs a convenient and easy-to-use two-factor technique to generate strong passwords for Web and other applications. In this technique, a convenient or personal device such as a mouse is used as the other factor besides a user password. A secret stored in the mouse or other personal device is hashed together with the password entered by a user and the server ID, to generate a strong, server-specific password which is used to authenticate the user to the server. This password enhancement operation is carried out inside the personal device.

Abstract: Optical tracking systems, method, and devices are described in which optical components detect light within a substantially planar region adjacent to a user device. Tracking logic may receive signals output by the optical components and determine coordinates associated with a movement of a pointing object through the substantially planar region. The tracking logic may then provide for translation of the coordinates into an action on a display, such as, for example, a movement of a cursor or other icon on the display.

Abstract: Described is a technology by which personal information that comes into a computer system is intelligently managed according to current state data including user presence and/or user attention data. Incoming information is processed against the state data to determine whether corresponding data is to be output, and if so, what output modality or modalities to use. For example, if a user is present and busy, a notification may be blocked or deferred to avoid disturbing the user. Cost analysis may be used to determine the cost of outputting the data. In addition to user state data, the importance of the information, other state data, the cost of converting data to another format for output (e.g., text-to-speech), and/or user preference data, may factor into the decision. The output data may be modified (e.g., audio made louder) based on a current output environment as determined via the state data.

Abstract: An input device encodes motion using a laser self-mixing velocimeter. The laser beam is directed at a disk or other moving member. As light from that beam is reflected back into the emitting cavity of the laser, the beam power output fluctuates because of the self-mixing effect and generates a beat signal. The beat signal frequency is used to determine the speed of the member's motion. The direction of motion is also determined based on the beat signal. A difference frequency analog phase locked loop filters the beat signal. A zero-point control disables motion detection when the average beat signal amplitude falls below a threshold. A triangle modulator generates a triangle wave for the laser bias current, with the triangle wave frequency being a submultiple of the beat signal frequency.