Abstract: A multimodal system that employs a plurality of sensing modalities which can be processed concurrently to increase confidence in connection with authentication. The multimodal system and/or set of various devices can provide several points of information entry in connection with authentication. Authentication can be improved, for example, by combining face recognition, biometrics, speech recognition, handwriting recognition, gait recognition, retina scan, thumb/hand prints, or subsets thereof. Additionally, portable multimodal devices (e.g., a smartphone) can be used as credit cards, and authentication in connection with such use can mitigate unauthorized transactions.

Abstract: A multimodal, multilanguage mobile device which can be employed to enhance note taking and/or annotation of a document, and gaming. Input data types such as optical character recognition (OCR), speech, handwriting, and visual information (e.g., image and/or video), etc., can be fused to generate rich documents with a multidimensional level of data to provide an increased level of context over conventional documents. Such architecture can be utilized by students for homework management, as well as entertainment (e.g., gaming).

Abstract: A data collaboration system that aggregates data from a number of multi-modal mobile devices in connection with collaborative note taking, presentation generation, memorializing a meeting, etc. The data collaboration system can automatically compile, index and/or memorialize data from numerous multi-modal multi-lingual mobile devices. More particularly, the system can filter and aggregate information from a plurality of disparate multi-modal devices. The system can facilitate indexing information gathered from a group of multi-modal mobile devices. The indexing can be based upon any desired criteria including but not limited to information type, importance, etc.

Abstract: Infrastructure for a multi-modal multilingual communications device (MMCD) is presented. A communications component is provided that includes wireless and wired IP networks (e.g, LANs, MANs, and WANs, . . . ), as well as cellular and/or wired telecommunications networks for cellular communications. A management component can include software and hardware entities that facilitate the activation, authentication, accounting, updating of the MMCD systems, and synchronization to other entities. Additionally, the management component can facilitate the dissemination of applications, third-party services, and subscription information. An access component (e.g., a web server and interface) facilitates access to one or more of these entities such that administrators and/or users can access aspects of setup, configuration, subscriptions, updates, etc.

Abstract: A system that facilitates consolidating resources (e.g., devices, services) based at least in part upon an established context. More particularly, a context determination component can be employed to establish a context by processing sensor inputs or learning/inferring a user action/preference. Once the context is established via a context determination component, a consolidation component can be employed to aggregate and/or disaggregate disparate resources (e.g., devices, services) in accordance with the established context. These resources can work autonomously and/or in conjunction with a subset of the other resources to provide for a highly rich multi-modal user experience.

Abstract: A multi-modal multi-lingual mobile device that facilitates intelligently automating an action. The device can automatically synchronize a user schedule based upon a user state, intention, preference and/or limitation. The device can employ sensors to automatically detect criteria by which to automatically implement an action. Moreover, the system can interrogate a user thus converging upon a user intention and/or preference. An analyzer component can intelligently evaluate the compiled criterion in order to automatically perform an action. The multi-modal multi-lingual mobile device can automatically facilitate identification of an individual. Other actions that are automatically performed can include modifying personal information manager data, translating languages into a language comprehendible to a user, etc. Implementation of these actions can be based at least in part upon an environmental factor, a conversation, a location factor and a temporal factor.

Abstract: A multi-modal device that can substantially facilitate intelligent shopping. Electronic receipts can be provided to a user wirelessly and stored/indexed on the multi-modal device. Receipts can be categorized (e.g., personal, business, client entertainment) thereby facilitating financial management and accounting. Likewise, such electronic receipts can provide for easier return/exchange of goods. The multi-modal device can also assist in tracking/managing shopping lists and business cards (e.g., provide for business card exchanges). Moreover, the multi-modal device can provide for comparison shopping, catalog shopping, locating products and obtaining more information about a product via visual or audio mechanisms.

Abstract: A multimodal, multilanguage mobile device which can be employed to enhance note taking and/or annotation of a document, and gaming. Input data types such as optical character recognition (OCR), speech, handwriting, and visual information (e.g., image and/or video), etc., can be fused to generate rich documents with a multidimensional level of data to provide an increased level of context over conventional documents. Such architecture can be utilized by students for homework management, as well as entertainment (e.g., gaming).

Abstract: Location-based technologies (e.g., global position system (GPS)) can be employed to facilitate providing multi-modal, multi-lingual location-based services. Identification of location can provide significant context as to identifying user state and intentions. Thus, location identification can facilitate providing/augmenting data and services (e.g., location-aware based suggestions, truncating contact lists based upon location, location-based reminders as a user approaches a predetermined location, truncating pre-loaded tasks, suggesting routes to accomplish pre-loaded tasks in a PIM). Still other aspects can augment GPS location identification with a compass, accelerometer, azimuth control, cellular triangulation, SPOT services of telephone, etc. Effectively, these alternative aspects can facilitate determination of a target location by detecting movement and direction of a user and/or portable device.

Abstract: A multimodal system that employs a plurality of sensing modalities which can be processed concurrently to increase confidence in connection with authentication. The multimodal system and/or set of various devices can provide several points of information entry in connection with authentication. Authentication can be improved, for example, by combining face recognition, biometrics, speech recognition, handwriting recognition, gait recognition, retina scan, thumb/hand prints, or subsets thereof. Additionally, portable multimodal devices (e.g., a smartphone) can be used as credit cards, and authentication in connection with such use can mitigate unauthorized transactions.

Abstract: Portable computing devices automatically interface with other computing devices to interact in a collaborative effort toward providing a single, seamless computing experience for a user. As a user walks into a room with a cellular telephone certain functionality and data can be automatically unloaded to a desktop computer or other device based on a user or device identification or state. For example, a conversation on a cellular telephone can be automatically migrated to a desktop telephone as a user sits down. As a user is about to leave a room for a meeting, the desktop computer can update the telephone with latest versions of certain files. Thus, devices can automatically aggregate and/or decouple to provide a user with a single computing experience. These portable devices can broadcast an extensible set of services to other devices as well as to a host computer or server.

Abstract: A device and/or devices can be placed on an individual to continuously collect and/or transmit information regarding the health state of the individual. The monitor, for example, can transmit data to doctor(s), hospital(s), emergency personnel, as well as automatically initiate affirmative actions (e.g., call an ambulance). The invention can facilitate preventive medicine by monitoring the individual's day to day actions (e.g., eating habits, exercise, stress, sleep, allergy detection, heart rate, blood sugar). This monitored information can be employed to facilitate the individual in taking proactive steps to living a healthy life. The device can also be used to record a user reaction to an event and/or to broadcast information about oneself whether for health, business or social purposes. Additionally, the invention can be used as a driver monitor to facilitate safe handling of equipment (e.g., alcohol sensor).

Abstract: A light pointer is selectively activated to direct a light beam onto an interactive display surface, forming a pattern of light that is detected by a light sensor disposed within an interactive display table. The waveband of the light produced by the light pointer is selected to correspond to a waveband to which the light sensor responds, enabling the light sensor to detect the position of the pattern on the interactive display surface, as well as characteristics that enable the location and orientation of the light pointer to be determined. Specifically, the shape and size of the pattern, and the intensity of light forming the pattern are detected by the light sensor and are processed to determine the orientation of the light pointer and its distance from the interactive display surface. The pattern may comprise various shapes, such as circles, arrows, and crosshairs.

Abstract: An object placed on an interactive display surface is detected and its position and orientation are determined in response to IR light that is reflected from an encoded marking on the object. Upon detecting the object on an interactive display surface, a software program produces a virtual entity or image visible through the object to perform a predefined function. For example, the object may appear to magnify text visible through the object, or to translate a word or phrase from one language to another, so that the translated word or phrase is visible through the object. When the object is moved, the virtual entity or image that is visible through the object may move with it, or can control the function being performed. A plurality of such objects can each display a portion of an image, and when correctly positioned, together will display the entire image, like a jigsaw puzzle.

Abstract: A system and/or method that generates user interface output sequences controlled by a user interface output system. The user interface output system can provide event definitions to an application program that specify high-level actions to be performed by the sequence and can issue low-level commands to direct the actions of the user interface output sequence. The user interface output system provides a user interface output controller, which acts as an interface between an application program and the low-level commands which specify tasks for the user interface output sequence to perform. The user interface output controller is generated from a specification, using a planning methodology.

Abstract: A view restrictor is employed to ensure that private information can only be viewed on an interactive display by a privileged user but not by non-privileged users. By detecting the location and orientation of the view restrictor on the display surface, a private portion of the display surface can be determined. The private portion is not visible to non-privileged users. The private information is then displayed to a privileged user at this private portion, and the view restrictor blocks non-privileged user(s) from viewing the private information. The interactive display detects removal of the view restrictor from the display surface, and interrupts display of the private information. In another embodiment, the private information is obfuscated so that it can be viewed only by a privileged viewer through a view revealer that includes a color filter. The private information may be either a graphic image or text.

Abstract: One or more objects placed on a display surface of an interactive display system are identified by a camera that receives infrared light reflected back by the object(s) through the display surface. The interactive display system displays images on the display surface that are produced by software applications, as well as sensing objects placed proximate to the display surface. If object(s) that were placed on the display surface are identified and determined to be associated with a predefined software application, the application is automatically executed. Objects can be identified based upon shape, a pattern applied to the objects, a size of the object, or a location on the display surface where the object is placed. The object may be used in the software application after it is executed or may simply be bear a functional relationship to the software application.

Abstract: An interactive table has a display surface on which a physical object is disposed. A camera within the interactive table responds to infrared (IR) light reflected from the physical object enabling a location of the physical object on the display surface to be determined, so that the physical object appear part of a virtual environment displayed thereon. The physical object can be passive or active. An active object performs an active function, e.g., it can be self-propelled to move about on the display surface, or emit light or sound, or vibrate. The active object can be controlled by a user or the processor. The interactive table can project an image through a physical object on the display surface so the image appears part of the object. A virtual entity is preferably displayed at a position (and a size) to avoid visually interference with any physical object on the display surface.