Abstract: An auxiliary device that remotely controls a mobile computing device is described herein. The auxiliary device can be wirelessly coupled with the mobile computing device. The auxiliary device can detect a user input at the auxiliary device. An operation executed by the mobile computing device can be performed responsive to the user input. Further, an identity of the operation can be a function of a context of the mobile computing device and the user input. Responsive to detection of the user input, the auxiliary device can transmit data indicative of the user input from the auxiliary device to the mobile computing device.

Abstract: An auxiliary device that remotely controls a mobile computing device is described herein. The auxiliary device can be wirelessly coupled with the mobile computing device. The auxiliary device can detect a user input at the auxiliary device. An operation executed by the mobile computing device can be performed responsive to the user input. Further, an identity of the operation can be a function of a context of the mobile computing device and the user input. Responsive to detection of the user input, the auxiliary device can transmit data indicative of the user input from the auxiliary device to the mobile computing device.

Abstract: Embodiments present a game in which an ordered plurality of characters is presented for entry by a user with a touch screen, a physical keyboard, or other key input layout. The game advances to each successive character when the user presses the intended character or a character adjacent thereto. Contact areas are determined for each press, and in some embodiments the contact areas are overlaid on the keyboard. The contact areas are used to adjust user-specific touch models to improve text entry by the user. In some embodiments, the contact areas indicate areas for improvement by the user. Game completion statistics are calculated including speed and accuracy.

Abstract: An auxiliary device that remotely controls a mobile computing device is described herein. The auxiliary device can be wirelessly coupled with the mobile computing device. The auxiliary device can detect a user input at the auxiliary device. An operation executed by the mobile computing device can be performed responsive to the user input. Further, an identity of the operation can be a function of a context of the mobile computing device and the user input. Responsive to detection of the user input, the auxiliary device can transmit data indicative of the user input from the auxiliary device to the mobile computing device.

Abstract: The collection and clustering of data input characteristics from a plurality of computing devices is provided. The clustered data input characteristics define user groups to which users are assigned. Input models such as language models and touch models are created for, and distributed to, each of the user groups based on the data input characteristics of the users assigned thereto. For example, an input model may be selected for a computing device based on a current context of the computing device. The selected input model is applied to the computing device during the current context to alter the interpretation of input received from the user via the computing device.

Abstract: The collection and clustering of data input characteristics from a plurality of computing devices is provided. The clustered data input characteristics define user groups to which users are assigned. Input models such as language models and touch models are created for, and distributed to, each of the user groups based on the data input characteristics of the users assigned thereto. For example, an input model may be selected for a computing device based on a current context of the computing device. The selected input model is applied to the computing device during the current context to alter the interpretation of input received from the user via the computing device.

Abstract: Embodiments present a game in which an ordered plurality of characters is presented for entry by a user with a touch screen, a physical keyboard, or other key input layout. The game advances to each successive character when the user presses the intended character or a character adjacent thereto. Contact areas are determined for each press, and in some embodiments the contact areas are overlaid on the keyboard. The contact areas are used to adjust user-specific touch models to improve text entry by the user. In some embodiments, the contact areas indicate areas for improvement by the user. Game completion statistics are calculated including speed and accuracy.

Abstract: Multimodal interaction with grammar-based speech applications may be facilitated with a device by presenting permissible phrases that are in-grammar based on acceptable terms that are in-vocabulary and that have been recognized from a spoken utterance. In an example embodiment, a spoken utterance having two or more terms is received. The two or more terms include one or more acceptable terms. An index is searched using the acceptable terms as query terms. From the searching of the index, permissible phrase(s) are produced that include the acceptable terms. The index is a searchable data structure that represents multiple possible grammar paths that are ascertainable based on acceptable values for each term position of a grammar-based speech application. The permissible phrase(s) are presented to a user as option(s) that may be selected to conduct multimodal interaction with the device.

Abstract: A multi-modal search system (and corresponding methodology) that employs wildcards is provided. Wildcards can be employed in the search query either initiated by the user or inferred by the system. These wildcards can represent uncertainty conveyed by a user in a multi-modal search query input. In examples, the words “something” or “whatchamacallit” can be used to convey uncertainty and partial knowledge about portions of the query and to dynamically trigger wildcard generation.

Abstract: Multimodal interaction with grammar-based speech applications may be facilitated with a device by presenting permissible phrases that are in-grammar based on acceptable terms that are in-vocabulary and that have been recognized from a spoken utterance. In an example embodiment, a spoken utterance having two or more terms is received. The two or more terms include one or more acceptable terms. An index is searched using the acceptable terms as query terms. From the searching of the index, permissible phrase(s) are produced that include the acceptable terms. The index is a searchable data structure that represents multiple possible grammar paths that are ascertainable based on acceptable values for each term position of a grammar-based speech application. The permissible phrase(s) are presented to a user as option(s) that may be selected to conduct multimodal interaction with the device.

Abstract: A multi-modal search system (and corresponding methodology) is provided. The system employs text, speech, touch and gesture input to establish a search query. Additionally, a subset of the modalities can be used to obtain search results based upon exact or approximate matches to a search result. For example, wildcards, which can either be triggered by the user or inferred by the system, can be employed in the search.

Abstract: A multi-modal search system (and corresponding methodology) that employs wildcards is provided. Wildcards can be employed in the search query either initiated by the user or inferred by the system. These wildcards can represent uncertainty conveyed by a user in a multi-modal search query input. In examples, the words “something” or “whatchamacallit” can be used to convey uncertainty and partial knowledge about portions of the query and to dynamically trigger wildcard generation.

Abstract: A multi-modal search query refinement system (and corresponding methodology) is provided. In accordance with the innovation, query suggestion results represent a word palette which can be used to select strings for inclusion or exclusion from a refined set of results. The system employs text, speech, touch and gesture input to refine a set of search query results. Wildcards can be employed in the search either prompted by the user or inferred by the system. Additionally, partial knowledge supplemented by speech can be employed to refine search results.