Abstract: Techniques for providing adaptive assistive technology for assisting users with visual impairment can be used on a computing device. These techniques include displaying content to a user, capturing a series of images or video of the user using a camera, analyzing the series of images or video to determine whether the user is exhibiting behavior or characteristics indicative of visual impairment, and rendering a magnification user interface on the display configured to magnify at least a portion of the content of the display based on a determination that the user is exhibiting behavior or characteristics indicative of visual impairment. The magnification user interface may be controlled based on head and/or eye movements of the user of the computing device.

Abstract: Techniques for providing adaptive assistive technology for assisting users with visual impairment can be used on a computing device. These techniques include displaying content to a user, capturing a series of images or video of the user using a camera, analyzing the series of images or video to determine whether the user is exhibiting behavior or characteristics indicative of visual impairment, and rendering a magnification user interface on the display configured to magnify at least a portion of the content of the display based on a determination that the user is exhibiting behavior or characteristics indicative of visual impairment. The magnification user interface may be controlled based on head and/or eye movements of the user of the computing device.

Abstract: Techniques for providing adaptive assistive technology for assisting users with visual impairment can be used on a computing device. These techniques include displaying content to a user, capturing a series of images or video of the user using a camera, analyzing the series of images or video to determine whether the user is exhibiting behavior or characteristics indicative of visual impairment, and rendering a magnification user interface on the display configured to magnify at least a portion of the content of the display based on a determination that the user is exhibiting behavior or characteristics indicative of visual impairment. The magnification user interface may be controlled based on head and/or eye movements of the user of the computing device.

Abstract: Adaptive assistance technologies can assist a user with operating a computing device. A method according to these techniques includes analyzing user interactions with the computing device, determining that the user interactions with the computing device are indicative of a user experiencing one or more issues for which adaptive assistive technologies provided by the computing device may assist the user, identifying one or more assistive technologies provided by the computing device that may address the one or more issues, modifying one or more operating parameters of the computing device using the one or more assistive technologies, and operating the computing device according to the one or more modified operating parameters.

Abstract: Techniques for providing adaptive assistive technology for assisting users with visual impairment can be used on a computing device. These techniques include displaying content to a user, capturing a series of images or video of the user using a camera, analyzing the series of images or video to determine whether the user is exhibiting behavior or characteristics indicative of visual impairment, and rendering a magnification user interface on the display configured to magnify at least a portion of the content of the display based on a determination that the user is exhibiting behavior or characteristics indicative of visual impairment. The magnification user interface may be controlled based on head and/or eye movements of the user of the computing device.

Abstract: Embodiments are disclosed for a method of providing a user interface on a computing device. The method includes presenting a virtual keyboard on a display of the computing device, detecting input to the virtual keyboard. The method further includes, for each detected input, determining whether the input selects any of one or more delimiter keys, displaying a placeholder for the input responsive to the input not selecting any of the one or more delimiter keys, and receiving suggested candidate text from a word-level recognizer and replacing all currently displayed placeholders with the suggested candidate text responsive to the input selecting any of the one or more delimiter keys.

Abstract: Quick tasks for on-screen keyboards are described in which an on-screen keyboard supports a plurality of quick tasks configured to edit selected text in defined ways. Quick task functions may be assigned to keys of the on-screen keyboard in addition to the default actions or “normal” character entry functions of the keys. During text input, the keys operate normally to perform a function related to character entry, such as to cause input of corresponding text character. When text is selected or in other designated interaction scenarios, operation of a key associated with a quick task may automatically trigger the quick task to modify selected text in a corresponding way. Thus, the same key of an on-screen keyboard may be employed to initiate a function related to character entry or apply of a quick task to text depending upon the interaction scenario.

Abstract: Embodiments are disclosed for a method of providing a user interface on a computing device. The method includes presenting a virtual keyboard on a display of the computing device, detecting input to the virtual keyboard. The method further includes, for each detected input, determining whether the input selects any of one or more delimiter keys, displaying a placeholder for the input responsive to the input not selecting any of the one or more delimiter keys, and receiving suggested candidate text from a word-level recognizer and replacing all currently displayed placeholders with the suggested candidate text responsive to the input selecting any of the one or more delimiter keys.

Abstract: Methods, systems, and apparatuses in a computing device enable magnification of selectable display objects. A first interaction event associated with a first selectable display object displayed in a display screen, the display screen having a boundary and a current magnification level is detected. A first display location and a first unmagnified size of the first selectable display object in the display screen is determined and a magnified display size for the first selectable display object based at least on the first unmagnified size is determined. A second display location for the first selectable display object based at least on the first display location is determined and the first selectable display object is displayed at the magnified display size and at the second display location on the display screen. The display screen is otherwise displayed entirely at the current magnification level.

Abstract: Embodiments are disclosed for a method of providing a user interface on a computing device. The method includes presenting a virtual keyboard on a display of the computing device, detecting input to the virtual keyboard. The method further includes, for each detected input, determining whether the input selects any of one or more delimiter keys, displaying a placeholder for the input responsive to the input not selecting any of the one or more delimiter keys, and receiving suggested candidate text from a word-level recognizer and replacing all currently displayed placeholders with the suggested candidate text responsive to the input selecting any of the one or more delimiter keys.

Abstract: In a mobile device, the text entered by users is analyzed to determine a set of responses commonly entered by users into text applications such as SMS applications in response to received messages. This set of responses is used to provide suggested responses to a user for a currently received message in a soft input panel based on the text of the currently received message. The suggested responses are provided before any characters are provided by the user. After the user provides one or more characters, the suggested responses in the soft input panel are updated. The number of suggested responses displayed to the user in the soft input panel is limited to a total confidence value to reduce user distraction and to allow for easier selection. An undo feature for inadvertent selections of suggested responses is also provided.

Abstract: Embodiments are disclosed for a method of providing a user interface on a computing device. The method includes presenting a virtual keyboard on a display of the computing device, detecting input to the virtual keyboard. The method further includes, for each detected input, determining whether the input selects any of one or more delimiter keys, displaying a placeholder for the input responsive to the input not selecting any of the one or more delimiter keys, and receiving suggested candidate text from a word-level recognizer and replacing all currently displayed placeholders with the suggested candidate text responsive to the input selecting any of the one or more delimiter keys.

Abstract: In a mobile device, a context is determined for the mobile device. The context is determined based on a variety of characteristics of the mobile device environment including, for example, the current application being used, any contacts that a user of the mobile device is interacting with or having a conversation with, the current date and/or time, a current topic of the conversation, a current style of the conversation, etc. Based on a set of strings associated with the determined context and user generated text, one or more string predictions are generated for the user generated text. The string predictions may be presented to the user as suggested completions of the user generated text.

Abstract: In a mobile device, the text entered by users is analyzed to determine a set of responses commonly entered by users into text applications such as SMS applications in response to received messages. This set of responses is used to provide suggested responses to a user for a currently received message in a soft input panel based on the text of the currently received message. The suggested responses are provided before any characters are provided by the user. After the user provides one or more characters, the suggested responses in the soft input panel are updated. The number of suggested responses displayed to the user in the soft input panel is limited to a total confidence value to reduce user distraction and to allow for easier selection. An undo feature for inadvertent selections of suggested responses is also provided.

Abstract: Techniques to employ emoji for text predictions are described herein. In one or more implementations, entry of characters is detected during interaction with a device. Prediction candidates corresponding to the detected characters are generated according to a language model that is configured to consider emoji along with words and phrases. The language model may make use of a mapping table that maps a plurality of emoji to corresponding words. The mapping table enables a text prediction engine to offer the emoji as alternatives for matching words. In addition or alternatively, the text prediction engine may be configured to analyze emoji as words within the model and generate probabilities and candidate rankings for predictions that include both emoji and words. User-specific emoji use may also be learned by monitoring a user's typing activity to adapt predictions to the user's particular usage of emoji.