Abstract: In one example, a method includes outputting, at a presence-sensitive display operatively coupled to a computing device, a graphical keyboard comprising a plurality of keys and receiving an indication of a gesture to select a group of keys of the plurality of keys. The method may further include determining, in response to the indication, a candidate word based at least in part on the group of keys. The method may further include determining a group of alignment points traversed by the gesture and respective cost values for each of at least two keys of the plurality of keys. The method may further include comparing the respective cost values for at least each of at least two keys of the plurality of keys to determine a combination of keys having a combined cost value and outputting the candidate word that is based on the respective cost values.

Abstract: In one example, a method may include outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys, and receiving an indication of a gesture. The method may include determining an alignment score that is based at least in part on a word prefix and an alignment point traversed by the gesture. The method may include determining at least one alternative character that is based at least in part on a misspelling that includes at least a portion of the word prefix. The method may include determining an alternative alignment score based at least in part on the alternative character; and outputting, by the computing device and for display, based at least in part on the alternative alignment score, a candidate word based at least in part on the alternative character.

Abstract: A graphical keyboard including a number of keys is output for display at a display device. The computing device receives an indication of a gesture to select at least two of the keys based at least in part on detecting an input unit at locations of a presence-sensitive input device. In response to the detecting and while the input unit is detected at the presence-sensitive input device: the computing device determines a candidate word for the gesture based at least in part on the at least two keys and the candidate word is output for display at a first location of the output device. In response to determining that the input unit is no longer detected at the presence-sensitive input device, the displayed candidate word is output for display at a second location of the display device.

Abstract: In one example, a method includes outputting, for display at a presence-sensitive display, a graphical user interface including a text display region and a graphical keyboard. The method further includes receiving an indication of a first gesture detected at a location within the text display region, and selecting, based at least in part on the location within the text display region, at least a portion of a character string included in the text display region. The method further includes receiving, while the first gesture is detected at the presence-sensitive display, an indication of at least a portion of a second gesture to select at least one key of the graphical keyboard, and outputting, responsive to receiving an indication of a termination of at least the second gesture, a replacement character string for display within the text display region to replace the portion of the character string.

Abstract: A computing device outputs a keyboard for display, receives an indication of a first gesture to select a first sequence of one or more keys, determines a set of candidate strings based in part on the first sequence of keys, and outputs for display at least one of the set of candidate strings. The computing device receives an indication of a second gesture to select a second sequence of one or more keys, and determines that characters associated with the second sequence of keys are included in a first candidate word based at least in part on the set of candidate strings, or are included in a second candidate word not based on the first sequence of keys. The computing device modifies the set of candidate strings based at least in part on the determination and outputs for display at least one of the modified candidate strings.

Abstract: An example method includes displaying, at a presence-sensitive device, a virtual keyboard, receiving an indication of input entered at a presence-sensitive device indicating a plurality of characters, determining a sequence of at least three character strings in the plurality such that the sequence does not include any space characters, modifying the characters by inserting at least two space characters to demarcate the at least three character strings, and determining at least two suggested character strings based on first, second, and third character strings of the sequence. The method further includes outputting, for display at the presence-sensitive device and at a text-suggestion area of the GUI, the at least two suggested character strings, receiving a selection that indicates a selected character string of the at least two suggested character strings, and outputting, for display at the presence-sensitive device and at the text-entry area of the GUI, the selected character string.

Abstract: A computing device determines, based at least in part on indications of user input, scores for a first set of candidate strings and a second set of candidate strings. Each candidate string from the first set of candidate strings is in a lexicon. Candidate strings from the second set of candidate strings are not necessarily in the lexicon. The computing device determines the scores for the first set of candidate strings based on probabilities of the candidate strings being entered. For each candidate string from the second set of candidate strings, the computing device determines the scores for the candidate string based on probabilities of characters of the candidate string being entered. The computing device selects a candidate string based on the scores for the first and second sets of candidate strings and outputs, for display at the display device, the selected candidate string.

Abstract: Handwriting interpretation tools, such as optical character recognition (OCR), have improved over the years such that OCR is a common tool in business for interpreting typed text and sometimes handwritten text. OCR does not apply well to non-text-only diagrams, such as chemical structure diagrams. A method according to an embodiment of the present invention of interpreting a human-drawn sketch includes determining a local metric indicating whether a candidate symbol belongs to a certain classification based on a set of features. The set of features includes, as a feature, scores generated from feature images of the candidate symbol. Also included is determining a joint metric of multiple candidate symbols based on their respective classifications and interpreting the sketch as a function of the local and joint metrics.

Abstract: In one example, a method includes outputting, for display at a presence-sensitive display, a graphical user interface including a text display region and a graphical keyboard. The method further includes receiving an indication of a first gesture detected at a location within the text display region, and selecting, based at least in part on the location within the text display region, at least a portion of a character string included in the text display region. The method further includes receiving, while the first gesture is detected at the presence-sensitive display, an indication of at least a portion of a second gesture to select at least one key of the graphical keyboard, and outputting, responsive to receiving an indication of a termination of at least the second gesture, a replacement character string for display within the text display region to replace the portion of the character string.

Abstract: In one example, a method includes outputting, at a presence-sensitive display operatively coupled to a computing device, a graphical keyboard comprising a plurality of keys and receiving an indication of a gesture to select a group of keys of the plurality of keys. The method may further include determining, in response to the indication, a candidate word based at least in part on the group of keys. The method may further include determining a group of alignment points traversed by the gesture and respective cost values for each of at least two keys of the plurality of keys. The method may further include comparing the respective cost values for at least each of at least two keys of the plurality of keys to determine a combination of keys having a combined cost value and outputting the candidate word that is based on the respective cost values.

Abstract: A computing device is described that outputs for display at a presence-sensitive screen, a graphical keyboard having keys. The computing device receives an indication of a selection of one or more of the keys. Based on the selection the computing device determines a character string from which the computing device determines one or more candidate words. Based at least in part on the candidate words and a plurality of features, the computing device determines a spelling probability that the character string represents an incorrect spelling of at least one candidate word. The plurality of features includes a spatial model probability associated with at least one of the candidate words. If the spelling probability satisfies a threshold, the computing device outputs for display the at least one candidate word.

Abstract: In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.

Abstract: In one example, a method includes receiving, by a server, data representative of a group of gestures detected by the plurality of computing devices and data representative of one or more shortcuts associated with the group of gestures from a plurality of computing devices, wherein each shortcut corresponds to an action performed by at least one of the computing devices. The method may further include aggregating, by the server, the data representative of the gestures and the data representative of the associated shortcuts received from the plurality of computing devices based at least in part on detected similarities between at least one of 1) the group of gestures and 2) the associated shortcuts, and defining, by the server, a gesture-shortcut language based at least in part on the aggregated data.

Abstract: Handwriting interpretation tools, such as optical character recognition (OCR), have improved over the years such that OCR is a common tool in business for interpreting typed text and sometimes handwritten text. OCR does not apply well to non-text-only diagrams, such as chemical structure diagrams. A method according to an embodiment of the present invention of interpreting a human-drawn sketch includes determining a local metric indicating whether a candidate symbol belongs to a certain classification based on a set of features. The set of features includes, as a feature, scores generated from feature images of the candidate symbol. Also included is determining a joint metric of multiple candidate symbols based on their respective classifications and interpreting the sketch as a function of the local and joint metrics.

Abstract: A computing device is described that outputs for display at a presence-sensitive screen, a graphical keyboard having keys. The computing device receives an indication of a selection of one or more of the keys. Based on the selection the computing device determines a character string from which the computing device determines one or more candidate words. Based at least in part on the candidate words and a plurality of features, the computing device determines a spelling probability that the character string represents an incorrect spelling of at least one candidate word. The plurality of features includes a spatial model probability associated with at least one of the candidate words. If the spelling probability satisfies a threshold, the computing device outputs for display the at least one candidate word.

Abstract: An example method includes displaying, at a presence-sensitive device, a virtual keyboard, receiving an indication of input entered at a presence-sensitive device indicating a plurality of characters, determining a sequence of at least three character strings in the plurality such that the sequence does not include any space characters, modifying the characters by inserting at least two space characters to demarcate the at least three character strings, and determining at least two suggested character strings based on first, second, and third character strings of the sequence. The method further includes outputting, for display at the presence-sensitive device and at a text-suggestion area of the GUI, the at least two suggested character strings, receiving a selection that indicates a selected character string of the at least two suggested character strings, and outputting, for display at the presence-sensitive device and at the text-entry area of the GUI, the selected character string.

Abstract: In general, this disclosure describes techniques for enabling gesture-based cursor control on gesture keyboards. For example, a computing device outputs a graphical keyboard and a text display region, including a cursor at a first cursor location. The computing device detects a gesture that originates at a location of the graphical keyboard and determines whether the location of the detected gesture originates within a cursor control region of the graphical keyboard. In response to determining that the location of the detected gesture is within the cursor control region, the computing device also outputs the cursor at a second cursor location that is different from the first cursor location, wherein the second cursor location is based at least in part on the gesture.

Abstract: In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.

Abstract: A computing device is described that outputs for display at a presence-sensitive screen, a graphical keyboard having keys. The computing device receives an indication of a selection of one or more of the keys. Based on the selection the computing device determines a character string from which the computing device determines one or more candidate words. Based at least in part on the candidate words and a plurality of features, the computing device determines a spelling probability that the character string represents an incorrect spelling of at least one candidate word. The plurality of features includes a spatial model probability associated with at least one of the candidate words. If the spelling probability satisfies a threshold, the computing device outputs for display the at least one candidate word.

Abstract: Techniques are described for character deletion on a computing device that utilizes a gesture-based keyboard. The computing device includes a processor and at least one module operable by the processor to output, for display at a presence-sensitive display, a graphical keyboard comprising a plurality of keys and a text editor field. In response to receiving an indication of a gesture that comprises a first path, the module outputs a first character, based at least in part on the first path, associated with a first key and a second character associated with a second key. In response to determining that the gesture further comprises a second path that retraces at least a portion of the first path, the module removes the second character from the text editor field of the presence-sensitive display.