Patents by Inventor Yu Ouyang

Yu Ouyang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10019435
    Abstract: An example method includes displaying, at a presence-sensitive device, a virtual keyboard, receiving an indication of input entered at a presence-sensitive device indicating a plurality of characters, determining a sequence of at least three character strings in the plurality such that the sequence does not include any space characters, modifying the characters by inserting at least two space characters to demarcate the at least three character strings, and determining at least two suggested character strings based on first, second, and third character strings of the sequence. The method further includes outputting, for display at the presence-sensitive device and at a text-suggestion area of the GUI, the at least two suggested character strings, receiving a selection that indicates a selected character string of the at least two suggested character strings, and outputting, for display at the presence-sensitive device and at the text-entry area of the GUI, the selected character string.
    Type: Grant
    Filed: August 5, 2014
    Date of Patent: July 10, 2018
    Assignee: Google LLC
    Inventors: Yu Ouyang, Shumin Zhai
  • Publication number: 20180188948
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.
    Type: Application
    Filed: December 29, 2016
    Publication date: July 5, 2018
    Inventors: Yu Ouyang, Diego Melendo Casado, Mohammadinamul Hasan Sheik, Francoise Beaufays, Dragan Zivkovic, Meltem Oktem
  • Publication number: 20180074698
    Abstract: In one example, a method may include outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys, and receiving an indication of a gesture. The method may include determining an alignment score that is based at least in part on a word prefix and an alignment point traversed by the gesture. The method may include determining at least one alternative character that is based at least in part on a misspelling that includes at least a portion of the word prefix. The method may include determining an alternative alignment score based at least in part on the alternative character; and outputting, by the computing device and for display, based at least in part on the alternative alignment score, a candidate word based at least in part on the alternative character.
    Type: Application
    Filed: November 9, 2017
    Publication date: March 15, 2018
    Inventors: Yu Ouyang, Shumin Zhai
  • Publication number: 20180018314
    Abstract: In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.
    Type: Application
    Filed: September 13, 2017
    Publication date: January 18, 2018
    Inventors: Shumin Zhai, Yu Ouyang, Ken Wakasa, Satoshi Kataoka
  • Patent number: 9841895
    Abstract: In one example, a method may include outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys, and receiving an indication of a gesture. The method may include determining an alignment score that is based at least in part on a word prefix and an alignment point traversed by the gesture. The method may include determining at least one alternative character that is based at least in part on a misspelling that includes at least a portion of the word prefix. The method may include determining an alternative alignment score based at least in part on the alternative character; and outputting, by the computing device and for display, based at least in part on the alternative alignment score, a candidate word based at least in part on the alternative character.
    Type: Grant
    Filed: June 12, 2015
    Date of Patent: December 12, 2017
    Assignee: Google LLC
    Inventors: Yu Ouyang, Shumin Zhai
  • Patent number: 9804777
    Abstract: An example method includes outputting a plurality of characters, receiving an input indicative of a slide gesture across one or more regions associated with a group of characters included in the plurality of characters, determining, based on an origination point and/or a speed of movement, whether the slide gesture represents a character string level selection or a character level selection, responsive to determining that the slide gesture represents the character string level selection, outputting a graphical selection of at least one character string included in the group of characters, such that the at least one character string is visually differentiated from any of the plurality of characters not included in the group of characters, and responsive to determining that the slide gesture represents the character level selection, outputting, in single character increments, a graphical selection of at least one character included in the group of characters.
    Type: Grant
    Filed: July 16, 2013
    Date of Patent: October 31, 2017
    Assignee: Google Inc.
    Inventors: Yu Ouyang, Shumin Zhai
  • Publication number: 20170308522
    Abstract: A computing device outputs a keyboard for display, receives an indication of a first gesture to select a first sequence of one or more keys, determines a set of candidate strings based in part on the first sequence of keys, and outputs for display at least one of the set of candidate strings. The computing device receives an indication of a second gesture to select a second sequence of one or more keys, and determines that characters associated with the second sequence of keys are included in a first candidate word based at least in part on the set of candidate strings, or are included in a second candidate word not based on the first sequence of keys. The computing device modifies the set of candidate strings based at least in part on the determination and outputs for display at least one of the modified candidate strings.
    Type: Application
    Filed: July 12, 2017
    Publication date: October 26, 2017
    Inventors: Yu Ouyang, Shumin Zhai, Xiaojun Bi
  • Patent number: 9798718
    Abstract: In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.
    Type: Grant
    Filed: September 14, 2016
    Date of Patent: October 24, 2017
    Assignee: Google Inc.
    Inventors: Shumin Zhai, Yu Ouyang, Ken Wakasa, Satoshi Kataoka
  • Publication number: 20170269708
    Abstract: In some examples, a method includes outputting a graphical keyboard (120) for display and responsive to receiving an indication of a first input (124), determining a new character string that is not included in a language model. The method may include adding the new character string to the language model and associating a likelihood value with the new character string. The method may include, responsive to receiving an indication of a second input, predicting the new character string, and responsive to receiving an indication of a third input that rejects the new character string, decreasing the likelihood value associated with the new character string.
    Type: Application
    Filed: June 8, 2017
    Publication date: September 21, 2017
    Inventors: Yu Ouyang, Shumin Zhai
  • Patent number: 9753906
    Abstract: In one example, a method includes outputting, for display at a presence-sensitive display, a graphical user interface including a text display region and a graphical keyboard. The method further includes receiving an indication of a first gesture detected at a location within the text display region, and selecting, based at least in part on the location within the text display region, at least a portion of a character string included in the text display region. The method further includes receiving, while the first gesture is detected at the presence-sensitive display, an indication of at least a portion of a second gesture to select at least one key of the graphical keyboard, and outputting, responsive to receiving an indication of a termination of at least the second gesture, a replacement character string for display within the text display region to replace the portion of the character string.
    Type: Grant
    Filed: June 4, 2014
    Date of Patent: September 5, 2017
    Assignee: Google Inc.
    Inventors: Kurt Edward Partridge, Yu Ouyang
  • Patent number: 9747272
    Abstract: A computing device is described that outputs for display at a presence-sensitive screen, a graphical keyboard having keys. The computing device receives an indication of a selection of one or more of the keys. Based on the selection the computing device determines a character string from which the computing device determines one or more candidate words. Based at least in part on the candidate words and a plurality of features, the computing device determines a spelling probability that the character string represents an incorrect spelling of at least one candidate word. The plurality of features includes a spatial model probability associated with at least one of the candidate words. If the spelling probability satisfies a threshold, the computing device outputs for display the at least one candidate word.
    Type: Grant
    Filed: March 6, 2014
    Date of Patent: August 29, 2017
    Assignee: Google Inc.
    Inventors: Yu Ouyang, Shumin Zhai
  • Publication number: 20170206193
    Abstract: A graphical keyboard including a number of keys is output for display at a display device. The computing device receives an indication of a gesture to select at least two of the keys based at least in part on detecting an input unit at locations of a presence-sensitive input device. In response to the detecting and while the input unit is detected at the presence-sensitive input device: the computing device determines a candidate word for the gesture based at least in part on the at least two keys and the candidate word is output for display at a first location of the output device. In response to determining that the input unit is no longer detected at the presence-sensitive input device, the displayed candidate word is output for display at a second location of the display device.
    Type: Application
    Filed: April 4, 2017
    Publication date: July 20, 2017
    Inventors: Xiaojun Bi, Yu Ouyang, Shumin Zhai
  • Patent number: 9710453
    Abstract: A computing device outputs a keyboard for display, receives an indication of a first gesture to select a first sequence of one or more keys, determines a set of candidate strings based in part on the first sequence of keys, and outputs for display at least one of the set of candidate strings. The computing device receives an indication of a second gesture to select a second sequence of one or more keys, and determines that characters associated with the second sequence of keys are included in a first candidate word based at least in part on the set of candidate strings, or are included in a second candidate word not based on the first sequence of keys. The computing device modifies the set of candidate strings based at least in part on the determination and outputs for display at least one of the modified candidate strings.
    Type: Grant
    Filed: September 4, 2014
    Date of Patent: July 18, 2017
    Assignee: Google Inc.
    Inventors: Yu Ouyang, Shumin Zhai, Xiaojun Bi
  • Publication number: 20170199665
    Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.
    Type: Application
    Filed: March 29, 2017
    Publication date: July 13, 2017
    Inventors: Shumin Zhai, Thomas Breuel, Ouais Alsharif, Yu Ouyang, Francoise Beaufays, Johan Schalkwyk
  • Patent number: 9703394
    Abstract: In some examples, a method includes outputting a graphical keyboard (120) for display and responsive to receiving an indication of a first input (124), determining a new character string that is not included in a language model. The method may include adding the new character string to the language model and associating a likelihood value with the new character string. The method may include, responsive to receiving an indication of a second input, predicting the new character string, and responsive to receiving an indication of a third input that rejects the new character string, decreasing the likelihood value associated with the new character string.
    Type: Grant
    Filed: October 1, 2015
    Date of Patent: July 11, 2017
    Assignee: Google Inc.
    Inventors: Yu Ouyang, Shumin Zhai
  • Publication number: 20170185286
    Abstract: Methods, systems, and apparatus for receiving data indicating a location of a particular touchpoint representing a latest received touchpoint in a sequence of received touchpoints; identifying candidate characters associated with the particular touchpoint; generating, for each of the candidate characters, a confidence score; identifying different candidate sequences of characters each including for each received touchpoint, one candidate character associated with a location of the received touchpoint, and one of the candidate characters associated with the particular touchpoint; for each different candidate sequence of characters, determining a language model score and generating a transcription score based at least on the confidence score for one or more of the candidate characters in the candidate sequence of characters and the language model score for the candidate sequence of characters; selecting, and providing for output, a representative sequence of characters from among the candidate sequences of char
    Type: Application
    Filed: December 29, 2015
    Publication date: June 29, 2017
    Inventors: Francoise Beaufays, Yu Ouyang, David Rybach, Michael D. Riley, Lars Hellsten
  • Patent number: 9678664
    Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.
    Type: Grant
    Filed: April 10, 2015
    Date of Patent: June 13, 2017
    Assignee: Google Inc.
    Inventors: Shumin Zhai, Thomas Breuel, Ouais Alsharif, Yu Ouyang, Francoise Beaufays, Johan Schalkwyk
  • Patent number: 9678943
    Abstract: A graphical keyboard including a number of keys is output for display at a display device. The computing device receives an indication of a gesture to select at least two of the keys based at least in part on detecting an input unit at locations of a presence-sensitive input device. In response to the detecting and while the input unit is detected at the presence-sensitive input device: the computing device determines a candidate word for the gesture based at least in part on the at least two keys and the candidate word is output for display at a first location of the output device. In response to determining that the input unit is no longer detected at the presence-sensitive input device, the displayed candidate word is output for display at a second location of the display device.
    Type: Grant
    Filed: September 24, 2014
    Date of Patent: June 13, 2017
    Assignee: Google Inc.
    Inventors: Xiaojun Bi, Yu Ouyang, Shumin Zhai
  • Patent number: 9665276
    Abstract: Techniques are described for character deletion on a computing device that utilizes a gesture-based keyboard. The computing device includes a processor and at least one module operable by the processor to output, for display at a presence-sensitive display, a graphical keyboard comprising a plurality of keys and a text editor field. In response to receiving an indication of a gesture that comprises a first path, the module outputs a first character, based at least in part on the first path, associated with a first key and a second character associated with a second key. In response to determining that the gesture further comprises a second path that retraces at least a portion of the first path, the module removes the second character from the text editor field of the presence-sensitive display.
    Type: Grant
    Filed: November 19, 2014
    Date of Patent: May 30, 2017
    Assignee: Google Inc.
    Inventors: Xiaojun Bi, Kurt Edward Partridge, Yu Ouyang, Shumin Zhai
  • Patent number: 9569107
    Abstract: In one example, a method includes outputting, for display at a presence-sensitive display, a graphical user interface comprising a graphical keyboard that includes a group of keys, wherein each key in the group of keys is associated with a respective, different region of the presence-sensitive display. The method further includes receiving an indication of a gesture to select a sequence of one or more keys in the group of keys of the graphical keyboard. The method further includes determining, based at least in part on the indication of the gesture, that the gesture includes at least one feature associated with a cancellation of the selected sequence of one or more keys. The method further includes, in response to determining that the gesture includes the at least one feature associated with the cancellation, omitting the selected sequence of one or more keys from entry to a text input field.
    Type: Grant
    Filed: April 19, 2013
    Date of Patent: February 14, 2017
    Assignee: Google Inc.
    Inventors: Shumin Zhai, Kurt Edward Partridge, Xiaojun Bi, Yu Ouyang