Abstract: Various implementations include initiating, at a client device, a translation application for translation of a dialog session between a first user speaking in a first language and a second user speaking in a second language. In many implementations, the first language, spoken by the first user, can be determined based on one or more features of the client device. Additional or alternative implementations include determining a subset of candidate second languages from a plurality of languages available to the translation application. In a variety of implementations, the system can render output based on the subset of candidate second languages, and can process received input from the second user indicative of one or more of the candidate second languages in the subset of candidate second languages.

Abstract: Various implementations include initiating, at a client device, a translation application for translation of a dialog session between a first user speaking in a first language and a second user speaking in a second language. In many implementations, the first language, spoken by the first user, can be determined based on one or more features of the client device. Additional or alternative implementations include determining a subset of candidate second languages from a plurality of languages available to the translation application. In a variety of implementations, the system can render output based on the subset of candidate second languages, and can process received input from the second user indicative of one or more of the candidate second languages in the subset of candidate second languages.

Abstract: Implementations relate to a multimodal translation application that can provide an abridged version of a translation through an audio interface of a computing device, while simultaneously providing a verbatim textual translation at a display interface of the computing device. The application can provide these different versions of the translation in certain circumstances when, for example, the rate of speech of a person speaking to a user is relatively high compared to a preferred rate of speech of the user. For example, a comparison between phonemes of an original language speech and a translated language speech can be performed to determine whether the ratio satisfies a threshold for providing an audible abridged translation. A determination to provide the abridged translation can additionally or alternatively be based on a determined language of the speaker.

Abstract: A computer generated voice can automatically be adapted to be similar to a user's voice. Various implementations include processing audio data capturing a first language spoken utterance to identify one or more pitch characteristics. For example, the one or more pitch characteristics can include an estimated frequency range of the given user's voice. Additionally or alternatively, the system can process the audio data capturing the first language spoken utterance and a set of candidate computer generated voices using a computer generated voice selection model to select a candidate computer generated voice. Various implementations can include automatically modifying the selected candidate computer generated voice based on the one or more pitch characteristics to change the frequency range of the modified computer generated voice based on the user's voice.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for re-translation for simultaneous, spoken-language machine translation. In some implementations, a stream of audio data comprising speech in a first language is received. A transcription for the speech in the stream of audio data is generated using an automated speech recognizer through a series of updates. A translation of the transcription into a second language is generated using a machine translation module. The translation is generated with translation iterations that translate increasing amounts of the transcription, including re-translating previously portions of the transcription. A series of translation updates are provided to a client device based on the translation iterations.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for re-translation for simultaneous, spoken-language machine translation. In some implementations, a stream of audio data comprising speech in a first language is received. A transcription for the speech in the stream of audio data is generated using an automated speech recognizer through a series of updates. A translation of the transcription into a second language is generated using a machine translation module. The translation is generated with translation iterations that translate increasing amounts of the transcription, including re-translating previously portions of the transcription. A series of translation updates are provided to a client device based on the translation iterations.