Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for an automated calling system are disclosed. In one aspect, a method includes the actions of receiving audio data of an utterance spoken by a user who is having a telephone conversation with a bot. The actions further include determining a context of the telephone conversation. The actions further include determining a user intent of a first previous portion of the telephone conversation spoken by the user and a bot intent of a second previous portion of the telephone conversation outputted by a speech synthesizer of the bot. The actions further include, based on the audio data of the utterance, the context of the telephone conversation, the user intent, and the bot intent, generating synthesized speech of a reply by the bot to the utterance. The actions further include, providing, for output, the synthesized speech.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving data identifying contexts; selecting an initial set of questions based at least on the contexts; providing a respective representation of the questions of the initial set, for output; receiving data indicating a selection of a particular representation associated with a particular question of the initial set of questions; selecting a set of answers associated with the particular question; providing a respective representation of the answers of the set that are associated with the particular question, for output; receiving data indicating a selection of a particular representation associated with a particular answer of the set that are associated with the particular question; determining that an additional set of other questions is associated with the particular answer; and in response to the determining, providing a respective representation of the other questions of the additional set, for output.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for an automated calling system are disclosed. In one aspect, a method includes the actions of receiving audio data of an utterance spoken by a user who is having a telephone conversation with a bot. The actions further include determining a context of the telephone conversation. The actions further include determining a user intent of a first previous portion of the telephone conversation spoken by the user and a bot intent of a second previous portion of the telephone conversation outputted by a speech synthesizer of the bot. The actions further include, based on the audio data of the utterance, the context of the telephone conversation, the user intent, and the bot intent, generating synthesized speech of a reply by the bot to the utterance. The actions further include, providing, for output, the synthesized speech.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call initiation. In some implementations, a method includes receiving, by a call triggering module of a call initiating system for placing calls and conducing conversations between a bot of the call initiating system and human callee during the calls, data indicating a first event, determining, by the call triggering module and using the data indicating the first event, that the first event is a trigger event that triggers a workflow for the call initiating system that begins with initiating a phone call, selecting, based on the determined trigger event, a particular workflow, and in response to the selecting, initiating a phone call to a callee specified by the particular workflow.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for selecting textual representations for entity attribute values. One of the methods includes receiving, for presentation to a user, data identifying a relevant entity and a respective presentation attribute value for each of a plurality of presentation attributes associated with the relevant entity; obtaining user profile data for the user; selecting a respective textual representation for each of the presentation attribute values, wherein selecting the textual representations comprises selecting a first alternative textual representation for a first presentation attribute value based on the user profile data; and providing data identifying the entity and the textual representations for presentation to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call initiation. In some implementations, a method includes receiving, by a call triggering module of a call initiating system for placing calls and conducing conversations between a bot of the call initiating system and human callee during the calls, data indicating a first event, determining, by the call triggering module and using the data indicating the first event, that the first event is a trigger event that triggers a workflow for the call initiating system that begins with initiating a phone call, selecting, based on the determined trigger event, a particular workflow, and in response to the selecting, initiating a phone call to a callee specified by the particular workflow.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call initiation. In some implementations, a method includes receiving, by a call triggering module of a call initiating system for placing calls and conducing conversations between a bot of the call initiating system and human callee during the calls, data indicating a first event, determining, by the call triggering module and using the data indicating the first event, that the first event is a trigger event that triggers a workflow for the call initiating system that begins with initiating a phone call, selecting, based on the determined trigger event, a particular workflow, and in response to the selecting, initiating a phone call to a callee specified by the particular workflow.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call initiations and bailouts. In some implementations, a method includes analyzing, by a call initiating system, a real-time conversation between a first human and the bot during a phone call between the first human on a first end of the phone call and the bot on a second end of the phone call. The call initiating system can determine, based on the analysis of the real-time conversation, whether the phone call should be transitioned from the bot to a second human on the second end of the phone call. In response to determining that the phone call should be transitioned to a second human on the second end of the phone call, the call initiating system transitions the phone call from the bot to the second human.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to synthetic call status updates. In some implementations, a method includes determining, by a task manager module, that a triggering event has occurred to provide a current status of a user call request. The method may then determine, by the task manager module, the current status of the user call request. A representation of the current status of the user call request is generated. Then, the generated representation of the current status of the user call request is provided to the user.

Abstract: Systems and methods are disclosed for enriching a knowledge base for search queries. According to certain embodiments, images are assigned annotations that identify entities contained in the images. An object entity is selected among the entities based on the annotations and at least one attribute entity is determined using annotated images containing the object entity. A relationship between the object entity and the at least one attribute entity is inferred and stored in the knowledge base. In some embodiments, confidence may be calculated for the entities. The confidence scores may be aggregated across a plurality of images to identify an object entity.