Abstract: Systems, methods, and devices for outputting indications regarding voice-based interactions are described. A first speech-controlled device detects spoken audio corresponding to recipient information. The first device captures the audio and sends audio data corresponding to the captured audio to a server. The server determines a second speech-controlled device of the recipient and sends a signal to the recipient's second speech-controlled device representing a message is forthcoming. The recipient's second speech-controlled device outputs and indication representing a message is forthcoming.

Abstract: Methods and devices for causing a communications session between a first device and a second device to end based on lack of speech activity are described herein. In some embodiments, non-speech may be detected for both the first device and the second device. If the non-speech associated with the first device is determined to occur at a substantially same time as the non-speech associated with the second device, then this may indicate that no individuals are talking within earshot of their respective devices. Furthermore, the non-speech detected by the first device and the non-speech detected by the second device may both be of an amount of time that is greater than a predefined temporal threshold. If so, then the communications session may be caused to end because speech activity has not been detected by either device for more than the predefined temporal threshold.

Abstract: Systems, methods, and devices for outputting visual indications regarding voice-based interactions are described. A first speech-controlled device detects spoken audio corresponding to a voice message to a second speech-controlled device. The first device captures the audio and sends audio data corresponding to the captured audio to a server. The server performs speech processing on the audio data to determine a recipient and message content. The server then determines a second speech-controlled device associated with the recipient and sends the message content to the recipient's second speech-controlled device. Thereafter, the server receives an indication from the recipient's speech-controlled device that the second device is detecting speech, presumably in response to the original message. The server then causes a visual indication to be output by the first speech-controlled device, with the visual indication representing the recipient-speech controlled device is detecting speech.

Abstract: Various embodiments pertain to techniques for proactively delivering navigation options to a user via a mobile device. In various embodiments, one or more navigation options can be determined for the user and delivered to the user's mobile device at a relevant time. Navigation options can be selected based on the user's current location, the user's future plans, the time, and other locally relevant information, such as friends nearby or a nearby favorite location of the user. The navigation options can be delivered to the user's mobile device at a time that the navigation options are relevant.

Abstract: Various embodiments pertain to techniques for proactively delivering navigation options to a user via a mobile device. In various embodiments, one or more navigation options can be determined for the user and delivered to the user's mobile device at a relevant time. Navigation options can be selected based on the user's current location, the user's future plans, the time, and other locally relevant information, such as friends nearby or a nearby favorite location of the user. The navigation options can be delivered to the user's mobile device at a time that the navigation options are relevant.

Abstract: Methods and devices for causing a communications session between a first device and a second device to end based on lack of speech activity are described herein. In some embodiments, non-speech may be detected for both the first device and the second device. If the non-speech associated with the first device is determined to occur at a substantially same time as the non-speech associated with the second device, then this may indicate that no individuals are talking within earshot of their respective devices. Furthermore, the non-speech detected by the first device and the non-speech detected by the second device may both be of an amount of time that is greater than a predefined temporal threshold. If so, then the communications session may be caused to end because speech activity has not been detected by either device for more than the predefined temporal threshold.

Abstract: Methods and systems for providing message playback using a shared electronic device is described herein. In response to receiving a request to output messages, a speech-processing system may determine a group account associated with a requesting device, and may determine messages stored by a message data store for the group account. Speaker identification processing may also be performed to determine a speaker of the request. A user account associated with the speaker, and messages stored for the user account, may be determined. A summary response indicating the user account's messages and the group account's message may then be generated such that the user account messages are identified prior to the group account's messages. The messages may then be analyzed to determine an appropriate voice user interface for the requester such that the playback of the messages using a shared electronic device is more natural and conversational.

Abstract: Methods and devices for causing a communications session between a first device and a second device to end based on lack of speech activity are described herein. In some embodiments, a communications between a first device and a second device may be initiated by the first device, where a first user account associated with the first device is authorized to initiate communications session with the second device by a second user account. After the communications session is started, audio data is received by a speech activity detection system, which determines whether the audio data represents speech or non-speech. If, after the communications session begins, non-speech is detected by the first device for more than a predefined amount of time, then the communications session is caused to end so that the first device is not capable of receiving video and/or audio associated with the second device.

Abstract: Methods and systems for prioritizing messages for playback are described herein. In some embodiments, a request for messages to be output may be received by a speech-processing system. The speech-processing system may include a message database that includes messages received for a speaker of the request's user account and/or a group account associated with a shared electronic device that the request was received from. One or more prioritization rules may be applied to the messages to order the messages for playback in order to provide an optimal voice user interface for the requesting individual. For instance, messages received for the user account may be prioritized over messages received for the group account, messages received from a similar sender or a high priority sender may be prioritized over other messages, and messages that are indicating as being urgent may be prioritized over messages that are indicated as being non-urgent.

Abstract: Methods and systems for providing message playback using a shared electronic device is described herein. In response to receiving a request to output messages, a speech-processing system may determine a group account associated with a requesting device, and may determine messages stored by a message data store for the group account. Speaker identification processing may also be performed to determine a speaker of the request. A user account associated with the speaker, and messages stored for the user account, may be determined. A summary response indicating the user account's messages and the group account's message may then be generated such that the user account messages are identified prior to the group account's messages. The messages may then be analyzed to determine an appropriate voice user interface for the requester such that the playback of the messages using a shared electronic device is more natural and conversational.

Abstract: Methods and systems for redirecting messages based on contextual information associated with the messages are described herein. In some embodiments, a first individual may speak an utterance including a message, where the utterance indicates a first recipient for the message. Audio data representing the utterance may be provided to a speech-processing system, which may performed automatic speech recognition processing, natural language understanding processing, and contextual recognition processing to the audio data. In some embodiments, the contextual recognition processing may determine that the message may be intended for a second recipient. If so, the speech-processing system may cause the message to be redirected to the second recipient, such that the second recipient may receive the message as opposed to the first recipient.

Abstract: A system is configured to synchronize a first video, a second video, and an audio track. The system analyzes image content associated with the first video and the second video to obtain a first subset of images of the first video and a second subset of images of the second video. The system then determines a music beat of the audio track to be synchronized with one of the first subset of images or the second subset of images. The system then adjusts a framerate of the first subset of images or the second subset of images based on the determined music beat to synchronize the first subset of images or the second subset of images. The first subset of images and the second subset of images may then be combined, which the system then plays back from a designated playback slot along with the audio track.

Abstract: Systems, methods, and devices for escalating voice-based interactions via speech-controlled devices are described. Speech-controlled devices capture audio, including wakeword portions and payload portions, for sending to a server to relay messages between speech-controlled devices. In response to determining the occurrence of an escalation event, such as repeated messages between the same two devices, the system may automatically change a mode of a speech-controlled device, such as no longer requiring a wakeword, no longer requiring an indication of a desired recipient, or automatically connecting two speech-controlled devices in a voice-chat mode. In response to determining the occurrence of further escalation events, the system may initiate a real-time call between the speech-controlled devices.

Abstract: Methods and systems for facilitating communications between shared electronic devices are described herein. In some embodiments, a group account may be assigned to a shared electronic device. The group account may include one or more user accounts, where individuals associated with those user accounts may interact with the shared electronic device, and also may form a part of the group account. When a message is sent from one shared electronic device to another personal device or shared electronic device, the message may be indicated as being sent from the group account, as if the shared electronic device corresponds to its own separate account. In some embodiments, speaker identification processing may be employed to determine a speaker of the message and, if the speaker is able to be identified, the message may be sent from the corresponding speaker's user account instead of the shared electronic device's corresponding group account.

Abstract: Various embodiments enable a video messaging experience which permits the exchange of short video messages in an asynchronous manner. The video messaging experience preserves the video intimacy and experience of synchronous-type video communications, while at the same time provides the convenience of SMS-type message exchange.

Abstract: Systems, methods, and devices for outputting indications regarding voice-based interactions are described. A first speech-controlled device detects spoken audio corresponding to recipient information. The first device captures the audio and sends audio data corresponding to the captured audio to a server. The server determines a second speech-controlled device of the recipient and sends a signal to the recipient's second speech-controlled device representing a message is forthcoming. The recipient's second speech-controlled device outputs and indication representing a message is forthcoming.

Abstract: Systems, methods, and devices for outputting visual indications regarding voice-based interactions are described. A first speech-controlled device detects spoken audio corresponding to a voice message to a second speech-controlled device. The first device captures the audio and sends audio data corresponding to the captured audio to a server. The server performs speech processing on the audio data to determine a recipient and message content. The server then determines a second speech-controlled device associated with the recipient and sends the message content to the recipient's second speech-controlled device. Thereafter, the server receives an indication from the recipient's speech-controlled device that the second device is detecting speech, presumably in response to the original message. The server then causes a visual indication to be output by the first speech-controlled device, with the visual indication representing the recipient-speech controlled device is detecting speech.

Abstract: Systems, methods, and devices for escalating voice-based interactions via speech-controlled devices are described. Speech-controlled devices capture audio, including wakeword portions and payload portions, for sending to a server to relay messages between speech-controlled devices. In response to determining the occurrence of an escalation event, such as repeated messages between the same two devices, the system may automatically change a mode of a speech-controlled device, such as no longer requiring a wakeword, no longer requiring an indication of a desired recipient, or automatically connecting two speech-controlled devices in a voice-chat mode. In response to determining the occurrence of further escalation events, the system may initiate a real-time call between the speech-controlled devices.

Abstract: Various embodiments enable a video messaging experience which permits the exchange of short video messages in an asynchronous manner. The video messaging experience preserves the video intimacy and experience of synchronous-type video communications, while at the same time provides the convenience of SMS-type message exchange.

Abstract: Various embodiments enable a video messaging experience which permits the exchange of short video messages in an asynchronous manner. The video messaging experience preserves the video intimacy and experience of synchronous-type video communications, while at the same time provides the convenience of SMS-type message exchange.