Abstract: A speech interface device is configured to defer encryption of audio data on-device until a time when the encryption operation is not competing with other computationally-intensive operations for responding to the audio data. For example, audio data based on sound captured in an environment of the speech interface device can be stored in volatile memory of the speech interface device, without encrypting it, until a set of processing operations (e.g., ASR processing, NLU processing, audio event processing, etc.) performed based on the audio data have stopped. Based on a determination that these processing operations for responding to the audio data have stopped, the logic may encrypt the audio data to generate encrypted data, and the encrypted data can be stored in non-volatile memory of the speech interface device for uploading to a remote system when a connection is available.

Abstract: A speech interface device is configured to update personalized data in local memory for responding to user speech. The speech interface device may receive compiled personalized data from a remote system, or raw personalized data from local devices in the environment of the speech interface device, the raw personalized data being compiled locally on the speech interface device. The compiled personalized data is received by an artifact manager of the speech interface device for storage in the memory of the speech interface device. A local speech processing component of the speech interface device may use the compiled personalized data when processing user speech in order to understand a spoken form of a word or phrase that is associated with a user. This allows for responding to personal user speech, even when the speech interface device is unable to communicate with a remote speech processing system over a wide area network.

Abstract: Techniques for performing spoken language understanding (SLU) processing locally on a user device are described. When a user device is about to present content on a display, the user device may generate one or more SLU models (e.g., one or more ASR models and/or one or more NLU models) specific to the content to be presented. When the user device receives a spoken input while the content is being presented on the display, the user device performs SLU processing on the spoken input using the display-specific SLU model(s).

Abstract: A speech interface device is configured to defer encryption of audio data on-device until a time when the encryption operation is not competing with other computationally-intensive operations for responding to the audio data. For example, audio data based on sound captured in an environment of the speech interface device can be stored in volatile memory of the speech interface device, without encrypting it, until a set of processing operations (e.g., ASR processing, NLU processing, audio event processing, etc.) performed based on the audio data have stopped. Based on a determination that these processing operations for responding to the audio data have stopped, the logic may encrypt the audio data to generate encrypted data, and the encrypted data can be stored in non-volatile memory of the speech interface device for uploading to a remote system when a connection is available.