Abstract: Systems and methods for preemptive wakeword detection are disclosed. For example, a first part of a wakeword is detected from audio data representing a user utterance. When this occurs, on-device speech processing is initiated prior to when the entire wakeword is detected. When the entire wakeword is detected, results from the on-device speech processing and/or the audio data is sent to a speech processing system to determine a responsive action to be performed by the device. When the entire wakeword is not detected, on-device processing is canceled and the device refrains from sending the audio data to the speech processing system.

Abstract: This disclosure describes techniques and systems for encoding instructions in audio data that, when output on a speaker of a first device in an environment, cause a second device to output content in the environment. In some instances, the audio data has a frequency that is inaudible to users in the environment. Thus, the first device is able to cause the second device to output the content without users in the environment hearing the instructions. In some instances, the first device also outputs content, and the content output by the second device is played at an offset relative to a position of the content output by the first device.

Abstract: Systems and methods for preemptive wakeword detection are disclosed. For example, a first part of a wakeword is detected from audio data representing a user utterance. When this occurs, on-device speech processing is initiated prior to when the entire wakeword is detected. When the entire wakeword is detected, results from the on-device speech processing and/or the audio data is sent to a speech processing system to determine a responsive action to be performed by the device. When the entire wakeword is not detected, on-device processing is canceled and the device refrains from sending the audio data to the speech processing system.

Abstract: Coordinated operation of a voice-controlled device and an accessory device in an environment is described. A remote system processes audio data it receives from the voice-controlled device in the environment to identify a first intent associated with a first domain, a second intent associated with a second domain, and a named entity associated with the audio data. The remote system sends, to the voice-controlled device, first information for accessing main content associated with the named entity, and a first instruction corresponding to the first intent. The remote system also sends, to the accessory device, second information for accessing control information or supplemental content associated with the main content, and a second instruction corresponding to the second intent. The first and second instructions, when processed by the devices in the environment, cause coordinated operation of the voice-controlled device and the accessory device.

Abstract: This disclosure proposes systems and methods for speech processing and sharing permitted entity information across speech processing systems. A first system can receive first audio data representing a first utterance. The first system can receive a first dialog identifier associated with a previous utterance. The first system can determine that the first audio data references a first entity. In some cases, the first system may not be able to resolve the first entity based on information in the first audio data. The first system can send, to a second system different from the first system, a first request for information about the first entity. The first request includes the first dialog identifier. The first system can receive first data responsive to the first request from the second system. The first system can process the first data and the first audio data to determine second data responsive to the first utterance, and output a first response representing the second data.

Abstract: This disclosure describes techniques and systems for encoding instructions in audio data that, when output on a speaker of a first device in an environment, cause a second device to output content in the environment. In some instances, the audio data has a frequency that is inaudible to users in the environment. Thus, the first device is able to cause the second device to output the content without users in the environment hearing the instructions. In some instances, the first device also outputs content, and the content output by the second device is played at an offset relative to a position of the content output by the first device.

Abstract: Systems and methods for viseme data generation are disclosed. Uncompressed audio data is generated and/or utilized to determine the beats per minute of the audio data. Visemes are associated with the audio data utilizing a Viterbi algorithm and the beats per minute. A time-stamped list of viseme data is generated that associates the visemes with the portions of the audio data that they correspond to. An animatronic toy and/or an animation is caused to lip sync using the viseme data while audio corresponding to the audio data is output.

Abstract: Coordinated operation of a voice-controlled device and an accessory device in an environment is described. A remote system processes audio data it receives from the voice-controlled device in the environment to identify a first intent associated with a first domain, a second intent associated with a second domain, and a named entity associated with the audio data. The remote system sends, to the voice-controlled device, first information for accessing main content associated with the named entity, and a first instruction corresponding to the first intent. The remote system also sends, to the accessory device, second information for accessing control information or supplemental content associated with the main content, and a second instruction corresponding to the second intent. The first and second instructions, when processed by the devices in the environment, cause coordinated operation of the voice-controlled device and the accessory device.

Abstract: This disclosure describes, in part, techniques implemented by a speech-processing system for providing an extensible skill-interface component to facilitate voice-control of third-party developer devices. The speech-processing system may provide the skill-interface component to third-party device developers using a web-based portal through which the skill interfaces may be created to voice-enable third-party devices having unique capabilities. For instance, a skill interface may define events, such as voice commands of a user, which map to directives configured to cause the third-party devices to perform an operation that is responsive to the event. In this way, the speech-processing system may receive audio data representing a voice command of a user in an environment of a third-party device, and return a directive to cause the third-party device to perform an operation responsive to the voice command.

Abstract: This disclosure describes techniques and systems for encoding instructions in audio data that, when output on a speaker of a first device in an environment, cause a second device to output content in the environment. In some instances, the audio data has a frequency that is inaudible to users in the environment. Thus, the first device is able to cause the second device to output the content without users in the environment hearing the instructions. In some instances, the first device also outputs content, and the content output by the second device is played at an offset relative to a position of the content output by the first device.

Abstract: This disclosure describes techniques and systems for encoding instructions in audio data that, when output on a speaker of a first device in an environment, cause a second device to output content in the environment. In some instances, the audio data has a frequency that is inaudible to users in the environment. Thus, the first device is able to cause the second device to output the content without users in the environment hearing the instructions. In some instances, the first device also outputs content, and the content output by the second device is played at an offset relative to a position of the content output by the first device.

Abstract: Systems and methods for viseme data generation are disclosed. Uncompressed audio data is generated and/or utilized to determine the beats per minute of the audio data. Visemes are associated with the audio data utilizing a Viterbi algorithm and the beats per minute. A time-stamped list of viseme data is generated that associates the visemes with the portions of the audio data that they correspond to. An animatronic toy and/or an animation is caused to lip sync using the viseme data while audio corresponding to the audio data is output.

Abstract: This disclosure describes systems, devices, and techniques for causing an accessory device to present predefined lighting sequences. In some instances, the accessory device is a battery-powered device that includes a wireless radio, an actuatable button, and one or more lighting elements. The accessory device may receive a lighting-sequence schema specifying how to illuminate the lighting elements as well as trigger event upon which to present the lighting sequence. The accessory device may store the received schema and, upon identifying the specified trigger event, may present the corresponding lighting sequence on the lighting elements.

Abstract: Coordinated operation of a voice-controlled device and an accessory device in an environment is described. A remote system processes audio data it receives from the voice-controlled device in the environment to identify a first intent associated with a first domain, a second intent associated with a second domain, and a named entity associated with the audio data. The remote system sends, to the voice-controlled device, first information for accessing main content associated with the named entity, and a first instruction corresponding to the first intent. The remote system also sends, to the accessory device, second information for accessing control information or supplemental content associated with the main content, and a second instruction corresponding to the second intent. The first and second instructions, when processed by the devices in the environment, cause coordinated operation of the voice-controlled device and the accessory device.

Abstract: This disclosure describes techniques and systems for encoding instructions in audio data that, when output on a speaker of a first device in an environment, cause a second device to output content in the environment. In some instances, the audio data has a frequency that is inaudible to users in the environment. Thus, the first device is able to cause the second device to output the content without users in the environment hearing the instructions. In some instances, the first device also outputs content, and the content output by the second device is played at an offset relative to a position of the content output by the first device.

Abstract: This disclosure describes systems, devices, and techniques for selecting a device in an environment to act as a communication hub for other devices in the environment. For instance, an environment may include two or more devices that are configured to communicate with one another as well as with remote resources (e.g., Internet-available resources, etc.). In one example, the devices each include a first radio configured to communication over a wireless local area network (WLAN) and a second radio configured to communicate over a short-range wireless communication network, such as Bluetooth, ZigBee, Z-Wave, or the like. A device having a highest battery life may be selected as the communication hub for the devices, such that the other non-hub devices may therefore route messages through the hub using their short-range radios. In addition, the non-hub devices may power off their WLAN radios, thus conserving battery life of these devices.

Abstract: This disclosure describes systems, devices, and techniques for causing an accessory device to present predefined lighting sequences. In some instances, the accessory device is a battery-powered device that includes a wireless radio, an actuatable button, and one or more lighting elements. The accessory device may receive a lighting-sequence schema specifying how to illuminate the lighting elements as well as trigger event upon which to present the lighting sequence. The accessory device may store the received schema and, upon identifying the specified trigger event, may present the corresponding lighting sequence on the lighting elements.

Abstract: Coordinated operation of a voice-controlled device and an accessory device in an environment is described. A remote system processes audio data it receives from the voice-controlled device in the environment to identify a first intent associated with a first domain, a second intent associated with a second domain, and a named entity associated with the audio data. The remote system sends, to the voice-controlled device, first information for accessing main content associated with the named entity, and a first instruction corresponding to the first intent. The remote system also sends, to the accessory device, second information for accessing control information or supplemental content associated with the main content, and a second instruction corresponding to the second intent. The first and second instructions, when processed by the devices in the environment, cause coordinated operation of the voice-controlled device and the accessory device.

Abstract: This disclosure describes systems, devices, and techniques for causing an accessory device to present predefined lighting sequences. In some instances, the accessory device is a battery-powered device that includes a wireless radio, an actuatable button, and one or more lighting elements. The accessory device may receive a lighting-sequence schema specifying how to illuminate the lighting elements as well as trigger event upon which to present the lighting sequence. The accessory device may store the received schema and, upon identifying the specified trigger event, may present the corresponding lighting sequence on the lighting elements.

Abstract: A method for selecting test devices in a service provider environment may include receiving a request for performing a test on a device, the request specifying at least one parameter for the test. A list of available devices may be obtained. The list of available devices may be filtered to generate a list of candidate hardware devices that meet the at least one parameter for the test. Using a first set of operations, current state information for each of the candidate devices may be obtained. Using a second set of operations, at least one weight may be assigned to the current state information to generate weighted state information for each of the candidate devices. Device scores may be generated using the weighted state information. Based on the scores, one of the candidate devices may be selected for performing the test.