Abstract: Techniques for performing speech processing using multi-modal widget information are described. A system may receive input data corresponding to a user input. The system may also receive widget context data corresponding to one or more multi-modal widgets active at a device. The system may use the widget context data to perform natural language understanding (NLU) processing with respect to the user input, and for selecting a skill component for responding to the user input. The system may send a widget identifier to the skill component when invoking the skill to respond to the user input.

Abstract: Techniques for performing speech processing using multi-modal widget information are described. A system may receive input data corresponding to a user input. The system may also receive widget context data corresponding to one or more multi-modal widgets active at a device. The system may use the widget context data to perform natural language understanding (NLU) processing with respect to the user input, and for selecting a skill component for responding to the user input. The system may send a widget identifier to the skill component when invoking the skill to respond to the user input.

Abstract: Techniques for session-based device grouping are described. In an example, a computer system receives first data requesting an output, determines a function to provide content data based at least in part on the first data, determines a session identifier of a session associated with execution of the function, and determines session data associated with the session identifier. The session data includes a first device identifier of a first device, an indication that the first device is outputting the content data, and a second device identifier of a second device. The computer system also causes, based at least in part on the session data including the second device identifier, the second device to output the content data.