Abstract: Implementations described herein relate to distributed processing of sign language input(s) and/or other gestures across multiple computing devices. For example, processor(s) of client device can receive user input that visually indicates a gesture and an identity of a user; generate, based on processing the user input, anonymized data that indicates the gesture of the user and that anonymizes the personal identity of the user; transmit a subset of the anonymized data to a computing device (e.g., a remote server or another client device); receive a natural language interpretation of the gesture of the user from the computing device; and perform an action based on the natural language interpretation of the gesture of the user. Notably, processor(s) of the computing device can generate the natural language interpretation of the gesture of the user and based on processing the subset of the anonymized data.

Abstract: Implementations described herein relate to an automated assistant that is responsive to sign language commands and can provide feedback to assist a user with efficiently controlling the automated assistant using sign language. When the user is initially detected, and/or the automated assistant otherwise determines that the user intends to invoke the automated assistant, the automated assistant can render graphical output and/or a depiction of one or both hands of the user (or a representation thereof). In some implementations, this depiction can be a static representation of hands, or a dynamic representation (e.g., an avatar) that mimics the movement of one or both hands of the user. When the user provides a sign language command, an American Sign Language (ASL) Gloss interpretation (or corresponding natural language interpretation thereof) can be rendered at the display interface, along with any autocomplete suggestions and/or suggestions for other commands.