Abstract: The technology is directed to a system that enhances input(s) received from a device. The system analyzes the input to extract features such as acoustic properties and expressive parameters. The system upscales the input based on the extracted features and translates the enhanced audio into text while maintaining the original context and satisfying predetermined language guidelines. The system generates synthesized speech that preserves the context of the original input and presents the synthesized speech via a speaker of the device. The system can process communications containing hybrid multimodal inputs by identifying the communication mode of each input and extracting contextual features from the multimodal inputs. The system generates a message for communication by translating the extracted contextual features into a predefined communication format and presents the message via the device.

Abstract: The technology is directed to a system that enhances input(s) received from a device. The system analyzes the input to extract features such as acoustic properties and expressive parameters. The system upscales the input based on the extracted features and translates the enhanced audio into text while maintaining the original context and satisfying predetermined language guidelines. The system generates synthesized speech that preserves the context of the original input and presents the synthesized speech via a speaker of the device. The system can process communications containing hybrid multimodal inputs by identifying the communication mode of each input and extracting contextual features from the multimodal inputs. The system generates a message for communication by translating the extracted contextual features into a predefined communication format and presents the message via the device.

Abstract: The technology is directed to a system that enhances input(s) received from a device. The system analyzes the input to extract features such as acoustic properties and expressive parameters. The system upscales the input based on the extracted features and translates the enhanced audio into text while maintaining the original context and satisfying predetermined language guidelines. The system generates synthesized speech that preserves the context of the original input and presents the synthesized speech via a speaker of the device. The system can process communications containing hybrid multimodal inputs by identifying the communication mode of each input and extracting contextual features from the multimodal inputs. The system generates a message for communication by translating the extracted contextual features into a predefined communication format and presents the message via the device.

Abstract: System and methods for routing requests for both assisted communications and non-assisted communications with devices operated by deaf or hard-of-hearing (DHH) users using a single number are described. A network component may determine whether to use routing that directs such requests to an assistance system based on the type of communications requested and one or more identifiers in a request. If a communications request includes a DHH user device's identifier and communications type that are represented in assistance routing data, the network component may forward that request to an assistance system. Otherwise, the network component may route such a request normally. A DHH user may request a suspension of the assistance routing for a period of time and/or until reinstatement of the assistance routing is requested.