Abstract: In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.

Abstract: A method includes receiving acoustic features and phonetic features associated with an utterance from a driver in a vehicle, providing the acoustic features and the phonetic features to a feature fusion sub-network, receiving a feature fusion utterance representation from the feature fusion sub-network, providing one of the acoustic features or the phonetic features to a non-fusion sub-network trained using supervised learning, receiving a non-fusion utterance representation from the non-fusion sub-network, generating an intermediate utterance representation based on the feature fusion utterance representation and the non-fusion utterance representation, providing at least a portion of the intermediate utterance representation to a fully-connected sub-network trained using supervised learning, receiving a valence vector from the fully-connected sub-network, and causing a vehicle control system to perform a vehicle maneuver based on the valence vector.

Abstract: The present disclosure provides a method that includes receiving acoustic features and phonetic features associated with an utterance from a driver in a vehicle with a vehicle control system, providing the plurality of acoustic features and the plurality of phonetic features to a feature fusion sub-network, receiving a feature fusion utterance representation from the feature fusion sub-network, providing one of the plurality of acoustic features or the plurality of phonetic features to a non-fusion sub-network trained using supervised learning, receiving a non-fusion utterance representation from the non-fusion sub-network, generating an intermediate utterance representation based on the feature fusion utterance representation and the non-fusion utterance representation, providing at least a portion of the intermediate utterance representation to a fully-connected sub-network trained using supervised learning, receiving a valence vector from the fully-connected sub-network, and causing the vehicle control sys