Abstract: An infotainment system of a vehicle includes: a primary intent module configured to determine a primary intent included in voice input using automated speech recognition (ASR); and an execution module configured to, via a first hardware output device of the vehicle, execute the primary intent. A secondary intent module is configured to: based on the primary intent, determine a first domain of the primary intent; based on the first domain of the primary intent, determine a second domain; and based on the voice input and the second domain, determine a secondary intent included in the voice input using ASR. A display control module is configured to display a request for user input indicative of whether to execute the secondary intent. The execution module is further configured to, via a second hardware output device of the vehicle, execute the secondary intent in response to user input to execute the secondary intent.

Abstract: A method for recognizing speech in a vehicle includes receiving speech at a microphone installed to a vehicle, and determining whether the speech includes a navigation instruction. If the speech includes a navigation instruction, the speech may be sent to a remote facility. After sending the speech to the remote facility, a local speech recognition result is provided in the vehicle to the user. The speech sent to the remote facility may be used to provide corrective action. A system for recognizing speech in a vehicle may include a microphone, and may be configured to determine a local speech recognition result from the speech command and determine when the speech command includes a navigation instruction. The system may further include a remote server in communication with the vehicle that receives a sample of the speech command from the speech recognition system when the speech command includes a navigation instruction.

Abstract: A system and method of recognizing speech in a vehicle. The method includes receiving a voice command at the vehicle via a microphone in the vehicle, and obtaining a recognition result from speech recognition performed on the received voice command. The recognition result may represent the voice command and be indicative of any of two or more available vehicle commands. The method may further include selecting one of the two or more available vehicle commands based on a secondary characteristic and an attribute of the selected one of the vehicle commands. The system may be implemented as vehicle electronics that include a microphone located within the vehicle and configured to receive a voice command from a user located within the vehicle, and a controller in communication with the microphone. The controller may be configured to perform speech recognition on the voice command and obtain a disambiguated recognition result.

Abstract: In various embodiments, methods, systems, and vehicles are provided. The system includes a sensor, a memory, and a processor. The sensor is configured to obtain a request from a user. The memory is configured to store voice assistant data pertaining to respective skills of a plurality of different voice assistants. The processor is configured to at least facilitate: identifying a nature of the request; identifying a selected voice assistant, from the plurality of different voice assistants, having skills that are most appropriate for the request, based on the nature of the request and the voice assistant data; and facilitating communication with the selected voice assistant to provide assistance in accordance with the request.

Abstract: In certain embodiments, methods, systems, and vehicles are provided for controlling information for a user. One or more sensors are configured to obtain one or more inputs from the user, the one or more inputs pertaining to a drawing made by the user on a display corresponding to a geographic region of interest for the user. A processor is configured to at least facilitate identifying the geographic region of interest based on the one or more inputs; and providing instructions for the providing of the information pertaining to one or more points of interest within the identified geographic region based on the one or more inputs.

Abstract: In various embodiments, methods, systems, and vehicles are provided. The system includes a microphone and a processor. The microphone is configured to obtain a request from a user. The processor is configured to at least facilitate automatically generating an interpretation of the request; automatically determining an automated processing recognition score for the request; and automatically engaging a human advisor to further process the request, based on the determined automated processing recognition score.

Abstract: A processor receives a broadcast in a vehicle, select audio data from the broadcast, processes the audio data selected from the broadcast, determines a phonetic pattern of the selected audio data based on the processing, selects additional instances of audio data from the broadcast that resemble the selected audio data, processes the additional instances of audio data from the broadcast, determine phonetic patterns of the additional instances of audio data, and selects a plurality of phonetic patterns from the phonetic pattern of the selected audio data and the phonetic patterns of the additional instances of audio data. A transmitter transmits the plurality of phonetic patterns to a server to determine an optimal pronunciation of the selected audio data based on a statistical analysis of the plurality of phonetic patterns and to add the optimal pronunciation of the selected audio data to a database used to recognize speech in the vehicle.

Abstract: A system and method of performing speech arbitration at a client device that includes a neural network speech arbitration application, wherein the neural network speech arbitration application is configured to implement a neural network speech arbitration process, and wherein the method includes: receiving speech signals at a client device; generating and/or obtaining a set of inputs to be used in a speech arbitration neural network process, wherein the speech arbitration neural network process uses a neural network model that is tailored to speech arbitration and that can be used to determine whether and/or to what extent speech recognition processing of the received speech signals should be carried out at the client device; and receiving a speech arbitration output that indicates whether and/or to what extent the speech recognition processing of the received speech signals is to be carried out at the client device or at the remote server.

Abstract: A system and method of generating a natural language generation (NLG) output, wherein the method includes: receiving speech signals from a user at a microphone of a client device; determining a requested communication goal and at least one inputted communication value based on the received speech signals; determining to use a static natural language generation (NLG) template or a dynamic NLG template to generate an NLG output, wherein the determination of whether to use a static NLG template or a dynamic NLG template is made using a neural network NLG template selection process; selecting an NLG template after the determination of whether to use a static NLG template or a dynamic NLG template; and generating an NLG output based on the selected NLG template.

Abstract: One general aspect includes a method for detecting one or more cues in conversational speech, the method including: recognizing (via a controller) a conversation between a vehicle occupant and at least one third party; reviewing silently (via the controller) the conversation in real-time; receiving (at a controller) from the vehicle occupant or the third party a speech cue made during the conversation; in response to the received speech cue, retrieving suggestion information based on the silent review of the conversation (via the controller) from one or more suggestion databases; providing (via the controller) an audio announcement of the suggestion information configured to be announced through an audio system located in a vehicle.

Abstract: One general aspect includes a system for responsive activation of a vehicle feature for a vehicle, the system includes: an audio system configured to announce information and the vehicle feature; a memory configured to include one or more executable instructions; a controller configured to execute the executable instructions, and where the executable instructions enable the controller to: receive speech inputs from a vehicle occupant located in the vehicle, the speech inputs regarding the vehicle feature; retrieve vehicle feature information from vehicle feature information databases, in response to the received speech inputs; provide audio description information for the vehicle feature information; determine whether at least one received speech input includes a feature activation request; provide vehicle feature activation information to the vehicle feature, in response to a positive determination that the at least one received speech input includes the feature activation request.

Abstract: One general aspect includes a system for responsive activation of a vehicle feature for a vehicle, the system includes: an audio system configured to announce information and the vehicle feature; a memory configured to include one or more executable instructions; a controller configured to execute the executable instructions, and where the executable instructions enable the controller to: receive speech inputs from a vehicle occupant located in the vehicle, the speech inputs regarding the vehicle feature; retrieve vehicle feature information from vehicle feature information databases, in response to the received speech inputs; provide audio description information for the vehicle feature information; determine whether at least one received speech input includes a feature activation request; provide vehicle feature activation information to the vehicle feature, in response to a positive determination that the at least one received speech input includes the feature activation request.

Abstract: A system and method of processing disfluent speech at an automatic speech recognition (ASR) system includes: receiving speech from a speaker via a microphone; determining the received speech includes disfluent speech; accessing a disfluent speech grammar or acoustic model in response to the determination; and processing the received speech using the disfluent speech grammar.

Abstract: A processor receives a broadcast in a vehicle, select audio data from the broadcast, processes the audio data selected from the broadcast, determines a phonetic pattern of the selected audio data based on the processing, selects additional instances of audio data from the broadcast that resemble the selected audio data, processes the additional instances of audio data from the broadcast, determine phonetic patterns of the additional instances of audio data, and selects a plurality of phonetic patterns from the phonetic pattern of the selected audio data and the phonetic patterns of the additional instances of audio data. A transmitter transmits the plurality of phonetic patterns to a server to determine an optimal pronunciation of the selected audio data based on a statistical analysis of the plurality of phonetic patterns and to add the optimal pronunciation of the selected audio data to a database used to recognize speech in the vehicle.

Abstract: Methods and systems are provided for radio data system (RDS) feed data in a vehicle. In one embodiment, a method includes: receiving, by a processor, RDS feed data; processing, by a processor, the RDS feed data to determine a classification of the RDS feed data to be at least one of active programming and advertisement; and storing, by a processor, information extracted from the RDS feed data based on the classification.

Abstract: A system and method of changing features of an existing automatic speech recognition (ASR) system includes: monitoring speech received from a vehicle occupant for one or more keywords identifying a feature to remove from or add to the ASR system; detecting the keywords in the monitored speech; and adding the identified feature to or removing the identified feature from from the ASR system.

Abstract: A system and method of adjusting digital audio sampling used with wideband audio includes: performing audio sampling on an analog audio signal at an initial sampling rate and an initial bit rate over a wideband audio frequency range; generating a digital audio signal based on the audio sampling; detecting a qualitative error rate between the analog audio signal and the digital audio signal; and decreasing the initial sampling rate, the initial bit rate, or both for sampling subsequent analog audio when the qualitative error is below a threshold.

Abstract: A method for recognizing speech in a vehicle includes receiving speech at a microphone installed to a vehicle, and determining whether the speech includes a navigation instruction. If the speech includes a navigation instruction, the speech may be sent to a remote facility. After sending the speech to the remote facility, a local speech recognition result is provided in the vehicle to the user. The speech sent to the remote facility may be used to provide corrective action. A system for recognizing speech in a vehicle may include a microphone, and may be configured to determine a local speech recognition result from the speech command and determine when the speech command includes a navigation instruction. The system may further include a remote server in communication with the vehicle that receives a sample of the speech command from the speech recognition system when the speech command includes a navigation instruction.

Abstract: An infotainment system of a vehicle includes: a primary intent module configured to determine a primary intent included in voice input using automated speech recognition (ASR); and an execution module configured to, via a first hardware output device of the vehicle, execute the primary intent. A secondary intent module is configured to: based on the primary intent, determine a first domain of the primary intent; based on the first domain of the primary intent, determine a second domain; and based on the voice input and the second domain, determine a secondary intent included in the voice input using ASR. A display control module is configured to display a request for user input indicative of whether to execute the secondary intent. The execution module is further configured to, via a second hardware output device of the vehicle, execute the secondary intent in response to user input to execute the secondary intent.

Abstract: A method of choosing a nametag using automatic speech recognition (ASR) includes: receiving a spoken nametag via a microphone; performing a first speech recognition analysis on the spoken nametag; determining that the first speech recognition analysis outputs only handheld wireless device nametags; performing a second speech recognition analysis that excludes the handheld wireless device nametags stored at the handheld wireless device; and combining the results of the first speech recognition analysis and the second speech recognition analysis.