Patents Assigned to SoundHound AI IP, LLC
-
Publication number: 20240331702Abstract: Methods and systems for enabling an efficient review of meeting content via a metadata-enriched, speaker-attributed transcript are disclosed. By incorporating speaker diarization and other metadata, the system can provide a structured and effective way to review and/or edit the transcript. One type of metadata can be image or video data to represent the meeting content. Furthermore, the present subject matter utilizes a multimodal diarization model to identify and label different speakers. The system can synchronize various sources of data, e.g., audio channel data, voice feature vectors, acoustic beamforming, image identification, and extrinsic data, to implement speaker diarization.Type: ApplicationFiled: June 14, 2024Publication date: October 3, 2024Applicant: SoundHound AI IP, LLC.Inventors: Kiersten L. BRADLEY, Ethan COEYTAUX, Ziming YIN
-
Patent number: 12086564Abstract: A system and method for masking an identity of a speaker of natural language speech, such as speech clips to be labeled by humans in a system generating voice transcriptions for training an automatic speech recognition model. The natural language speech is morphed prior to being presented to the human for labeling. In one embodiment, morphing comprises pitch shifting the speech randomly either up or down, then frequency shifting the speech, then pitch shifting the speech in a direction opposite the first pitch shift. Labeling the morphed speech comprises at least one or more of transcribing the morphed speech, identifying a gender of the speaker, identifying an accent of the speaker, and identifying a noise type of the morphed speech.Type: GrantFiled: November 30, 2021Date of Patent: September 10, 2024Assignee: SoundHound AI IP, LLC.Inventor: Dylan H. Ross
-
Publication number: 20240296197Abstract: As audio (1) is input to an extension of a browser, the extension transmits the audio (1) to a language processing server. A speech recognition unit obtains a text (1) corresponding to the audio (1), and transmits the text (1) to a natural language understanding unit. In the natural language understanding unit, an information processing unit identifies a URL (1) corresponding to the text (1), and transmits the URL (1) to the browser. The extension passes the URL (1) to a browsing function. The browsing function uses the URL (1) to access a web server. The web server transmits a web page (1) corresponding to the URL (1) to the browser. The browsing function shows a screen corresponding to the web page (1) on a display.Type: ApplicationFiled: May 13, 2024Publication date: September 5, 2024Applicant: SoundHound AI IP, LLC.Inventors: Masaki NAITO, Keisuke TSUCHIDA, Jun YONEYAMA, Kaku SAWADA
-
Patent number: 12080275Abstract: Systems for automatic speech recognition and/or natural language understanding automatically learn new words by finding subsequences of phonemes that, if they were a new word, would enable a successful tokenization of a phoneme sequence. Systems can learn alternate pronunciations of words by finding phoneme sequences with a small edit distance to existing pronunciations. Systems can learn the part of speech of words by finding part-of-speech variations that would enable parses by syntactic grammars. Systems can learn what types of entities a word describes by finding sentences that could be parsed by a semantic grammar but for the words not being on an entity list.Type: GrantFiled: January 11, 2021Date of Patent: September 3, 2024Assignee: SoundHound AI IP, LLC.Inventor: Anton V. Relin
-
Patent number: 12067006Abstract: A machine learning system for a digital assistant is described, together with a method of training such a system. The machine learning system is based on an encoder-decoder sequence-to-sequence neural network architecture trained to map input sequence data to output sequence data, where the input sequence data relates to an initial query and the output sequence data represents canonical data representation for the query. The method of training involves generating a training dataset for the machine learning system. The method involves clustering vector representations of the query data samples to generate canonical-query original-query pairs in training the machine learning system.Type: GrantFiled: June 17, 2021Date of Patent: August 20, 2024Assignee: SoundHound AI IP, LLC.Inventors: Pranav Singh, Yilun Zhang, Keyvan Mohajer, Mohammadreza Fazeli
-
Patent number: 12051403Abstract: A server supports multiple virtual assistants. It receives requests that include wake phrase audio and an identification of the source of the request, such as a virtual assistant device. Based on the identification, the server searches a database for a wake phrase detector appropriate for the identified source. The server then applies the wake phrase detector to the received wake phrase audio. If the wake phrase audio triggers the wake phrase detector, the server provides an appropriate response to the source.Type: GrantFiled: January 26, 2022Date of Patent: July 30, 2024Assignee: SoundHound AI IP, LLC.Inventors: Newton Jain, Sameer Syed Zaheer
-
Publication number: 20240212678Abstract: A voice interface recognizes spoken utterances from multiple users. It responds to the utterances in ways such as modifying the attributes of instances of items. The voice interface computes a voice vector for each utterance and associates it with the item instance that is modified. For following utterances with a closely matching voice vector, the voice interface modifies the same instance. For following utterances with a voice vector that is not a close match to one stored for any item instance, the voice interface modifies a different item instance.Type: ApplicationFiled: December 21, 2023Publication date: June 27, 2024Applicant: SoundHound AI IP, LLCInventors: Robert Macrae, Jon Grossman, Scott Halstvedt
-
Patent number: 12020696Abstract: [Object] Technology is provided to enable a mobile terminal to function as a digital assistant even when the mobile terminal is in a state where it cannot communicate with a server apparatus. [Solution] When a user terminal 200 receives a query A from a user, user terminal 200 sends query A to a server 100. Server 100 interprets the meaning of query A using a grammar A. Server 100 obtains a response to query A based on the meaning of query A and sends the response to user terminal 200. Server 100 further sends grammar A to user terminal 200. That is, server 100 sends to user terminal 200 a grammar used to interpret the query received from user terminal 200.Type: GrantFiled: October 21, 2019Date of Patent: June 25, 2024Assignee: SoundHound AI IP, LLCInventor: Karl Stahl
-
Patent number: 12020708Abstract: Methods and systems for enabling an efficient review of meeting content via a metadata-enriched, speaker-attributed transcript are disclosed. By incorporating speaker diarization and other metadata, the system can provide a structured and effective way to review and/or edit the transcript. One type of metadata can be image or video data to represent the meeting content. Furthermore, the present subject matter utilizes a multimodal diarization model to identify and label different speakers. The system can synchronize various sources of data, e.g., audio channel data, voice feature vectors, acoustic beamforming, image identification, and extrinsic data, to implement speaker diarization.Type: GrantFiled: October 11, 2021Date of Patent: June 25, 2024Assignee: SoundHound AI IP, LLC.Inventors: Kiersten L. Bradley, Ethan Coeytaux, Ziming Yin
-
Patent number: 12013862Abstract: The technology disclosed relates to natural language understanding-based search engines, ranking sponsored search results and simulated ranking of sponsored search results. Tools and methods describe how to simulate the ranking of sponsored search results. The tools further identify instances of user queries within the scope of trigger patterns, optionally providing examples both of user queries for which a sponsored search result is likely to be displayed and examples for which the sponsored search result will not rank highly enough to be displayed, at least on the first page of search results.Type: GrantFiled: December 27, 2019Date of Patent: June 18, 2024Assignee: SoundHound AI IP, LLCInventors: Bernard Mont-Reynaud, Keyvan Mohajer, Kamyar Mohajer, Chris Wilson
-
Patent number: 12008991Abstract: A user specifies a natural language command to a device. Software on the device generates contextual metadata about the user interface of the device, such as data about all visible elements of the user interface, and sends the contextual metadata along with the natural language command to a natural language understanding engine. The natural language understanding engine parses the natural language query using a stored grammar (e.g., a grammar provided by a maker of the device) and as a result of the parsing identifies information about the command (e.g., the user interface elements referenced by the command) and provides that information to the device. The device uses that provided information to respond to the command.Type: GrantFiled: May 27, 2021Date of Patent: June 11, 2024Assignee: SoundHound AI IP, LLCInventors: Utku Yabas, Philipp Hubert, Karl Stahl
-
Publication number: 20240185853Abstract: Natural language grammars interpret expressions at the conversational human-machine interfaces of devices. Under conditions favoring engagement, as specified in a unit of conversational code, the device initiates a discussion using one or more of TTS, images, video, audio, and animation depending on the device capabilities of screen and audio output. Conversational code units specify conditions based on conversation state, mood, and privacy. Grammars provide intents that cause calls to system functions. Units can provide scripts for guiding the conversation. The device, or supporting server system, can provide feedback to creators of the conversational code units for analysis and machine learning.Type: ApplicationFiled: February 13, 2024Publication date: June 6, 2024Applicant: SoundHound AI IP, LLCInventors: Joel McKENZIE, Qindi ZHANG
-
Patent number: 11997448Abstract: A voice-controlled device includes a microphone to receive a set of sound waves that includes speech uttered by a user and other sound, and to output a first audio signal that includes a contribution from the speech uttered by the user and a contribution from the other sound. The device also includes a receiver to receive an electromagnetic signal and to output a second audio signal obtained from the electromagnetic signal. An audio pre-processor of the device processes the first audio signal using the second audio signal to reduce the contribution from the other sound in a processed audio signal. The voice-controlled device then provides the processed audio signal to a speech recognition module to determine a voice command issued by the user.Type: GrantFiled: April 3, 2023Date of Patent: May 28, 2024Assignee: SOUNDHOUND AI IP, LLCInventor: Karl Stahl
-
Patent number: 11978454Abstract: A system for performing automated speech recognition (ASR) on audio data includes a queue manager to receive a request to perform ASR on audio data, add the request to a queue of incoming requests, and determine a queue depth representing a number of requests in the queue at a given time. The system also includes a load supervisor to receive the request and the queue depth from the queue manager and assign a service level for the request based on the queue depth. In addition, the system includes a speech-to-text converter to receive the assigned service level for the request from the load supervisor, select an ASR model for the request based on the received service level, receive the audio data associated with the request, and perform ASR on the audio data using the selected ASR model.Type: GrantFiled: September 16, 2021Date of Patent: May 7, 2024Assignee: SOUNDHOUND AI IP, LLCInventors: Timothy P. Stonehocker, Zizu Gowayyed, Matthias Eichstaedt, Seyed Majid Emami, Evelyn Jiang, Ryan Berryhill, Mathieu Ramona, Neil Veira
-
Patent number: 11948571Abstract: A system and method are disclosed capable of parsing a spoken utterance into a natural language request and a speech audio segment, where the natural language request directs the system to use the speech audio segment as a new wakeword. In response to this wakeword assignment directive, the system and method are further capable of immediately building a new wakeword spotter to activate the device upon matching the new wakeword in the input audio. Different approaches to promptly building a new wakeword spotter are described. Variations of wakeword assignment directives can make the new wakeword public or private. They can also add the new wakeword to earlier wakewords, or replace earlier wakewords.Type: GrantFiled: March 30, 2022Date of Patent: April 2, 2024Assignee: SoundHound AI IP, LLCInventor: Bernard Mont-Reynaud
-
Patent number: 11922939Abstract: A system and method are disclosed for ignoring a wakeword received at a speech-enabled listening device when it is determined the wakeword is reproduced audio from an audio-playing device. Determination can be by detecting audio distortions, by an ignore flag sent locally between an audio-playing device and speech-enabled device, by and ignore flag sent from a server, by comparison of received audio played audio to a wakeword within an audio-playing device or a speech-enabled device, and other means.Type: GrantFiled: May 4, 2022Date of Patent: March 5, 2024Assignee: SoundHound AI IP, LLCInventors: Hsuan Yang, Qindí Zhãng, Warren S. Heit
-
Publication number: 20240073161Abstract: [Object] To provide a technique for more accurate interpretation of a message inputted by a user. [Solving Means] An information processing server 300 obtains a first message from a user in a thread 001, has a context of the first message stored in a context database 500 in association with the thread 001, obtains a second message from the user in the thread 001, and provides the second message to a conversation server 400 together with the context of the first message.Type: ApplicationFiled: August 25, 2023Publication date: February 29, 2024Applicant: SoundHound AI IP, LLC.Inventors: Yuki Matsuda, Keisuke Tsuchida
-
Publication number: 20240054297Abstract: Aspects include methods, systems, and computer-program products providing virtual assistant domain functionality. A natural language query including one or more words is received. A collection of natural language modules is accessed. The collection natural language modules are configured to process sets of natural language queries. A natural language module, from the collection of natural language modules, is identified to interpret the natural language query. An interpretation of the natural language query is computed using the identified natural language module. A response to the natural language query is returned using the computed interpretation.Type: ApplicationFiled: October 24, 2023Publication date: February 15, 2024Applicant: SoundHound AI IP, LLCInventors: Kamyar Mohajer, Keyvan Mohajer, Bernard Mont-Reynaud, Pranav Singh
-
Patent number: 11900928Abstract: Natural language grammars interpret expressions at the conversational human-machine interfaces of devices. Under conditions favoring engagement, as specified in a unit of conversational code, the device initiates a discussion using one or more of TTS, images, video, audio, and animation depending on the device capabilities of screen and audio output. Conversational code units specify conditions based on conversation state, mood, and privacy. Grammars provide intents that cause calls to system functions. Units can provide scripts for guiding the conversation. The device, or supporting server system, can provide feedback to creators of the conversational code units for analysis and machine learning.Type: GrantFiled: December 23, 2017Date of Patent: February 13, 2024Assignee: SoundHound AI IP, LLCInventors: Joel McKenzie, Qindi Zhang
-
Publication number: 20240046918Abstract: A system and method invoke virtual assistant action, which may comprise an argument. From audio, a probability of an intent is inferred. A probability of a domain and a plurality of variable values may also be inferred. Invoking the action is in response to the intent probability exceeding a threshold. Invoking the action may also be in response to the domain probability exceeding a threshold, a variable value probability exceeding a threshold, detecting an end of utterance, and a specific amount of time having elapsed. The intent probability may increase when the audio includes speech of words with the same meaning in multiple natural languages. Invoking the action may also be conditional on the variable value exceeding its threshold within a certain period of time of the intent probability exceeding its threshold.Type: ApplicationFiled: September 26, 2023Publication date: February 8, 2024Applicant: SoundHound AI IP, LLCInventors: Sudharsan Krishnaswamy, Maisy Wieman, Jonah Probell