Patents Examined by Jesse S Pullias
  • Media generating and editing system
    Patent number: 11170780
    Abstract: A media generating and editing system that generates audio playback in alignment with text that has been automatically transcribed from the audio. A transcript data file that includes a plurality of text words transcribed from audio words included in the audio data is stored. Timing data is paired with the text words indicating locations in the audio data of the corresponding audio words from which the text words are transcribed. The audio data is provided for playback at a user device. The text words are displayed on a display screen at a user device and a visual marker is displayed on the display screen to indicate the text words on the display screen in time alignment with the audio playback of the corresponding audio words at the user device. The text words in the transcript data file are amended in response to inputs from the user device.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: November 9, 2021
    Assignee: Trint Limited
    Inventors: Jeffrey Kofman, Mark Boas, Mark Panaghiston, Laurian Gridinoc
  • Virtual assistant device
    Patent number: 11170774
    Abstract: A device includes a screen and one or more processors configured to provide, at the screen, a graphical user interface (GUI) configured to display data associated with multiple devices on the screen. The GUI is also configured to illustrate a label and at least one control input for each device of the multiple devices. The GUI is also configured to provide feedback to a user. The feedback indicates that a verbal command is not recognized with an action to be performed. The GUI is also configured to provide instructions for the user on how to teach the one or more processors which action is to be performed in response to receiving the verbal command.
    Type: Grant
    Filed: May 21, 2019
    Date of Patent: November 9, 2021
    Assignee: Qualcomm Incorproated
    Inventors: Hye Jin Jang, Sungrack Yun, Kyu Woong Hwang
  • Wake word based on acoustic analysis
    Patent number: 11164563
    Abstract: A sound-enabled detection system responds to a wakeup sound, and notifies a central server. Based on which wakeup sound is detected; the system's configuration is modified accordingly. More particularly, at least one sensor in the system has its wakeup sound reconfigured to “wake up” upon detection of a second wakeup sound when the first wakeup sound is detected.
    Type: Grant
    Filed: December 17, 2019
    Date of Patent: November 2, 2021
    Assignee: MOTOROLA SOLUTIONS, INC.
    Inventors: Fabrice Saadoun, Nissim Gean, Kenneth A. Haas
  • Constrained natural language processing
    Patent number: 11157704
    Abstract: In general, techniques are described by which to provide constrained natural language processing. A device comprising a processor and a memory may be configured to perform the techniques. The processor may expose a language sub-surface specifying a natural language containment hierarchy defining a grammar for a natural language as a hierarchical arrangement of language sub-surfaces. The processor may also receive the data indicative of the input that conforms with the portion of the language provided by the exposed language sub-surface, and process the data indicative of the input to identify an intent of the user from a plurality of intents associated with the portion of the language. The processor may next execute a process associated with the identified intent to perform an operation. The memory may store the data indicative of the input.
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: October 26, 2021
    Assignee: DataChat.ai
    Inventors: Jignesh Patel, Navneet Sankara Potty
  • Machine translation using attention model and hypernetwork
    Patent number: 11151335
    Abstract: A machine translation method includes using an encoder of a source language to determine a feature vector from a source sentence expressed in the source language, using an attention model of a target language to determine context information of the source sentence from the determined feature vector, and using a decoder of the target language to determine a target sentence expressed in the target language from the determined context information.
    Type: Grant
    Filed: June 19, 2019
    Date of Patent: October 19, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Hwidong Na
  • Support for grammar inflections within a software development framework
    Patent number: 11151329
    Abstract: A natural language understanding server includes grammars specified in a modified extended Backus-Naur form (MEBNF) that includes an agglutination metasymbol not supported by conventional EBNF grammar parsers, as well as an agglutination preprocessor. The agglutination preprocessor applies one or more sets of agglutination rewrite rules to the MEBNF grammars, transforming them to EBNF grammars that can be processed by conventional EBNF grammar parsers. Permitting grammars to be specified in MEBNF form greatly simplifies the authoring and maintenance of grammars supporting inflected forms of words in the languages described by the grammars.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: October 19, 2021
    Assignee: SoundHound, Inc.
    Inventors: Bernard Mont-Reynaud, Seth Taron
  • Inaudible watermark enabled text-to-speech framework
    Patent number: 11138964
    Abstract: According to various embodiments, an end-to-end TTS framework can integrate a watermarking process into the training of the TTS framework, which enables watermarks to be imperceptible within a synthesized/cloned audio segment generated by the TTS framework. The watermarks added in such a matter are statistically undetectable to prevent authorized removal. According to an exemplary method of training the TTS framework, a TTS neural network model and a watermarking neural network mode in the TTS framework are trained in an end to end manner, with the watermarking being part of the optimization process of the TTS framework. During the training, neuron values of the TTS neural network model are adjusted based on training data to prepare one or more spaces for adding a watermark in a synthesized audio segment to be generated by the TTS framework.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: October 5, 2021
    Assignee: BAIDU USA LLC
    Inventors: Wei Ping, Zhenyu Zhong, Yueqiang Cheng, Xing Li, Tao Wei
  • Human emotion detection
    Patent number: 11138387
    Abstract: Disclosed herein are system, method, and computer program product embodiments for recognizing a human emotion in a message. An embodiment operates by receiving a message from a user. The embodiment labels each word of the message with a part of speech (POS) thereby creating a POS set. The embodiment determines an incongruity score for a combination of words in the POS set using a knowledgebase. The embodiment determines a preliminary emotion detection score for an emotion for the message based on the POS set. Finally, the embodiment calculates a final emotion detection score for the emotion for the message based on the preliminary emotion detection score and the incongruity score.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: October 5, 2021
    Assignee: Tucknologies Holdings, Inc.
    Inventors: Craig Tucker, Bryan Novak
  • Voice activity detection based on entropy-energy feature
    Patent number: 11138992
    Abstract: This application discloses a voice activity detection method. The method includes receiving speech data, the speech data including a multi-frame speech signal; determining energy and spectral entropy of a frame of speech signal; calculating a square root of the energy of the speech signal and/or calculating a square root of the spectral entropy of the frame of the speech signal; determining a spectral entropy-energy square root of the frame of the speech signal based on at least one of the square root of the energy and the square root of the spectral entropy; and determining that the frame of the speech signal is an unvoiced frame if the spectral entropy-energy square root of the speech signal is less than a first threshold, or that it is a voiced frame if the spectral entropy-energy square root of the speech signal is greater than or equal to the first threshold.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: October 5, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Jizhong Liu
  • Chinese composition reviewing system
    Patent number: 11132505
    Abstract: A Chinese composition reviewing system is provided and includes an identifying module, an analyzing module and a comprehending module. The identifying module identifies an abnormal phrase and an inappropriate punctuation mark of a target content by dividing a Chinese character into a Cangjie code. The analyzing module analyzes a sentence state of the target content and provides reference information when analyzing the sentence state. The comprehending module parses the target content via a predefined article mode, where the predefined article mode includes at least one of an article style, a word count, a paragraph count, a sentence count and a critical element. The Chinese composition reviewing system can evaluate the target content automatically.
    Type: Grant
    Filed: August 22, 2019
    Date of Patent: September 28, 2021
    Assignee: CULTURE COM TECHNOLOGY (MACAU), LIMITED
    Inventors: Bong-Foo Chu, Hung-Lien Shen
  • Intelligent summaries based on automated learning and contextual analysis of a user input
    Patent number: 11126796
    Abstract: The techniques provided herein improve existing systems by automatically generating summaries of a document in response to a user input that defines selected segments of a document. The document can include any type of content such as, but not limited to, channel conversations, chat threads, transcripts, word processing documents, spreadsheets, etc. As the user indicates a selection of segments, a system can dynamically update a summary of the segments to inform a user of salient information that is shared in the selected segments. A summary can include a text description of the information having a threshold priority level. A system can analyze documents that are referenced within the selected segments and provide summaries of the documents. The techniques disclosed herein also provide a number of graphical elements that communicate additional context of each part of the summary.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: September 21, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Shalendra Chhabra, Eric Randall Sexauer, Jason Thomas Faulkner
  • User-customized computer-automated translation
    Patent number: 11120219
    Abstract: A user-customized method, system and computer program for automated translation from a source language and a target language. The user's native language and accent are detected, from which a set of phonemes is determined which are those that are difficult to pronounce for that user based on his or her native language and accent. A translation engine is applied to translate a fragment of the source language input into target language output, wherein the translation is performed with reference to the synonym database for the target language so as to preferentially avoid word strings in the output that contain phonemes that exist in the user's set of difficult-to-pronounce phonemes.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: September 14, 2021
    Assignee: International Business Machines Corporation
    Inventors: Mustafa Alloh, Robert Huntington Grant, Hesham Mohamed Mohamed Ads, Jessica Mulder
  • Machine learning based intent resolution for a digital assistant
    Patent number: 11113476
    Abstract: Disclosed herein are system, method, and computer program product embodiments for training a machine learning model and using the machine learning model to determine an intent associated with an utterance. An embodiment operates by receiving an utterance, determining a first vector based on the received utterance, and determining a second vector based on the received utterance. A third vector is generated by concatenating the first vector and the second vector. The third vector is used to perform at least one of classifying, using a machine learning model, the utterance to determine the intent associated with the utterance or training the machine-learning model.
    Type: Grant
    Filed: June 12, 2019
    Date of Patent: September 7, 2021
    Assignee: SAP SE
    Inventor: Julian Seibel
  • Automated chatbot linguistic expression generation
    Patent number: 11106874
    Abstract: Linguistic expressions for training a chatbot can be generated in an automated system via linguistic expression templates that are associated with intents. The pre-categorized linguistic expressions can then be used for training and validation. Chatbot development can thus be improved by having a large number of expressions for development, leading to a more robust chatbot. In practice, the process can iterate with modifications to the templates until a suitable benchmark is met. The technique can be applied across human languages to generate chatbots conversant in any number of languages and is applicable to a variety of domains.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: August 31, 2021
    Assignee: SAP SE
    Inventor: Pablo Roisman
  • Event sensing system
    Patent number: 11100918
    Abstract: An event sensing system includes one or more sensor assemblies, each sensor assembly including a housing, a microphone, and an audio signal processor. The audio signal processor is configured to generate one of an event classification, which is indicative of a type of event, and an event characteristic, which is indicative of a severity of an event, from the audio signal. The sensor assembly is configured to transmit event records that contain the generated event data to a cloud infrastructure component. The cloud infrastructure component is configured to calculate the probability of an event occurring at a plurality of locations in a region within a bounded time window based on the event records received from a plurality of sensor assemblies.
    Type: Grant
    Filed: March 6, 2019
    Date of Patent: August 24, 2021
    Assignee: American Family Mutual Insurance Company, S.I.
    Inventors: Michael Smith, Ben Zimmerman, Sherry Eckholm, Peter Gunder
  • Post-processor, pre-processor, audio encoder, audio decoder and related methods for enhancing transient processing
    Patent number: 11094331
    Abstract: An audio post-processor for post-processing an audio signal having a time-variable high frequency gain information as side information includes: a band extractor for extracting a high frequency band of the audio signal and a low frequency band of the audio signal; a high band processor for performing a time-variable modification of the high frequency band in accordance with the time-variable high frequency gain information to obtain a processed high frequency band; and a combiner for combining the processed high frequency band and the low frequency band. Furthermore, a pre-processor is illustrated.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: August 17, 2021
    Inventors: Florin Ghido, Sascha Disch, Jürgen Herre, Alexander Adami, Franz Reutelhuber
  • User authentication for voice-input devices
    Patent number: 11087769
    Abstract: Techniques for authenticating users at devices that interact with the users via voice input. For instance, the described techniques may allow a voice-input device to safely verify the identity of a user by engaging in a back-and-forth conversation. The device or another device coupled thereto may then verify the accuracy of the responses from the user during the conversation, as well as compare an audio signature associated with the user's responses to a pre-stored audio signature associated with the user. By utilizing multiple checks, the described techniques are able to accurately and safely authenticate the user based solely on an audible conversation between the user and the voice-input device.
    Type: Grant
    Filed: January 3, 2018
    Date of Patent: August 10, 2021
    Assignee: Amazon Technologies, Inc.
    Inventor: Preethi Narayanan
  • Systems and methods for selecting a voice to use during a communication with a user
    Patent number: 11087736
    Abstract: A computing device having the capability to dynamically select a voice that will be used by a speech synthesizer in creating synthesized speech for use in communicating with a user of the computing device is provided. For example, in some embodiments, the computing device: i) employs the speech synthesizer to have a first audible communication with the user using a first voice; ii) stores user satisfaction data that can be used to determine a user's satisfaction with an action the user took in response to the first audible communication; and iii) determines whether a different voice should be used during a second audible communication with the user based on the stored user satisfaction data.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: August 10, 2021
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Matthew John Lawrenson, Julian Charles Nolan
  • Auto-completion for multi-modal user input in assistant systems
    Patent number: 11087756
    Abstract: In one embodiment, a method includes receiving an initial input in a first modality from a first user from a client system associated with the first user, determining one or more intents corresponding to the initial input by an intent-understanding module, generating one or more candidate continuation-inputs based on the one or more intents, where the one or more candidate continuation-inputs are in one or more candidate modalities, respectively, and wherein the candidate modalities are different from the first modality, and sending instructions for presenting one or more suggested inputs corresponding to one or more of the candidate continuation-inputs to the client system.
    Type: Grant
    Filed: April 19, 2019
    Date of Patent: August 10, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: William Crosby Presant, Francislav P. Penov, Anuj Kumar
  • Systems and methods for comprehensive Chinese speech scoring and diagnosis
    Patent number: 11081102
    Abstract: Systems and methods for scoring spoken Chinese are provided. In an exemplary method, a user reads a written transcript and the user's voice is recorded. Characters of the transcript are then represented as pinyins with tone markings. The voice recording is sectioned into individual phonemes that are aligned with the phonemes of the pinyins. For each character of the transcript, a tone is determined for the phonemes in the voice recording corresponding to that character. That tone is scored as correct or incorrect by comparison to the tone marking associated with the pinyins for that character. The pronunciation of each phoneme of the voice recording is also scored relative to the corresponding phonemes of the pinyins of the characters of the transcript. Further scores for words and sentences can be developed from the tone and pronunciation scores and provided to the user with feedback.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: August 3, 2021
    Assignee: Ponddy Education Inc.
    Inventors: Franz C. Chen, Ming Lung Chen, George Yang, Chen-Wen Chung, Ke-Chih Ning