Subportions Patents (Class 704/254)
-
Patent number: 11810568Abstract: A computer-implemented method for transcribing an utterance includes receiving, at a computing system, speech data that characterizes an utterance of a user. A first set of candidate transcriptions of the utterance can be generated using a static class-based language model that includes a plurality of classes that are each populated with class-based terms selected independently of the utterance or the user. The computing system can then determine whether the first set of candidate transcriptions includes class-based terms. Based on whether the first set of candidate transcriptions includes class-based terms, the computing system can determine whether to generate a dynamic class-based language model that includes at least one class that is populated with class-based terms selected based on a context associated with at least one of the utterance and the user.Type: GrantFiled: December 10, 2020Date of Patent: November 7, 2023Assignee: Google LLCInventors: Petar Aleksic, Pedro J. Moreno Mengibar
-
Patent number: 11783830Abstract: Various embodiments contemplate systems and methods for performing automatic speech recognition (ASR) and natural language understanding (NLU) that enable high accuracy recognition and understanding of freely spoken utterances which may contain proper names and similar entities. The proper name entities may contain or be comprised wholly of words that are not present in the vocabularies of these systems as normally constituted. Recognition of the other words in the utterances in question, e.g. words that are not part of the proper name entities, may occur at regular, high recognition accuracy. Various embodiments provide as output not only accurately transcribed running text of the complete utterance, but also a symbolic representation of the meaning of the input, including appropriate symbolic representations of proper name entities, adequate to allow a computer system to respond appropriately to the spoken request without further analysis of the user's input.Type: GrantFiled: May 26, 2021Date of Patent: October 10, 2023Assignee: Promptu Systems CorporationInventor: Harry William Printz
-
Patent number: 11763100Abstract: A system is provided comprising a processor and a memory storing instructions which configure the processor to process an original sentence structure through an encoder neural network to decompose the original sentence structure into an original semantics component and an original syntax component, process the original syntax component through a syntax variation autoencoder (VAE) to receive a syntax mean vector and a syntax covariance matrix, obtain a sampled syntax value from a syntax Gaussian posterior parameterized by the syntax mean vector and the syntax covariance matrix, process the original semantics component through a semantics VAE to receive a semantics mean vector and a semantics covariance matrix, obtain a sampled semantics vector from the Gaussian semantics posterior parameterized by the semantics mean vector and the semantics covariance matrix, and process the sampled syntax vector and the sampled semantics vector through a decoder neural network to compose a new sentence.Type: GrantFiled: May 22, 2020Date of Patent: September 19, 2023Assignee: ROYAL BANK OF CANADAInventors: Peng Xu, Yanshuai Cao, Jackie C. K. Cheung
-
Patent number: 11735191Abstract: This application describes methods and apparatus for speaker recognition. An apparatus according to an embodiment has an analyzer for analyzing each frame of a sequence of frames of audio data which correspond to speech sounds uttered by a user to determine at least one characteristic of the speech sound of that frame. An assessment module determines, for each frame of audio data, a contribution indicator of the extent to which that frame of audio data should be used for speaker recognition processing based on the determined characteristic of the speech sound. Said contribution indicator comprises a weighting to be applied to each frame in the speaker recognition processing. In this way frames which correspond to speech sounds that are of most use for speaker discrimination may be emphasized and/or frames which correspond to speech sounds that are of least use for speaker discrimination may be de-emphasized.Type: GrantFiled: June 25, 2019Date of Patent: August 22, 2023Assignee: Cirrus Logic, Inc.Inventors: John Paul Lesso, John Laurence Melanson
-
Patent number: 11735167Abstract: Disclosed is an electronic device recognizing an utterance voice in units of individual characters. The electronic device includes: a voice receiver; and a processor configured to: obtain a recognition character converted from a character section of a user voice received through the voice receiver, and recognize a candidate character having high acoustic feature related similarity with the character section among a plurality of acquired candidate characters as an utterance character of the character section based on a confusion possibility with the acquired recognition character.Type: GrantFiled: November 24, 2020Date of Patent: August 22, 2023Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jihun Park, Dongheon Seok
-
Patent number: 11704089Abstract: A display device according to an embodiment of the present invention may comprise: a display unit for displaying a content image; a microphone for receiving voice commands from a user; a network interface unit for communicating with a natural language processing server and a search server; and a control unit for transmitting the received voice commands to the natural language processing server, receiving intention analysis result information indicating the user's intention corresponding to the voice commands from the natural language processing server, and performing a function of the display device according to the received intention analysis result information.Type: GrantFiled: January 11, 2021Date of Patent: July 18, 2023Assignee: LG ELECTRONICS INC.Inventors: Sunki Min, Kiwoong Lee, Hyangjin Lee, Jeean Chang, Seunghyun Heo, Jaekyung Lee
-
Patent number: 11676073Abstract: Methods, apparatus, systems, and articles of manufacture are disclosed that analyze performance of manufacturer independent devices. An example apparatus includes a software development kit (SDK) deployment engine to deploy an SDK to a manufacturer of a device, the SDK to define heartbeat data to be collected from the device and interfacing techniques to transmit the heartbeat data to a measurement entity. In some examples, the apparatus includes a machine learning engine to predict whether the device is associated with one or more failure modes. The example apparatus also includes an alert generator to generate an alert based on a prediction, the alert to indicate at least one of a type of a first one of the failure modes or at least one component of the device to be remedied according to the first one of the one or more failure modes, and transmit the alert to a management agent.Type: GrantFiled: July 12, 2021Date of Patent: June 13, 2023Assignee: The Nielsen Company (US), LLCInventors: John T. Livoti, Susan Cimino, Stanley Wellington Woodruff, Rajakumar Madhanganesh, Alok Garg
-
Patent number: 11657799Abstract: Techniques performed by a data processing system for training a Recurrent Neural Network Transducer (RNN-T) herein include encoder pretraining by training a neural network-based token classification model using first token-aligned training data representing a plurality of utterances, where each utterance is associated with a plurality of frames of audio data and tokens representing each utterance are aligned with frame boundaries of the plurality of audio frames; obtaining first cross-entropy (CE) criterion from the token classification model, wherein the CE criterion represent a divergence between expected outputs and reference outputs of the model; pretraining an encoder of an RNN-T based on the first CE criterion; and training the RNN-T with second training data after pretraining the encoder of the RNN-T. These techniques also include whole-network pre-training of the RNN-T.Type: GrantFiled: April 3, 2020Date of Patent: May 23, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong, Hu Hu
-
Patent number: 11636146Abstract: Methods and apparatus for improving speech recognition accuracy in media content searches are described. An advertisement for a media content item is analyzed to identify keywords that may describe the media content item. The identified keywords are associated with the media content item for use during a voice search to locate the media content item. A user may speak the one or more of the keywords as a search input and be provided with the media content item as a result of the search.Type: GrantFiled: September 23, 2019Date of Patent: April 25, 2023Assignee: Comcast Cable Communications, LLCInventor: George Thomas Des Jardins
-
Patent number: 11600284Abstract: A voice morphing apparatus having adjustable parameters is described. The disclosed system and method include a voice morphing apparatus that morphs input audio to mask a speaker's identity. Parameter adjustment uses evaluation of an objective function that is based on the input audio and output of the voice morphing apparatus. The voice morphing apparatus includes objectives that are based adversarially on speaker identification and positively on audio fidelity. Thus, the voice morphing apparatus is adjusted to reduce identifiability of speakers while maintaining fidelity of the morphed audio. The voice morphing apparatus may be used as part of an automatic speech recognition system.Type: GrantFiled: January 11, 2020Date of Patent: March 7, 2023Assignee: SOUNDHOUND, INC.Inventor: Steve Pearson
-
Patent number: 11593621Abstract: An information processing apparatus according to an embodiment includes one or more hardware processors. The hardware processors obtain a first categorical distribution sequence corresponding to first input data and obtain a second categorical distribution sequence corresponding to second input data neighboring the first input data, by using a prediction model outputting a categorical distribution sequence representing a sequence of L categorical distributions for a single input data piece, where, L is a natural number of two or more. The hardware processors calculate, for each i of 1 to L, an inter-distribution distance between i-th categorical distributions in the first and second categorical distribution sequences. The hardware processors calculate a sum of L inter-distribution distances. The hardware processors update the prediction model's parameters to lessen the sum.Type: GrantFiled: January 24, 2020Date of Patent: February 28, 2023Assignees: KABUSHIKI KAISHA TOSHIBA, TOSHIBA DIGITAL SOLUTIONS CORPORATIONInventor: Ryohei Tanaka
-
Patent number: 11574127Abstract: Systems and methods for training a classifier binary model of a natural language understanding (NLU) system are disclosed herein. A determination is made as to whether a text string, with a content entity, includes an obsequious expression. In response to determining the text string includes an obsequious expression, a determination is made as to whether the obsequious expression describes the content entity. The model is trained based on a determination of at least one of: an absence of an obsequious expression in response to determining the obsequious expression describes the content entity; a presence of an obsequious expression in response to determining the obsequious expression describes the content entity; an absence of an obsequious expression in response to determining the obsequious expression does not describe the content entity, and a presence of an obsequious expression in response to determining the obsequious expression does not describe the content entity.Type: GrantFiled: February 28, 2020Date of Patent: February 7, 2023Assignee: Rovi Guides, Inc.Inventors: Jeffry Copps Robert Jose, Mithun Umesh
-
Patent number: 11574012Abstract: The present application provides an error correction method and device for search terms. The method comprises: identifying an incorrect search term; calculating weighted edit distances between the search term and pre-obtained hot terms by using a weighted edit distance algorithm, wherein, during the calculation of the weighted edit distances, different weights are set respectively for the following operations of transforming from the search term to the hot terms: an operation of inserting characters, an operation of deleting characters, an operation of replacing by characters with similar appearance or pronunciation, an operation of replacing by characters with dissimilar appearance or pronunciation, and an operation of exchanging characters; and selecting a predetermined number of hot terms based on the weighted edit distances and popularity of the hot terms for error correction prompt. The method and device of the present application can improve the error correction accuracy of error search terms.Type: GrantFiled: August 14, 2017Date of Patent: February 7, 2023Assignee: BEIJING QIYI CENTURY SCIENCE & TECHNOLOGY CO., LTD.Inventors: Jun Hu, Yingjie Chen, Tianchang Wang, Chengcan Ye
-
Patent number: 11557286Abstract: A speech recognition method includes receiving speech data, obtaining, from the received speech data, a candidate text including at least one word and a phonetic symbol sequence associated with a pronunciation of a target word included in the received speech data, using a speech recognition model, replacing the phonetic symbol sequence included in the candidate text with a replacement word corresponding to the phonetic symbol sequence, and determining a target text corresponding to the received speech data based on a result of the replacing.Type: GrantFiled: December 30, 2019Date of Patent: January 17, 2023Assignee: Samsung Electronics Co., Ltd.Inventor: Jihyun Lee
-
Patent number: 11557280Abstract: Implementations relate to techniques for providing context-dependent search results. A computer-implemented method includes receiving an audio stream at a computing device during a time interval, the audio stream comprising user speech data and background audio, separating the audio stream into a first substream that includes the user speech data and a second substream that includes the background audio, identifying concepts related to the background audio, generating a set of terms related to the identified concepts, influencing a speech recognizer based on at least one of the terms related to the background audio, and obtaining a recognized version of the user speech data using the speech recognizer.Type: GrantFiled: November 23, 2020Date of Patent: January 17, 2023Assignee: Google LLCInventors: Jason Sanders, Gabriel Taubman, John J. Lee
-
Patent number: 11557274Abstract: Embodiments may provide improved techniques to assess model checkpoint stability on unseen data on-the-fly, so as to prevent unstable checkpoints from being saved, and to avoid or reduce the need for an expensive thorough evaluation. For example, a method may comprise passing a set of input sequences through a checkpoint of a sequence to sequence model in inference mode to obtain a set of generated sequences of feature vectors, determining whether each of a plurality of generated sequences of feature vectors is complete, counting a number of incomplete generated sequences of feature vectors among the plurality of generated sequences of feature vectors, generating a score indicating a stability of the model based on the count of incomplete generated sequences of feature vectors, and storing the model checkpoint when the score indicating the stability of the model is above a predetermined threshold.Type: GrantFiled: March 15, 2021Date of Patent: January 17, 2023Assignee: International Business Machines CorporationInventor: Vyacheslav Shechtman
-
Patent number: 11537950Abstract: This disclosure describes one or more implementations of a text sequence labeling system that accurately and efficiently utilize a joint-learning self-distillation approach to improve text sequence labeling machine-learning models. For example, in various implementations, the text sequence labeling system trains a text sequence labeling machine-learning teacher model to generate text sequence labels. The text sequence labeling system then creates and trains a text sequence labeling machine-learning student model utilizing the training and the output of the teacher model. Upon the student model achieving improved results over the teacher model, the text sequence labeling system re-initializes the teacher model with the learned model parameters of the student model and repeats the above joint-learning self-distillation framework. The text sequence labeling system then utilizes a trained text sequence labeling model to generate text sequence labels from input documents.Type: GrantFiled: October 14, 2020Date of Patent: December 27, 2022Assignee: Adobe Inc.Inventors: Trung Bui, Tuan Manh Lai, Quan Tran, Doo Soon Kim
-
Patent number: 11538470Abstract: A system includes at least one communication interface, at least one processor operatively connected to the at least one communication interface, and at least one memory operatively connected to the at least one processor and storing a plurality of natural language understanding (NLU) models. The at least one memory stores instructions that, when executed, cause the processor to receive first information associated with a user from an external electronic device associated with a user account, using the at least one communication interface, to select at least one of the plurality of NLU models, based on at least part of the first information, and to transmit the selected at least one NLU model to the external electronic device, using the at least one communication interface such that the external electronic device uses the selected at least one NLU model for natural language processing.Type: GrantFiled: June 29, 2020Date of Patent: December 27, 2022Assignee: Samsung Electronics Co., Ltd.Inventors: Sean Minsung Kim, Jaeyung Yeo
-
Patent number: 11538488Abstract: Embodiments of the present disclosure provide methods and systems for processing a speech signal. The method can include: processing the speech signal to generate a plurality of speech frames; generating a first number of acoustic features based on the plurality of speech frames using a frame shift at a given frequency; and generating a second number of posteriori probability vectors based on the first number of acoustic features using an acoustic model, wherein each of the posteriori probability vectors comprises probabilities of the acoustic features corresponding to a plurality of modeling units, respectively.Type: GrantFiled: November 27, 2019Date of Patent: December 27, 2022Assignee: Alibaba Group Holding LimitedInventors: Shiliang Zhang, Ming Lei, Wei Li, Haitao Yao
-
Patent number: 11508355Abstract: Systems and methods are disclosed herein for discerning aspects of user speech to determine user intent and/or other acoustic features of a sound input without the use of an ASR engine. To this end, a processor may receive a sound signal comprising raw acoustic data from a client device, and divides the data into acoustic units. The processor feeds the acoustic units through a first machine learning model to obtain a first output and determines a first mapping, using the first output, of each respective acoustic unit to a plurality of candidate representations of the respective acoustic unit. The processor feeds each candidate representation of the plurality through a second machine learning model to obtain a second output, determines a second mapping, using the second output, of each candidate representation to a known condition, and determines a label for the sound signal based on the second mapping.Type: GrantFiled: October 26, 2018Date of Patent: November 22, 2022Assignee: Interactions LLCInventors: Ryan Price, Srinivas Bangalore
-
Patent number: 11495228Abstract: An apparatus including a user input receiver; a user voice input receiver; a display; and a processor. The processor is configured to: (a) based on a user input being received through the user input receiver, perform a function corresponding to voice input state for receiving a user voice input; (b) receive a user voice input through the user voice input receiver; (c) identify whether or not a text corresponding to the received user voice input is related to a pre-registered voice command or a prohibited expression; and (d) based on the text being related to the pre-registered voice command or the prohibited expression, control the display to display an indicator that the text is related to the pre-registered voice command or the prohibited expression. A method and non-transitory computer-readable medium are also provided.Type: GrantFiled: November 30, 2020Date of Patent: November 8, 2022Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Nam-yeong Kwon, Kyung-mi Park
-
Patent number: 11495224Abstract: Methods and systems for performing contact resolution are described herein. When initiating a communications session using a voice activated electronic device, a contact name may be resolved to determine an appropriate contact with which the communications session may be directed to. Contacts from an individual's contact list may be queried to determine a listing of probable contacts associated with the contact name, and contact identifiers associated with the contact may be determined. Using one or more rules for disambiguating between similar contact names, a single contact may be identified, and a communications session with that contact may be initiated.Type: GrantFiled: May 19, 2020Date of Patent: November 8, 2022Assignee: Amazon Technologies, Inc.Inventors: Someshwaran Elangovan, Aparna Nandyal, Venkatesh Kancharla, Arun Rajendran, Sumedha Arvind Kshirsagar, Christopher Geiger Parker
-
Patent number: 11481556Abstract: A naming support system is provided that includes a processing unit that receives first language name information input from a user, determines name evaluation's basic information about the first language name information, and generates and transmits name's evaluation information to an output unit based on a target language which includes at least one of a plurality of languages for the name evaluation's basic information, wherein the first language name information includes at least one of character notation information of a first language name, pronunciation information of a first language name, or desired information for a first language name, and the name evaluation's basic information includes the first language name information.Type: GrantFiled: April 29, 2020Date of Patent: October 25, 2022Inventor: Chul Hwan Jung
-
Patent number: 11454567Abstract: The present disclosure relates to a fault diagnosis method of a reciprocating machinery based on a keyphasor-free complete-cycle signal. The method includes the following steps: 1) building a complete-cycle vibration signal image library; 2) training an image recognition model; 3) acquiring a complete-cycle data on a keyphasor-free basis; 4) building an automatic feature extraction model; and 5) inputting a hidden layer feature of an autoencoder into a support vector machine (SVM) classifier to obtain a diagnosis result. By using a deep cascade convolutional neural network (CNN), the present disclosure achieves the goal of complete-cycle data acquisition on a keyphasor-free basis, solves the problems that traditional intelligent fault diagnosis relies on a keyphasor signal and real-time diagnosis fails due to insufficient installation space. In addition, by using an autoencoder for automatic feature extraction, the present disclosure avoids manual feature selection, reduces labor costs.Type: GrantFiled: February 2, 2021Date of Patent: September 27, 2022Assignee: Beijing University of Chemical TechnologyInventors: Jinjie Zhang, Zhinong Jiang, Haipeng Zhao, Zhiwei Mao, Kun Chang
-
Patent number: 11450327Abstract: Systems and methods for identifying potential bullying are disclosed. In various aspects, a system for identifying potential bullying includes a sound detector configured to provide samples of sounds over time, a processor, and a memory storing instructions. The instructions, when executed by the processor, cause the system to determine that a noise event has occurred by processing the samples to determine that the sounds exceed a sound level threshold over a time period that exceeds a time period threshold, process the samples to provide frequency spectrum information of the noise event, determine whether the noise event is a potential bullying occurrence based on comparing the frequency spectrum information of the noise event and at least one frequency spectrum profile, and initiate a bullying notification in a case of determining that the noise event is a potential bullying occurrence.Type: GrantFiled: April 20, 2021Date of Patent: September 20, 2022Assignee: SOTER TECHNOLOGIES, LLCInventor: Cary Chu
-
Patent number: 11443735Abstract: Disclosed are a method and a device for generating a filled pause detection model using a small amount of speech data included in a new domain in a 5G communication environment by executing artificial intelligence (AI) algorithms and/or machine learning algorithms provided therein. According to the present disclosure, the filled pause detection model generating method for a new domain may include constructing a filled pause detection model for the new domain, determining the initial model parameter for the filled pause detection model for the new domain by combining model parameters for filled pause detection models of a plurality of existing domains, and training the filled pause detection model of the new domain in which initial model parameter is set, using speech data from the new domain as training data.Type: GrantFiled: March 2, 2020Date of Patent: September 13, 2022Assignee: LG ELECTRONICS INC.Inventor: Yun Jin Lee
-
Patent number: 11423906Abstract: A method, computer system, and computer readable medium are provided for automatic speech recognition. Video data and audio data corresponding to one or more speakers is received. A minimum variance distortionless response function is applied to the received audio and video data. A predicted target waveform corresponding to a target speaker from among the one or more speakers is generated based on back-propagating the output of the applied minimum variance distortionless response function.Type: GrantFiled: July 10, 2020Date of Patent: August 23, 2022Assignee: TENCENT AMERICA LLCInventors: Yong Xu, Meng Yu, Shi-Xiong Zhang, Chao Weng, Jianming Liu, Dong Yu
-
Patent number: 11417342Abstract: An apparatus includes a communication interface and a processor. The processor is configured to receive, via the communication interface, a plurality of speech samples {um0}, m=1 . . . M, which were uttered by a subject while in a first state with respect to a disease, and using {um0} and at least one reference discriminator, which is not specific to the subject, synthesize a subject-specific discriminator, which is specific to the subject and is configured to generate, in response to one or more test utterances uttered by the subject, an output indicating a likelihood that the subject is in a second state with respect to the disease. Other embodiments are also described.Type: GrantFiled: June 29, 2020Date of Patent: August 16, 2022Assignee: CORDIO MEDICAL LTD.Inventor: Ilan D. Shallom
-
Patent number: 11403961Abstract: A public speaking trainer has a computer system including a display monitor. A microphone is coupled to the computer system. A video capture device is coupled to the computer system. A biometric device is coupled to the computer system. A simulated environment including a simulated audience member is rendered on the display monitor using the computer system. A presentation is recorded onto the computer system using the microphone and video capture device. A first feature of the presentation is extracted based on data from the microphone and video capture device while recording the presentation. A metric is calculated based on the first feature. The simulated audience member is animated in response to a change in the metric. A score is generated based on the metric. The score is displayed on the display monitor of the computer system after recording the presentation. A training video is suggested based on the score.Type: GrantFiled: September 6, 2019Date of Patent: August 2, 2022Assignee: PITCHVANTAGE LLCInventors: Anindya Gupta, Yegor Makhiboroda, Brad H. Story
-
Patent number: 11398243Abstract: A method for analyzing a voice sample of a subject to determine a cardiac condition, for example, an arrhythmic condition, comprising extracting at least one voice feature from the voice sample, detecting an effect of the cardiac condition on the at least one voice feature and determining the cardiac condition based on the effect. Disclosed is also a system for determining the cardiac condition in the voice sample provided by the subject. Related apparatus and methods are also described.Type: GrantFiled: February 12, 2018Date of Patent: July 26, 2022Assignee: CardioKol Ltd.Inventors: Yirmiyahu Hauptman, Alon Goren, Eli Attar, Pinhas Sabach
-
Patent number: 11393455Abstract: Systems and methods for generating a query using a trained natural language model of a natural language understanding (NLU) system are disclosed herein. A text string including at least a content entity is received. A determination is made as to whether the text string includes an obsequious expression. In response to determining the text string includes an obsequious expression, a determination is made as to whether the obsequious expression describes the content entity. In response to determining whether the obsequious expression describes the content entity, the query is generated. In response to determining the obsequious expression describes the content entity, the content entity and the obsequious expression are included in the query and in response to determining the obsequious expression does not describe the content entity, the content entity is included in the query and the obsequious expression is excluded from the query.Type: GrantFiled: February 28, 2020Date of Patent: July 19, 2022Assignee: ROVI GUIDES, INC.Inventors: Jeffry Copps Robert Jose, Mithun Umesh
-
Patent number: 11392771Abstract: Systems and methods for training a natural language model of a natural language understanding (NLU) system are disclosed herein. A text string including at least a content entity is received. A determination is made as to whether the text string includes an obsequious expression. In response to determining the text string includes an obsequious expression, a determination is made as to whether the obsequious expression describes the content entity. A query is forwarded in response to determining the text string includes an obsequious expression and in determining the obsequious expression describes the content entity. In response to determining the obsequious expression describes the content entity, the query includes the obsequious expression and in response to determining the obsequious expression does not describe the content entity, the query does not include the obsequious expression.Type: GrantFiled: February 28, 2020Date of Patent: July 19, 2022Assignee: Rovi Guides, Inc.Inventors: Jeffry Copps Robert Jose, Mithun Umesh
-
Patent number: 11386899Abstract: A system and method for providing real-time feedback of remote collaborative communication includes: processing first audio signals to extract first speech-related features therefrom; processing first EEG signals to extract first brain activity features therefrom; processing second audio signals to extract second speech-related features therefrom; processing second EEG signals to extract second brain activity features therefrom; processing the first and second speech-related features to determine if the speech from the first and second users exhibits positive or negative vocal entrainment; processing the first and second brain activity features to determine if the brain activity of the first and second users is aligned or misaligned; and generating feedback, on at least one display device, that indicates if the speech from the first and second users exhibits positive or negative vocal entrainment and if the brain activity of the first and second users is aligned or misaligned.Type: GrantFiled: August 4, 2020Date of Patent: July 12, 2022Assignee: HONEYWELL INTERNATIONAL INC.Inventors: Nichola Lubold, Santosh Mathan
-
Patent number: 11355122Abstract: In some examples, a software agent executing on a server an utterance from a customer. The software agent converts the utterance to text. The software agent creates an audio representation of the text and performs a comparison of the audio representation and the utterance. The software agent creates edited text based on the comparison. For example, the software agent may determine, based on the comparison, audio differences between the audio representation and the utterance, create a sequence of edit actions based on the audio differences, and apply the sequence of edit actions to the text to create the edited text. The software agent outputs the edited text as a dialog response to the utterance.Type: GrantFiled: September 1, 2021Date of Patent: June 7, 2022Assignee: ConverseNowAIInventors: Fernando Ezequiel Gonzalez, Vinay Kumar Shukla, Rahul Aggarwal, Vrajesh Navinchandra Sejpal, Leonardo Cordoba, Julia Milanese, Zubair Talib, Matias Grinberg
-
Patent number: 11355140Abstract: An emotion estimation system includes a feature amount extraction unit, a vowel section specification unit, and an estimation unit. The feature amount extraction unit analyzes recorded produced speech to extract a predetermined feature amount. The vowel section specification unit specifies, based on the feature amount extracted by the feature amount extraction unit, a section in which a vowel is produced. The estimation unit estimates, based on the feature amount in a vowel section specified by the vowel section specification unit, an emotion of a speaker.Type: GrantFiled: July 1, 2019Date of Patent: June 7, 2022Assignee: FUJIFILM Business Innovation Corp.Inventor: Xuan Luo
-
Patent number: 11350001Abstract: An operation receiving apparatus includes: a display; a user interface that overlaps with the display and receives a manual operation by a user; and a controller that acquires a recognition result of a user voice, and controls the display to display a first display region and a second display. The first display region displays an operation item that can receive an instruction by the manual operation, and the second display region displays an operation item that can be instructed by the user voice based on the recognition result.Type: GrantFiled: March 18, 2020Date of Patent: May 31, 2022Assignee: Konica Minolta, Inc.Inventor: Tomoko Kuroiwa
-
Patent number: 11281727Abstract: Embodiments for managing virtual assistants are described. Information associated with a user in an internet of things (IoT) device environment having a plurality of IoT devices is received. A request from the user is received. In response to the receiving of the request, a first portion of a response to the request is caused to be rendered utilizing a first of the plurality of IoT devices. Movement of the user within the IoT device environment is detected. In response to the detecting of the movement of the user, a second portion of the response to the request is caused to be rendered utilizing a second of the plurality of IoT devices based on said detected movement of the user and said received information about the user.Type: GrantFiled: July 3, 2019Date of Patent: March 22, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Zachary Silverstein, Robert Grant, Ruchika Bengani, Sarbajit Rakshit
-
Patent number: 11276390Abstract: An audio interval detection apparatus has a processor and a storage storing instructions that, when executed by the processor, control the processor to: detect, from a target audio signal, a specified audio interval including a specified audio signal representing a state of a phoneme of a same consonant produced continuously over a period longer than a specified time, and, by eliminating, from the target audio signal at least the detected specified audio interval, detect from the target audio signal an utterance audio interval that includes a speech utterance signal representing a speech utterance uttered by a speaker.Type: GrantFiled: March 13, 2019Date of Patent: March 15, 2022Assignee: CASIO COMPUTER CO., LTD.Inventor: Hiroki Tomita
-
Patent number: 11262909Abstract: A system, method and computer program product for use in providing a linguistic resource for input recognition of multiple input types on a computing device are provided. The computing device is connected to an input interface. A user is able to provide input by applying pressure to or gesturing above the input interface using a finger or an instrument such as a stylus or pen. The computing device has an input management system for recognizing the input. The input management system is configured to allow setting, in the computing device memory, parameters of a linguistic resource for a language model of one or more languages, and cause recognition of input to the input interface of the different input types using the linguistic resource. The resource parameters are set to optimize recognition performance characteristics of each input type while providing the linguistic resource with the pre-determined size.Type: GrantFiled: July 21, 2016Date of Patent: March 1, 2022Assignee: MYSCRIPTInventors: Ali Reza Ebadat, Lois Rigouste
-
Patent number: 11238865Abstract: One embodiment provides a method, including: receiving, at an information handling device, audible user input; determining, subsequent to the receiving, an intonation with which the audible user input was provided; assigning, based on the determined intonation, an expressive meaning to the audible user input; and performing, based on the expressive meaning, a corresponding function. Other aspects are described and claimed.Type: GrantFiled: November 18, 2019Date of Patent: February 1, 2022Assignee: Lenovo (Singapore) Pte. Ltd.Inventors: John Weldon Nicholson, Ming Qian, Song Wang, Ryan Charles Knudson, Roderick Echols
-
Patent number: 11232787Abstract: When a portion of an original audio track is unsatisfactory, alternate portions are searched for using phonetic matching within phonetically indexed alternate files. The alternates may correspond to recordings captured in a different take from the original where timecode matching is unavailable. An editor may preview one or more candidate alternates and select a preferred one to be used to replace the original. A media editing application, such as a digital audio workstation, automatically aligns and matches the preferred alternative to the original using waveform matching and optional gain matching.Type: GrantFiled: February 13, 2020Date of Patent: January 25, 2022Assignee: AVID TECHNOLOGY, INCInventor: Christopher M. Winsor
-
Patent number: 11222165Abstract: According to one or more embodiments of the present invention, an input request to a natural language processing (NLP) system is optimized. A window-size is selected for annotating an input corpus. The corpus is divided into partitions of the window-size, each partition processed separately. Further, a first set of entities is identified in a first partition, and a second set of entities in a second partition. Further, a third partition containing a first segment and a second segment is determined. The first segment overlaps the first partition, and the second segment overlaps the second partition. The method further includes identifying a third set of entities in the third partition. In response to the third set of entities being distinct from a set of entities from the first segment and the second segment, the window-size is adjusted. The input request for the NLP system is generated using the adjusted window-size.Type: GrantFiled: August 18, 2020Date of Patent: January 11, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Igor S. Ramos, Andrew J. Lavery, Scott Carrier, Paul Joseph Hake
-
Patent number: 11217231Abstract: A method of biasing speech recognition includes receiving audio data encoding an utterance and obtaining a set of one or more biasing phrases corresponding to a context of the utterance. Each biasing phrase in the set of one or more biasing phrases includes one or more words. The method also includes processing, using a speech recognition model, acoustic features derived from the audio data and grapheme and phoneme data derived from the set of one or more biasing phrases to generate an output of the speech recognition model. The method also includes determining a transcription for the utterance based on the output of the speech recognition model.Type: GrantFiled: April 30, 2020Date of Patent: January 4, 2022Assignee: Google LLCInventors: Rohit Prakash Prabhavalkar, Golan Pundak, Tara N. Sainath, Antoine Jean Bruguier
-
Patent number: 11205434Abstract: An audio encoder for providing an encoded audio information on the basis of an input audio information has a bandwidth extension information provider configured to provide bandwidth extension information using a variable temporal resolution and a detector configured to detect an onset of a fricative or affricate. The audio encoder is configured to adjust a temporal resolution used by the bandwidth extension information provider such that bandwidth extension information is provided with an increased temporal resolution at least for a predetermined period of time before a time at which an onset of a fricative or affricate is detected and for a predetermined period of time following the time at which the onset of the fricative or affricate is detected. Alternatively or in addition, the bandwidth extension information is provided with an increased temporal resolution in response to a detection of an offset of a fricative or affricate. Audio encoders and methods use a corresponding concept.Type: GrantFiled: August 12, 2019Date of Patent: December 21, 2021Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Sascha Disch, Christian Helmrich, Markus Multrus, Markus Schnell, Arthur Tritthart
-
Patent number: 11183171Abstract: The present disclosure relates to a method and system for robust and efficient language identification. The method includes: receiving the speech signal; partitioning the speech signal into a plurality of audio frames; extracting features of the plurality of audio frames; determining, using a neural network, a variable associated with the language identity and one or more auxiliary attributes of the speech signal, for each of the plurality of audio frames; determining scores of the plurality of audio frames based on the extracted features; and determining the language identity of the speech signal based on the variables and scores determined for the plurality of audio frames.Type: GrantFiled: July 30, 2019Date of Patent: November 23, 2021Assignee: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT CO., LTD.Inventor: Tianxiao Fu
-
Patent number: 11183168Abstract: A method, computer program, and computer system is provided for converting a singing first singing voice associated with a first speaker to a second singing voice associated with a second speaker. A context associated with one or more phonemes corresponding to the first singing voice is encoded, and the one or more phonemes are aligned to one or more target acoustic frames based on the encoded context. One or more mel-spectrogram features are recursively generated from the aligned phonemes and target acoustic frames, and a sample corresponding to the first singing voice is converted to a sample corresponding to the second singing voice using the generated mel-spectrogram features.Type: GrantFiled: February 13, 2020Date of Patent: November 23, 2021Assignee: TENCENT AMERICA LLCInventors: Chengzhu Yu, Heng Lu, Chao Weng, Dong Yu
-
Patent number: 11164578Abstract: A voice recognition apparatus capable of executing a function by a voice instruction, comprises an input unit configured to input a voice, and a control unit configured to enable the voice recognition apparatus to accept a voice instruction for executing a function, if a voice input by the input unit is an activation phrase. The voice recognition apparatus comprises a recognition unit configured to, if a voice input by the input unit after the control unit has enabled the voice recognition apparatus to accept the voice instruction contains the activation phrase, recognize the voice instruction by excluding the activation phrase from the voice.Type: GrantFiled: May 21, 2019Date of Patent: November 2, 2021Assignee: HONDA MOTOR CO., LTD.Inventor: Keigo Nakada
-
Patent number: 11164568Abstract: A speech recognition method is provided. The method includes: obtaining a voice signal; processing the voice signal according to a speech recognition algorithm to obtain n candidate recognition results, the candidate recognition results including text information corresponding to the voice signal; identifying a target result from among the n candidate recognition results according to a selection rule selected from among m selection rules, the selection rule having an execution sequence of j, the target result being a candidate recognition result that has a highest matching degree with the voice signal in the n candidate recognition results, an initial value of j being 1; and identifying the target result from among the n candidate recognition results according to a selection rule having an execution sequence of j+1 based on the target result not being identified according to the selection rule having the execution sequence of j.Type: GrantFiled: August 21, 2019Date of Patent: November 2, 2021Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LTDInventors: Ping Zheng, Feng Rao, Li Lu, Tao Li
-
Patent number: 11164581Abstract: An artificial intelligence device includes a speaker, a microphone configured to receive a user's speech, and one or more controllers configured to extract an utterance feature of the received speech, determine a user type corresponding to the extracted utterance feature, map a speech agent associated with the determined user type, and output an audio response through the speaker using the mapped speech agent.Type: GrantFiled: August 12, 2019Date of Patent: November 2, 2021Assignee: LG ELECTRONICS INC.Inventors: Jonghoon Chae, Yongchul Park, Siyoung Yang, Juyeong Jang, Sungmin Han
-
Patent number: 11145290Abstract: Provided is a system including an electronic device to recognize and process a user's speech and a method of controlling speech recognition on an electronic device. According to an embodiment, an electronic device comprises a communication circuit, an input module, at least one processor, and a memory operatively connected with the at least one processor the input module, and the communication circuit, wherein the memory stores instructions configured to enable the at least one processor to provide a function according to a first utterance of a user for wake-up, receive a second utterance of the user including a plurality of words with predesignated relevance through the input module while the function is provided, transmit information about the second utterance of the user, to another electronic device via the communication circuit, and receive a response related to the second utterance of the user from the second electronic device according to the transmission and provide the received response.Type: GrantFiled: May 22, 2019Date of Patent: October 12, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Jooyoo Kim, Jaepil Kim, Seongmin Je