Patents by Inventor Yifan Gong
Yifan Gong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240116771Abstract: The present disclosure relates to the technical field of oxygen carrier, discloses a medium-entropy perovskite oxygen carrier and its preparation method and application thereof, the synthesis procedure includes preparing an aqueous solution from metallic nitrate serving as a raw material, performing a coprecipitation reaction with at least one of aqueous ammonia solution, a sodium hydroxide aqueous solution or a sodium carbonate aqueous solution as a precipitant at a pH value of 9.5 to 10.5; obtaining the La3CoMnAlO9 powers after stirring, standing, washing, drying and calcining. The preparation method is simple, synthetic conditions are easy to control, and batch production could be achieved.Type: ApplicationFiled: May 26, 2023Publication date: April 11, 2024Inventors: Jinlong Gong, Xianhua Zhang, Chunlei Pei, Zhi-Jian Zhao, Xian Yao, Yifan Liu
-
Publication number: 20240072362Abstract: A solderless battery pack is provided that includes a battery port, a protective plate, an upper end plate, a lower end plate, cell groups and a cell locking mechanism. The cell groups are arranged between the upper end plate and the lower end plate and include a cell installation bracket, cells and a PCB busbar. The cell locking mechanism includes a metal upper pressing plate, a metal lower pressing plate and a fastening long bolt that passes through the metal upper pressing plate, the metal lower pressing plate, the upper end plate, the lower end plate and the cell groups.Type: ApplicationFiled: June 20, 2022Publication date: February 29, 2024Inventors: Yifan LU, Qiang GONG, Bin DUAN, Xuehao SHEN, Qijun SHI
-
Patent number: 11915686Abstract: Embodiments are associated with a speaker-independent attention-based encoder-decoder model to classify output tokens based on input speech frames, the speaker-independent attention-based encoder-decoder model associated with a first output distribution, and a speaker-dependent attention-based encoder-decoder model to classify output tokens based on input speech frames, the speaker-dependent attention-based encoder-decoder model associated with a second output distribution. The second attention-based encoder-decoder model is trained to classify output tokens based on input speech frames of a target speaker and simultaneously trained to maintain a similarity between the first output distribution and the second output distribution.Type: GrantFiled: January 5, 2022Date of Patent: February 27, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
-
Patent number: 11862144Abstract: A computer system is provided that includes a processor configured to store a set of audio training data that includes a plurality of audio segments and metadata indicating a word or phrase associated with each audio segment. For a target training statement of a set of structured text data, the processor is configured to generate a concatenated audio signal that matches a word content of a target training statement by comparing the words or phrases of a plurality of text segments of the target training statement to respective words or phrases of audio segments of the stored set of audio training data, selecting a plurality of audio segments from the set of audio training data based on a match in the words or phrases between the plurality of text segments of the target training statement and the selected plurality of audio segments, and concatenating the selected plurality of audio segments.Type: GrantFiled: December 16, 2020Date of Patent: January 2, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Rui Zhao, Jinyu Li, Yifan Gong
-
Patent number: 11823702Abstract: To generate substantially condition-invariant and speaker-discriminative features, embodiments are associated with a feature extractor capable of extracting features from speech frames based on first parameters, a speaker classifier capable of identifying a speaker based on the features and on second parameters, and a condition classifier capable of identifying a noise condition based on the features and on third parameters. The first parameters of the feature extractor and the second parameters of the speaker classifier are trained to minimize a speaker classification loss, the first parameters of the feature extractor are further trained to maximize a condition classification loss, and the third parameters of the condition classifier are trained to minimize the condition classification loss.Type: GrantFiled: November 30, 2021Date of Patent: November 21, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
-
Patent number: 11798535Abstract: Generally discussed herein are devices, systems, and methods for on-device detection of a wake word. A device can include a memory including model parameters that define a custom wake word detection model, the wake word detection model including a recurrent neural network transducer (RNNT) and a lookup table (LUT), the LUT indicating a hidden vector to be provided in response to a phoneme of a user-specified wake word, a microphone to capture audio, and processing circuitry to receive the audio from the microphone, determine, using the wake word detection model, whether the audio includes an utterance of the user-specified wake word, and wake up a personal assistant after determining the audio includes the utterance of the user-specified wake word.Type: GrantFiled: September 14, 2021Date of Patent: October 24, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Emilian Stoimenov, Rui Zhao, Kaustubh Prakash Kalgaonkar, Ivaylo Andreanov Enchev, Khuram Shahid, Anthony Phillip Stark, Guoli Ye, Mahadevan Srinivasan, Yifan Gong, Hosam Adel Khalil
-
Patent number: 11790891Abstract: Generally discussed herein are devices, systems, and methods for custom wake word selection assistance. A method can include receiving, at a device, data indicating a custom wake word provided by a user, determining one or more characteristics of the custom wake word, determining that use of the custom wake word will cause more than a threshold rate of false detections based on the characteristics, rejecting the custom wake word as the wake word for accessing a personal assistant in response to determining that use of the custom wake word will cause more than a threshold rate of false detections, and setting the custom wake word as the wake word in response to determining that use of the custom wake word will not cause more than the threshold rate of false detections.Type: GrantFiled: December 1, 2021Date of Patent: October 17, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Emilian Stoimenov, Khuram Shahid, Guoli Ye, Hosam Adel Khalil, Yifan Gong
-
Patent number: 11776548Abstract: Embodiments may include determination, for each of a plurality of speech frames associated with an acoustic feature, of a phonetic feature based on the associated acoustic feature, generation of one or more two-dimensional feature maps based on the plurality of phonetic features, input of the one or more two-dimensional feature maps to a trained neural network to generate a plurality of speaker embeddings, and aggregation of the plurality of speaker embeddings into a speaker embedding based on respective weights determined for each of the plurality of speaker embeddings, wherein the speaker embedding is associated with an identity of the speaker.Type: GrantFiled: February 7, 2022Date of Patent: October 3, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Yong Zhao, Tianyan Zhou, Jinyu Li, Yifan Gong, Jian Wu, Zhuo Chen
-
Patent number: 11735190Abstract: To generate substantially domain-invariant and speaker-discriminative features, embodiments may operate to extract features from input data based on a first set of parameters, generate outputs based on the extracted features and on a second set of parameters, and identify words represented by the input data based on the outputs, wherein the first set of parameters and the second set of parameters have been trained to minimize a network loss associated with the second set of parameters, wherein the first set of parameters has been trained to maximize the domain classification loss of a network comprising 1) an attention network to determine, based on a third set of parameters, relative importances of features extracted based on the first parameters to domain classification and 2) a domain classifier to classify a domain based on the extracted features, the relative importances, and a fourth set of parameters, and wherein the third set of parameters and the fourth set of parameters have been trained to minimizeType: GrantFiled: October 5, 2021Date of Patent: August 22, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Zhong Meng, Jinyu Li, Yifan Gong
-
Patent number: 11705117Abstract: Acoustic features are batched into two different batches. The second batch of the two batches is made in response to a detection of a word hypothesis output by a speech recognition network that received the first batch. The number of acoustic feature frames of the second batch is equal to a second batch size greater than the first batch size. The second batch is also to the speech recognition network for processing.Type: GrantFiled: October 13, 2021Date of Patent: July 18, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Hosam A. Khalil, Emilian Y. Stoimenov, Yifan Gong, Chaojun Liu, Christopher H. Basoglu, Amit K. Agarwal, Naveen Parihar, Sayan Pathak
-
Publication number: 20230186919Abstract: Systems, methods, and devices are provided for generating and using text-to-speech (TTS) data for improved speech recognition models. A main model is trained with keyword independent baseline training data. In some instances, acoustic and language model sub-components of the main model are modified with new TTS training data. In some instances, the new TTS training is obtained from a multi-speaker neural TTS system for a keyword that is underrepresented in the baseline training data. In some instances, the new TTS training data is used for pronunciation learning and normalization of keyword dependent confidence scores in keyword spotting (KWS) applications. In some instances, the new TTS training data is used for rapid speaker adaptation in speech recognition models.Type: ApplicationFiled: February 10, 2023Publication date: June 15, 2023Inventors: Guoli YE, Yan HUANG, Wenning WEI, Lei HE, Eva SHARMA, Jian WU, Yao TIAN, Edward C. LIN, Yifan GONG, Rui ZHAO, Jinyu LI, William Maxwell GALE
-
Patent number: 11676006Abstract: According to some embodiments, a universal modeling system may include a plurality of domain expert models to each receive raw input data (e.g., a stream of audio frames containing speech utterances) and provide a domain expert output based on the raw input data. A neural mixture component may then generate a weight corresponding to each domain expert model based on information created by the plurality of domain expert models (e.g., hidden features and/or row convolution). The weights might be associated with, for example, constrained scalar numbers, unconstrained scaler numbers, vectors, matrices, etc. An output layer may provide a universal modeling system output (e.g., an automatic speech recognition result) based on each domain expert output after being multiplied by the corresponding weight for that domain expert model.Type: GrantFiled: May 16, 2019Date of Patent: June 13, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Amit Das, Jinyu Li, Changliang Liu, Yifan Gong
-
Patent number: 11657799Abstract: Techniques performed by a data processing system for training a Recurrent Neural Network Transducer (RNN-T) herein include encoder pretraining by training a neural network-based token classification model using first token-aligned training data representing a plurality of utterances, where each utterance is associated with a plurality of frames of audio data and tokens representing each utterance are aligned with frame boundaries of the plurality of audio frames; obtaining first cross-entropy (CE) criterion from the token classification model, wherein the CE criterion represent a divergence between expected outputs and reference outputs of the model; pretraining an encoder of an RNN-T based on the first CE criterion; and training the RNN-T with second training data after pretraining the encoder of the RNN-T. These techniques also include whole-network pre-training of the RNN-T.Type: GrantFiled: April 3, 2020Date of Patent: May 23, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong, Hu Hu
-
Publication number: 20230153324Abstract: The present disclosure provides a service discovery method and apparatus, a computing device, and a storage medium, to solve the problem of node data falsification or tampering easily occurring in the prior art. The service discovery method comprises: in response to discovering a target node to be online or offline, creating, by a first online node, a block of a target node, and sending a data synchronization request to a second online node; in response to determining that the block is the latest block, informing, by the second online node, a plurality of third online nodes to respectively authenticate the permission of the target node; and performing statistics on permission authentication results of the target node authenticated by the plurality of third online nodes, and synchronizing the block to a block chain respectively maintained by each online node in response to an authentication passing rate satisfying a predetermined condition.Type: ApplicationFiled: November 17, 2022Publication date: May 18, 2023Inventors: Yifan GONG, Jiangming JIN
-
Publication number: 20230154467Abstract: A computing system including one or more processors configured to receive an audio input. The one or more processors may generate a text transcription of the audio input at a sequence-to-sequence speech recognition model, which may assign a respective plurality of external-model text tokens to a plurality of frames included in the audio input. Each external-model text token may have an external-model alignment within the audio input. Based on the audio input, the one or more processors may generate a plurality of hidden states. Based on the plurality of hidden states, the one or more processors may generate a plurality of output text tokens. Each output text token may have a corresponding output alignment within the audio input. For each output text token, a latency between the output alignment and the external-model alignment may be below a predetermined latency threshold. The one or more processors may output the text transcription.Type: ApplicationFiled: January 20, 2023Publication date: May 18, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Yashesh GAUR, Jinyu LI, Liang LU, Hirofumi INAGUMA, Yifan GONG
-
Publication number: 20230153254Abstract: A communication method, a related computing system and a storage medium are described. A communication method for a computing system runs at least one process, wherein the at least one process comprises a plurality of modules, and the method comprises: acquiring attribute information of each of the plurality of modules, wherein the plurality of modules at least comprise a first module and a second module; in response to determining that data is to be transmitted from the first module to the second module, comparing attribute information of the first module with attribute information of the second module; and selecting a communication channel for each of the first module and the second module according to the comparison, to transmit the data from the first module to the second module through the selected communication channel.Type: ApplicationFiled: November 14, 2022Publication date: May 18, 2023Inventors: Yifan GONG, Jiangming JIN
-
Patent number: 11631399Abstract: According to some embodiments, a machine learning model may include an input layer to receive an input signal as a series of frames representing handwriting data, speech data, audio data, and/or textual data. A plurality of time layers may be provided, and each time layer may comprise a uni-directional recurrent neural network processing block. A depth processing block may scan hidden states of the recurrent neural network processing block of each time layer, and the depth processing block may be associated with a first frame and receive context frame information of a sequence of one or more future frames relative to the first frame. An output layer may output a final classification as a classified posterior vector of the input signal. For example, the depth processing block may receive the context from information from an output of a time layer processing block or another depth processing block of the future frame.Type: GrantFiled: May 13, 2019Date of Patent: April 18, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Jinyu Li, Vadim Mazalov, Changliang Liu, Liang Lu, Yifan Gong
-
Patent number: 11620992Abstract: A method of enhancing an automated speech recognition confidence classifier includes receiving a set of baseline confidence features from one or more decoded words, deriving word embedding confidence features from the baseline confidence features, joining the baseline confidence features with word embedding confidence features to create a feature vector, and executing the confidence classifier to generate a confidence score, wherein the confidence classifier is trained with a set of training examples having labeled features corresponding to the feature vector.Type: GrantFiled: March 31, 2021Date of Patent: April 4, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Kshitiz Kumar, Anastasios Anastasakos, Yifan Gong
-
Patent number: 11586930Abstract: Embodiments are associated with conditional teacher-student model training. A trained teacher model configured to perform a task may be accessed and an untrained student model may be created. A model training platform may provide training data labeled with ground truths to the teacher model to produce teacher posteriors representing the training data. When it is determined that a teacher posterior matches the associated ground truth label, the platform may conditionally use the teacher posterior to train the student model. When it is determined that a teacher posterior does not match the associated ground truth label, the platform may conditionally use the ground truth label to train the student model. The models might be associated with, for example, automatic speech recognition (e.g., in connection with domain adaptation and/or speaker adaptation).Type: GrantFiled: May 13, 2019Date of Patent: February 21, 2023Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
-
Patent number: 11587569Abstract: Systems, methods, and devices are provided for generating and using text-to-speech (TTS) data for improved speech recognition models. A main model is trained with keyword independent baseline training data. In some instances, acoustic and language model sub-components of the main model are modified with new TTS training data. In some instances, the new TTS training is obtained from a multi-speaker neural TTS system for a keyword that is underrepresented in the baseline training data. In some instances, the new TTS training data is used for pronunciation learning and normalization of keyword dependent confidence scores in keyword spotting (KWS) applications. In some instances, the new TTS training data is used for rapid speaker adaptation in speech recognition models.Type: GrantFiled: May 14, 2020Date of Patent: February 21, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Guoli Ye, Yan Huang, Wenning Wei, Lei He, Eva Sharma, Jian Wu, Yao Tian, Edward C. Lin, Yifan Gong, Rui Zhao, Jinyu Li, William Maxwell Gale