Patents by Inventor Zhengyu Zhou
Zhengyu Zhou has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240139767Abstract: Provided is a movable electro-hydraulic composite drive spraying robot with a large working space, comprising movable bases, there being a plurality of movable bases cooperatively arranged for bearing a drive rope adjustment module, profile supporting columns in the driving rope adjusting module respectively being fixed on the movable bases, the plurality of movable bases encircling an operating space, a adjustable auxiliary motion platform that is movable being erected in the operating space, a rotary motion platform being arranged below the adjustable auxiliary motion platform, the adjustable auxiliary motion platform and the rotary motion platform being connected by means of a hydraulic push rod, the bottom end surface of the rotary motion platform being provided with a spray gun, and a balance mechanism and a fixed support mechanism for balancing the traction force of the rope and maintaining the balance of the mechanism also being mounted on the movable bases.Type: ApplicationFiled: May 26, 2021Publication date: May 2, 2024Applicant: HEFEI UNIVERSITY OF TECHNOLOGYInventors: Bin ZI, Jiahao ZHAO, Sen QIAN, Zhengyu WANG, Feng XU, Jingfeng PAN, Bin ZHOU, Shanshan JIANG, Yuan LI
-
Publication number: 20240134516Abstract: A system including a user interface that includes a processor in communication with a display and an input interface, the processor programmed to output on the display the user interface including a keyboard layout, wherein the keyboard layout includes at least a keyboard includes a collection of characters, in response to a first input from the input interface, output a first portion of the keyboard layout associated with a first subset of characters of the keyboard layout, wherein the first subset does not include all of the characters, in response to a second input from the input interface, select a second subset of characters, wherein the second subset of characters is from and include less characters than the first subset of characters and the second subset includes two or more characters, and output a character on a text field associated with the user interface based on the selection of the second subset.Type: ApplicationFiled: October 24, 2022Publication date: April 25, 2024Inventors: Jiajing GUO, Nan TIAN, Zhengyu ZHOU, William MA, Nicholas FEFFER, Marcellino GEMELLI
-
Publication number: 20240134505Abstract: A virtual reality apparatus that includes a display configured to output information related to a user interface of the virtual reality device, a microphone configured to receive one or more spoken word commands from a user upon activation of a voice recognition session, an eye gaze sensor configured to track eye movement of the user, and a processor programmed to, in response to a first input, output one or more words of a text field, in response to an eye gaze of the user exceeding a threshold time, emphasize a group of one or more words of the text field, toggle through a plurality of words of only the group utilizing the input interface, in response to a second input, highlight and edit an edited word from the group, and in response to utilizing contextual information associated with the group a language model, outputting one or more suggested words.Type: ApplicationFiled: October 24, 2022Publication date: April 25, 2024Inventors: Zhengyu ZHOU, Jiajing GUO, Nan TIAN, Nicholas FEFFER, William MA
-
Publication number: 20240105170Abstract: The systems and methods described herein are related to a new speech understanding system for domain-specific voice interaction. The systems and methods described herein combine the automatic correction of an automatic speech recognition errors with a natural language understanding model in a way that optimizes the recognition and understanding of a received speech input. The systems and methods described herein may further support out-of-domain detection or domain classification by jointly learning and/or performing automatic speech recognition error correction and domain-related classification. Through the joint learning with automatic speech recognition error correction, the out-of-domain detection or domain classification may be conducted based on a plurality of possible speech recognition results with shared feature inputs and shared neural layers. The systems and methods described herein may achieve robust performance with high computational efficiency.Type: ApplicationFiled: September 26, 2022Publication date: March 28, 2024Inventor: Zhengyu Zhou
-
Patent number: 11848024Abstract: A smart mask includes a main body having a back frame and a front cover. The back frame and the front cover each include an opening that is aligned with the mask wearer's mouth when worn. The front cover and back frame may be detachable from one another, or a single piece. A microphone is provided in the main body, as well as a speaker. A processor located in the main body is connected to the microphone and the speaker, and is configured to enhance the speech of the mask wearer. In particular, the processor receives audio signals representing a transformation of a spoken utterance of the wearer, processes the audio signals to enhance the speech, and then outputs the enhanced speech to the speaker. This helps other people better understand what the mask wearer is saying.Type: GrantFiled: January 26, 2021Date of Patent: December 19, 2023Assignee: Robert Bosch GmbHInventors: Pongtep Angkititrakul, Xiaoyang Gao, Hyeongsik Kim, Xiaowei Zhou, Zhengyu Zhou
-
Publication number: 20230367966Abstract: A method for optimizing performance of a natural language understanding model is disclosed. The method comprises receiving a plurality of training sentences, each training sentence being labeled with a respective intent from a plurality of intents, at least one portion of at least some training sentences being labeled with a respective slot type from a plurality of slot types. The method comprises determining a recommended modification to the plurality of training sentences, the recommended modification including at least one of (i) relabeling and (ii) deleting a training sentence in the plurality of training sentences. The method comprises generating a modified plurality of training sentences by performing the recommended modification to the plurality of training sentences in response to a user input received via a user interface. The method comprises training a first natural language understanding model using the modified plurality of training sentences.Type: ApplicationFiled: May 11, 2022Publication date: November 16, 2023Inventor: Zhengyu Zhou
-
Patent number: 11615785Abstract: A framework ranks multiple hypotheses generated by one or more ASR engines for each input speech utterance. The framework jointly implements ASR improvement and NLU. It makes use of NLU related knowledge to facilitate the ranking of competing hypotheses, and outputs the top-ranked hypothesis as the improved ASR result together with the NLU results of the speech utterance. The NLU results include intent detection results and the slot filling results.Type: GrantFiled: May 5, 2020Date of Patent: March 28, 2023Inventors: Zhengyu Zhou, Xuchen Song
-
Publication number: 20230069049Abstract: A computer-implemented method includes receiving one or more word embedding vectors in response to data indicative of one or more words. The method also includes utilizing a first recurrent neural network, outputting one or more intent representation vectors utilizing the one or more word embedding vectors; utilizing a second recurrent neural network, outputting one or more slot representation vectors utilizing the one or more intent representation vectors and the one or more word embedding vectors; and utilizing at least an additional third recurrent neural network and a fourth recurrent neural network, outputting a sentence intent and a slot label based on the one or more word embedding vectors, the one or more intent representation vectors, or the one or more slot representation vectors from either the first or second recurrent neural network.Type: ApplicationFiled: August 23, 2021Publication date: March 2, 2023Inventor: Zhengyu ZHOU
-
Publication number: 20220238129Abstract: A smart mask includes a main body having a back frame and a front cover. The back frame and the front cover each include an opening that is aligned with the mask wearer's mouth when worn. The front cover and back frame may be detachable from one another, or a single piece. A microphone is provided in the main body, as well as a speaker. A processor located in the main body is connected to the microphone and the speaker, and is configured to enhance the speech of the mask wearer. In particular, the processor receives audio signals representing a transformation of a spoken utterance of the wearer, processes the audio signals to enhance the speech, and then outputs the enhanced speech to the speaker. This helps other people better understand what the mask wearer is saying.Type: ApplicationFiled: January 26, 2021Publication date: July 28, 2022Inventors: Pongtep ANGKITITRAKUL, Xiaoyang GAO, Hyeongsik KIM, Xiaowei ZHOU, Zhengyu ZHOU
-
Patent number: 11250853Abstract: A dialog system and a method of using the dialog system is disclosed. The method may comprise: receiving audible human speech from a user; determining that the audible human speech comprises sarcasm information; providing an input to a neural network, wherein the input comprises speech data input associated with the audible human speech, an embedding vector associated with the sarcasm information, and a one-hot vector; and based on the input, determining an audible response to the human speech.Type: GrantFiled: April 30, 2020Date of Patent: February 15, 2022Assignee: ROBERT BOSCH GMBHInventors: Zhengyu Zhou, In Gyu Choi
-
Publication number: 20210343280Abstract: A dialog system and a method of using the dialog system is disclosed. The method may comprise: receiving audible human speech from a user; determining that the audible human speech comprises sarcasm information; providing an input to a neural network, wherein the input comprises speech data input associated with the audible human speech, an embedding vector associated with the sarcasm information, and a one-hot vector; and based on the input, determining an audible response to the human speech.Type: ApplicationFiled: April 30, 2020Publication date: November 4, 2021Inventors: Zhengyu ZHOU, In Gyu CHOI
-
Publication number: 20210343288Abstract: A spoken dialog system and methods of using the system is described. A method may comprise: receiving audible human speech from a user; determining textual speech data based on the audible human speech; extracting, from the audible human speech, signal speech data that is indicative of acoustic characteristics which correspond to the textual speech data; and using the textual speech data and the signal speech data, generating a response to the audible human speech.Type: ApplicationFiled: April 30, 2020Publication date: November 4, 2021Inventors: Zhengyu ZHOU, Vikas YADAV, Yongliang HE, In Gyu CHOI
-
Publication number: 20200357392Abstract: A framework ranks multiple hypotheses generated by one or more ASR engines for each input speech utterance. The framework jointly implements ASR improvement and NLU. It makes use of NLU related knowledge to facilitate the ranking of competing hypotheses, and outputs the top-ranked hypothesis as the improved ASR result together with the NLU results of the speech utterance. The NLU results include intent detection results and the slot filling results.Type: ApplicationFiled: May 5, 2020Publication date: November 12, 2020Inventors: Zhengyu ZHOU, Xuchen SONG
-
Patent number: 10258927Abstract: The present invention directs to a centrifugal filtration device, for separating living cells, including a spindle (28), a rotary arm (211) which is connected vertically to the spindle (28), a microporous membrane filter (31A;31B) which is mounted on the rotary arm (211), and a liquid distributor (4) arranged above the spindle (28). The microporous membrane filter (31A;31B) includes an inlet (311A;311B), an outlet (312A;312B), a front cavity (313A;313B) having the inlet (311A;311B) formed thereon, a rear cavity having the outlet (312A;312B) formed thereon, and a filter membrane (315A;315B) arranged between the front cavity and the rear cavity; the diameter of each filter pore formed in the filter membrane is smaller than that of the cell which needs to be separated. The present invention also discloses a cell separation system.Type: GrantFiled: August 8, 2016Date of Patent: April 16, 2019Inventors: Chong Zheng, Zhengyu Zhou
-
Patent number: 10170110Abstract: A method for ranking candidate speech recognition results includes generating, with a controller, a plurality of feature vectors for the candidate speech recognition results, each feature vector including one or more of trigger pair features, a confidence score feature, and word-level features. The method further includes providing the plurality of feature vectors as inputs to a neural network, generating a plurality of ranking scores corresponding to the plurality of feature vectors for the plurality of candidate speech recognition results based on an output layer of the neural network, and operating the automated system using the candidate speech recognition result in the plurality of candidate speech recognition results corresponding to a highest ranking score in the plurality of ranking scores as input.Type: GrantFiled: November 17, 2016Date of Patent: January 1, 2019Assignee: Robert Bosch GmbHInventors: Zhengyu Zhou, Rami Botros
-
Patent number: 10109219Abstract: A method for sign language recognition includes receiving, with an input device, an input based on a plurality of hand movements and postures of a user that correspond to a sequence of signs, extracting a plurality of features from the input corresponding to the plurality of hand movements and postures, identifying, a start of the sequence of signs in the input based on a first set of features in the plurality of features and a first Hidden Markov Model (HMM) stored in the memory and identifying a first sign in the input based on a second set of features in the plurality of features and a second HMM stored in the memory. The method also includes generating an output corresponding to the first sign from the input.Type: GrantFiled: April 15, 2016Date of Patent: October 23, 2018Assignee: Robert Bosch GmbHInventors: Zhengyu Zhou, Tobias Menne, Kehuang Li, Kui Xu, Zhe Feng, Chin-Hui Lee
-
Publication number: 20180137857Abstract: A method for ranking candidate speech recognition results includes generating, with a controller, a plurality of feature vectors for the candidate speech recognition results, each feature vector including one or more of trigger pair features, a confidence score feature, and word-level features. The method further includes providing the plurality of feature vectors as inputs to a neural network, generating a plurality of ranking scores corresponding to the plurality of feature vectors for the plurality of candidate speech recognition results based on an output layer of the neural network, and operating the automated system using the candidate speech recognition result in the plurality of candidate speech recognition results corresponding to a highest ranking score in the plurality of ranking scores as input.Type: ApplicationFiled: November 17, 2016Publication date: May 17, 2018Applicant: Robert Bosch GmbHInventors: Zhengyu Zhou, Rami Botros
-
Patent number: 9959861Abstract: A method for automated speech recognition includes generating first and second pluralities of candidate speech recognition results corresponding to audio input data using a first general-purpose speech recognition engine and a second domain-specific speech recognition engine, respectively. The method further includes generating a third plurality of candidate speech recognition result including a plurality of words included in one of the first plurality of speech recognition results and at least one word included in another one of the second plurality of speech recognition results, ranking the third plurality of candidate speech recognition results using a pairwise ranker to identify a highest ranked candidate speech recognition result, and operating the automated system using the highest ranked speech recognition result as an input from the user.Type: GrantFiled: September 30, 2016Date of Patent: May 1, 2018Assignee: Robert Bosch GmbHInventors: Zhengyu Zhou, Zhe Feng
-
Publication number: 20180096678Abstract: A method for automated speech recognition includes generating first and second pluralities of candidate speech recognition results corresponding to audio input data using a first general-purpose speech recognition engine and a second domain-specific speech recognition engine, respectively. The method further includes generating a third plurality of candidate speech recognition result including a plurality of words included in one of the first plurality of speech recognition results and at least one word included in another one of the second plurality of speech recognition results, ranking the third plurality of candidate speech recognition results using a pairwise ranker to identify a highest ranked candidate speech recognition result, and operating the automated system using the highest ranked speech recognition result as an input from the user.Type: ApplicationFiled: September 30, 2016Publication date: April 5, 2018Inventors: Zhengyu Zhou, Zhe Feng
-
Publication number: 20160340638Abstract: The present invention directs to a centrifugal filtration device, for separating living cells, including a spindle (28), a rotary arm (211) which is connected vertically to the spindle (28), a microporous membrane filter (31A;31B) which is mounted on the rotary arm (211), and a liquid distributor (4) arranged above the spindle (28). The microporous membrane filter (31A;31B) includes an inlet (311A;311B), an outlet (312A;312B), a front cavity (313A;313B) having the inlet (311A;311B) formed thereon, a rear cavity having the outlet (312A;312B) formed thereon, and a filter membrane (315A;315B) arranged between the front cavity and the rear cavity; the diameter of each filter pore formed in the filter membrane is smaller than that of the cell which needs to be separated. The present invention also discloses a cell separation system.Type: ApplicationFiled: August 8, 2016Publication date: November 24, 2016Inventors: Chong Zheng, Zhengyu Zhou