Patents by Inventor Zhengyu Zhou

Zhengyu Zhou has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240139767
    Abstract: Provided is a movable electro-hydraulic composite drive spraying robot with a large working space, comprising movable bases, there being a plurality of movable bases cooperatively arranged for bearing a drive rope adjustment module, profile supporting columns in the driving rope adjusting module respectively being fixed on the movable bases, the plurality of movable bases encircling an operating space, a adjustable auxiliary motion platform that is movable being erected in the operating space, a rotary motion platform being arranged below the adjustable auxiliary motion platform, the adjustable auxiliary motion platform and the rotary motion platform being connected by means of a hydraulic push rod, the bottom end surface of the rotary motion platform being provided with a spray gun, and a balance mechanism and a fixed support mechanism for balancing the traction force of the rope and maintaining the balance of the mechanism also being mounted on the movable bases.
    Type: Application
    Filed: May 26, 2021
    Publication date: May 2, 2024
    Applicant: HEFEI UNIVERSITY OF TECHNOLOGY
    Inventors: Bin ZI, Jiahao ZHAO, Sen QIAN, Zhengyu WANG, Feng XU, Jingfeng PAN, Bin ZHOU, Shanshan JIANG, Yuan LI
  • Publication number: 20240134516
    Abstract: A system including a user interface that includes a processor in communication with a display and an input interface, the processor programmed to output on the display the user interface including a keyboard layout, wherein the keyboard layout includes at least a keyboard includes a collection of characters, in response to a first input from the input interface, output a first portion of the keyboard layout associated with a first subset of characters of the keyboard layout, wherein the first subset does not include all of the characters, in response to a second input from the input interface, select a second subset of characters, wherein the second subset of characters is from and include less characters than the first subset of characters and the second subset includes two or more characters, and output a character on a text field associated with the user interface based on the selection of the second subset.
    Type: Application
    Filed: October 24, 2022
    Publication date: April 25, 2024
    Inventors: Jiajing GUO, Nan TIAN, Zhengyu ZHOU, William MA, Nicholas FEFFER, Marcellino GEMELLI
  • Publication number: 20240134505
    Abstract: A virtual reality apparatus that includes a display configured to output information related to a user interface of the virtual reality device, a microphone configured to receive one or more spoken word commands from a user upon activation of a voice recognition session, an eye gaze sensor configured to track eye movement of the user, and a processor programmed to, in response to a first input, output one or more words of a text field, in response to an eye gaze of the user exceeding a threshold time, emphasize a group of one or more words of the text field, toggle through a plurality of words of only the group utilizing the input interface, in response to a second input, highlight and edit an edited word from the group, and in response to utilizing contextual information associated with the group a language model, outputting one or more suggested words.
    Type: Application
    Filed: October 24, 2022
    Publication date: April 25, 2024
    Inventors: Zhengyu ZHOU, Jiajing GUO, Nan TIAN, Nicholas FEFFER, William MA
  • Publication number: 20240105170
    Abstract: The systems and methods described herein are related to a new speech understanding system for domain-specific voice interaction. The systems and methods described herein combine the automatic correction of an automatic speech recognition errors with a natural language understanding model in a way that optimizes the recognition and understanding of a received speech input. The systems and methods described herein may further support out-of-domain detection or domain classification by jointly learning and/or performing automatic speech recognition error correction and domain-related classification. Through the joint learning with automatic speech recognition error correction, the out-of-domain detection or domain classification may be conducted based on a plurality of possible speech recognition results with shared feature inputs and shared neural layers. The systems and methods described herein may achieve robust performance with high computational efficiency.
    Type: Application
    Filed: September 26, 2022
    Publication date: March 28, 2024
    Inventor: Zhengyu Zhou
  • Patent number: 11848024
    Abstract: A smart mask includes a main body having a back frame and a front cover. The back frame and the front cover each include an opening that is aligned with the mask wearer's mouth when worn. The front cover and back frame may be detachable from one another, or a single piece. A microphone is provided in the main body, as well as a speaker. A processor located in the main body is connected to the microphone and the speaker, and is configured to enhance the speech of the mask wearer. In particular, the processor receives audio signals representing a transformation of a spoken utterance of the wearer, processes the audio signals to enhance the speech, and then outputs the enhanced speech to the speaker. This helps other people better understand what the mask wearer is saying.
    Type: Grant
    Filed: January 26, 2021
    Date of Patent: December 19, 2023
    Assignee: Robert Bosch GmbH
    Inventors: Pongtep Angkititrakul, Xiaoyang Gao, Hyeongsik Kim, Xiaowei Zhou, Zhengyu Zhou
  • Publication number: 20230367966
    Abstract: A method for optimizing performance of a natural language understanding model is disclosed. The method comprises receiving a plurality of training sentences, each training sentence being labeled with a respective intent from a plurality of intents, at least one portion of at least some training sentences being labeled with a respective slot type from a plurality of slot types. The method comprises determining a recommended modification to the plurality of training sentences, the recommended modification including at least one of (i) relabeling and (ii) deleting a training sentence in the plurality of training sentences. The method comprises generating a modified plurality of training sentences by performing the recommended modification to the plurality of training sentences in response to a user input received via a user interface. The method comprises training a first natural language understanding model using the modified plurality of training sentences.
    Type: Application
    Filed: May 11, 2022
    Publication date: November 16, 2023
    Inventor: Zhengyu Zhou
  • Patent number: 11615785
    Abstract: A framework ranks multiple hypotheses generated by one or more ASR engines for each input speech utterance. The framework jointly implements ASR improvement and NLU. It makes use of NLU related knowledge to facilitate the ranking of competing hypotheses, and outputs the top-ranked hypothesis as the improved ASR result together with the NLU results of the speech utterance. The NLU results include intent detection results and the slot filling results.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: March 28, 2023
    Inventors: Zhengyu Zhou, Xuchen Song
  • Publication number: 20230069049
    Abstract: A computer-implemented method includes receiving one or more word embedding vectors in response to data indicative of one or more words. The method also includes utilizing a first recurrent neural network, outputting one or more intent representation vectors utilizing the one or more word embedding vectors; utilizing a second recurrent neural network, outputting one or more slot representation vectors utilizing the one or more intent representation vectors and the one or more word embedding vectors; and utilizing at least an additional third recurrent neural network and a fourth recurrent neural network, outputting a sentence intent and a slot label based on the one or more word embedding vectors, the one or more intent representation vectors, or the one or more slot representation vectors from either the first or second recurrent neural network.
    Type: Application
    Filed: August 23, 2021
    Publication date: March 2, 2023
    Inventor: Zhengyu ZHOU
  • Publication number: 20220238129
    Abstract: A smart mask includes a main body having a back frame and a front cover. The back frame and the front cover each include an opening that is aligned with the mask wearer's mouth when worn. The front cover and back frame may be detachable from one another, or a single piece. A microphone is provided in the main body, as well as a speaker. A processor located in the main body is connected to the microphone and the speaker, and is configured to enhance the speech of the mask wearer. In particular, the processor receives audio signals representing a transformation of a spoken utterance of the wearer, processes the audio signals to enhance the speech, and then outputs the enhanced speech to the speaker. This helps other people better understand what the mask wearer is saying.
    Type: Application
    Filed: January 26, 2021
    Publication date: July 28, 2022
    Inventors: Pongtep ANGKITITRAKUL, Xiaoyang GAO, Hyeongsik KIM, Xiaowei ZHOU, Zhengyu ZHOU
  • Patent number: 11250853
    Abstract: A dialog system and a method of using the dialog system is disclosed. The method may comprise: receiving audible human speech from a user; determining that the audible human speech comprises sarcasm information; providing an input to a neural network, wherein the input comprises speech data input associated with the audible human speech, an embedding vector associated with the sarcasm information, and a one-hot vector; and based on the input, determining an audible response to the human speech.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: February 15, 2022
    Assignee: ROBERT BOSCH GMBH
    Inventors: Zhengyu Zhou, In Gyu Choi
  • Publication number: 20210343280
    Abstract: A dialog system and a method of using the dialog system is disclosed. The method may comprise: receiving audible human speech from a user; determining that the audible human speech comprises sarcasm information; providing an input to a neural network, wherein the input comprises speech data input associated with the audible human speech, an embedding vector associated with the sarcasm information, and a one-hot vector; and based on the input, determining an audible response to the human speech.
    Type: Application
    Filed: April 30, 2020
    Publication date: November 4, 2021
    Inventors: Zhengyu ZHOU, In Gyu CHOI
  • Publication number: 20210343288
    Abstract: A spoken dialog system and methods of using the system is described. A method may comprise: receiving audible human speech from a user; determining textual speech data based on the audible human speech; extracting, from the audible human speech, signal speech data that is indicative of acoustic characteristics which correspond to the textual speech data; and using the textual speech data and the signal speech data, generating a response to the audible human speech.
    Type: Application
    Filed: April 30, 2020
    Publication date: November 4, 2021
    Inventors: Zhengyu ZHOU, Vikas YADAV, Yongliang HE, In Gyu CHOI
  • Publication number: 20200357392
    Abstract: A framework ranks multiple hypotheses generated by one or more ASR engines for each input speech utterance. The framework jointly implements ASR improvement and NLU. It makes use of NLU related knowledge to facilitate the ranking of competing hypotheses, and outputs the top-ranked hypothesis as the improved ASR result together with the NLU results of the speech utterance. The NLU results include intent detection results and the slot filling results.
    Type: Application
    Filed: May 5, 2020
    Publication date: November 12, 2020
    Inventors: Zhengyu ZHOU, Xuchen SONG
  • Patent number: 10258927
    Abstract: The present invention directs to a centrifugal filtration device, for separating living cells, including a spindle (28), a rotary arm (211) which is connected vertically to the spindle (28), a microporous membrane filter (31A;31B) which is mounted on the rotary arm (211), and a liquid distributor (4) arranged above the spindle (28). The microporous membrane filter (31A;31B) includes an inlet (311A;311B), an outlet (312A;312B), a front cavity (313A;313B) having the inlet (311A;311B) formed thereon, a rear cavity having the outlet (312A;312B) formed thereon, and a filter membrane (315A;315B) arranged between the front cavity and the rear cavity; the diameter of each filter pore formed in the filter membrane is smaller than that of the cell which needs to be separated. The present invention also discloses a cell separation system.
    Type: Grant
    Filed: August 8, 2016
    Date of Patent: April 16, 2019
    Inventors: Chong Zheng, Zhengyu Zhou
  • Patent number: 10170110
    Abstract: A method for ranking candidate speech recognition results includes generating, with a controller, a plurality of feature vectors for the candidate speech recognition results, each feature vector including one or more of trigger pair features, a confidence score feature, and word-level features. The method further includes providing the plurality of feature vectors as inputs to a neural network, generating a plurality of ranking scores corresponding to the plurality of feature vectors for the plurality of candidate speech recognition results based on an output layer of the neural network, and operating the automated system using the candidate speech recognition result in the plurality of candidate speech recognition results corresponding to a highest ranking score in the plurality of ranking scores as input.
    Type: Grant
    Filed: November 17, 2016
    Date of Patent: January 1, 2019
    Assignee: Robert Bosch GmbH
    Inventors: Zhengyu Zhou, Rami Botros
  • Patent number: 10109219
    Abstract: A method for sign language recognition includes receiving, with an input device, an input based on a plurality of hand movements and postures of a user that correspond to a sequence of signs, extracting a plurality of features from the input corresponding to the plurality of hand movements and postures, identifying, a start of the sequence of signs in the input based on a first set of features in the plurality of features and a first Hidden Markov Model (HMM) stored in the memory and identifying a first sign in the input based on a second set of features in the plurality of features and a second HMM stored in the memory. The method also includes generating an output corresponding to the first sign from the input.
    Type: Grant
    Filed: April 15, 2016
    Date of Patent: October 23, 2018
    Assignee: Robert Bosch GmbH
    Inventors: Zhengyu Zhou, Tobias Menne, Kehuang Li, Kui Xu, Zhe Feng, Chin-Hui Lee
  • Publication number: 20180137857
    Abstract: A method for ranking candidate speech recognition results includes generating, with a controller, a plurality of feature vectors for the candidate speech recognition results, each feature vector including one or more of trigger pair features, a confidence score feature, and word-level features. The method further includes providing the plurality of feature vectors as inputs to a neural network, generating a plurality of ranking scores corresponding to the plurality of feature vectors for the plurality of candidate speech recognition results based on an output layer of the neural network, and operating the automated system using the candidate speech recognition result in the plurality of candidate speech recognition results corresponding to a highest ranking score in the plurality of ranking scores as input.
    Type: Application
    Filed: November 17, 2016
    Publication date: May 17, 2018
    Applicant: Robert Bosch GmbH
    Inventors: Zhengyu Zhou, Rami Botros
  • Patent number: 9959861
    Abstract: A method for automated speech recognition includes generating first and second pluralities of candidate speech recognition results corresponding to audio input data using a first general-purpose speech recognition engine and a second domain-specific speech recognition engine, respectively. The method further includes generating a third plurality of candidate speech recognition result including a plurality of words included in one of the first plurality of speech recognition results and at least one word included in another one of the second plurality of speech recognition results, ranking the third plurality of candidate speech recognition results using a pairwise ranker to identify a highest ranked candidate speech recognition result, and operating the automated system using the highest ranked speech recognition result as an input from the user.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: May 1, 2018
    Assignee: Robert Bosch GmbH
    Inventors: Zhengyu Zhou, Zhe Feng
  • Publication number: 20180096678
    Abstract: A method for automated speech recognition includes generating first and second pluralities of candidate speech recognition results corresponding to audio input data using a first general-purpose speech recognition engine and a second domain-specific speech recognition engine, respectively. The method further includes generating a third plurality of candidate speech recognition result including a plurality of words included in one of the first plurality of speech recognition results and at least one word included in another one of the second plurality of speech recognition results, ranking the third plurality of candidate speech recognition results using a pairwise ranker to identify a highest ranked candidate speech recognition result, and operating the automated system using the highest ranked speech recognition result as an input from the user.
    Type: Application
    Filed: September 30, 2016
    Publication date: April 5, 2018
    Inventors: Zhengyu Zhou, Zhe Feng
  • Publication number: 20160340638
    Abstract: The present invention directs to a centrifugal filtration device, for separating living cells, including a spindle (28), a rotary arm (211) which is connected vertically to the spindle (28), a microporous membrane filter (31A;31B) which is mounted on the rotary arm (211), and a liquid distributor (4) arranged above the spindle (28). The microporous membrane filter (31A;31B) includes an inlet (311A;311B), an outlet (312A;312B), a front cavity (313A;313B) having the inlet (311A;311B) formed thereon, a rear cavity having the outlet (312A;312B) formed thereon, and a filter membrane (315A;315B) arranged between the front cavity and the rear cavity; the diameter of each filter pore formed in the filter membrane is smaller than that of the cell which needs to be separated. The present invention also discloses a cell separation system.
    Type: Application
    Filed: August 8, 2016
    Publication date: November 24, 2016
    Inventors: Chong Zheng, Zhengyu Zhou