Patents by Inventor Xufang Zhao

Xufang Zhao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9484027
    Abstract: A method of automated speech recognition in a vehicle. The method includes receiving audio in the vehicle, pre-processing the received audio to generate acoustic feature vectors, decoding the generated acoustic feature vectors to produce at least one speech hypothesis, and post-processing the at least one speech hypothesis using pitch to improve speech recognition accuracy. The speech hypothesis can be accepted as recognized speech during post-processing if pitch is present in the received audio. Alternatively, a pitch count for the received audio can be determined, N-best speech hypotheses can be post-processed by comparing the pitch count to syllable counts associated with the speech hypotheses, and the speech hypothesis having a syllable count equal to the pitch count can be accepted as recognized speech.
    Type: Grant
    Filed: December 10, 2009
    Date of Patent: November 1, 2016
    Assignee: General Motors LLC
    Inventors: Xufang Zhao, Uma Arun
  • Publication number: 20160307568
    Abstract: A system and method of controlling an automatic speech recognition (ASR) system includes: receiving speech at the ASR system from a vehicle occupant that includes a command to control a vehicle function; identifying a gate command from the speech; associating the identified gate command with the command to control the vehicle function; storing the associated gate command and vehicle command in a database; receiving additional speech at the ASR system from the vehicle occupant; detecting the gate command in the additional speech; and accessing the stored gate command and vehicle command from the database.
    Type: Application
    Filed: April 14, 2015
    Publication date: October 20, 2016
    Inventors: Xufang ZHAO, Gaurav TALWAR
  • Publication number: 20160307562
    Abstract: A system and method of controlling an automatic speech recognition (ASR) system includes: determining the location of a vehicle; identifying terrestrial radio stations in a database that are within a range of the vehicle location based on geographic locations of the terrestrial radio stations stored in the database; and altering the content of a speech grammar used by the ASR system to process speech received in the vehicle that requests a terrestrial radio station.
    Type: Application
    Filed: April 14, 2015
    Publication date: October 20, 2016
    Inventors: Xufang ZHAO, Gaurav TALWAR, Joseph M. HUK, JR.
  • Patent number: 9473094
    Abstract: A system and method of regulating automatic speech recognition (ASR) playback of audible prompts includes: generating an audible prompt via a speaker; detecting ambient sound during the audible prompt via a microphone; obtaining a speech recognition confidence value for speech recognition performed on the ambient sound; and reducing a volume level of the audible prompt based on the speech recognition confidence value while continuing to generate the audible prompt.
    Type: Grant
    Filed: May 23, 2014
    Date of Patent: October 18, 2016
    Assignee: General Motors LLC
    Inventors: Gaurav Talwar, Xufang Zhao, Eli Tzirkel-Hancock
  • Publication number: 20160300050
    Abstract: A system and method of verifying a biometric variable of a handheld wireless device user includes: receiving at a wireless device a biometric variable measured using a handheld wireless device; detecting the biometric variable at the wireless device in response to receiving the biometric variable measured using the handheld wireless device; performing feature recognition at the wireless device on the detected biometric variable; comparing the feature recognition performed at the wireless device with the biometric variable measured using the handheld wireless device; permitting access to one or more features available at the wireless device or the handheld wireless device when the comparison is within a predetermined range of values; and denying access to the wireless device or the handheld device when the comparison is outside of the predetermined range of values.
    Type: Application
    Filed: May 28, 2014
    Publication date: October 13, 2016
    Applicant: GM Global Technology Operations LLC
    Inventors: Ron M. Hecht, Omer Tsimhoni, Xufang Zhao, Gaurav Talwar
  • Patent number: 9446770
    Abstract: A vehicle including a passenger compartment having a rear seating area is described. A method for monitoring the rear seating area of the passenger compartment includes monitoring a vehicle operating state comprising one of a key-on state and a key-off state and monitoring the rear seating area. A presence or absence of a passenger in the rear seating area is detected based upon the monitoring, and a control routine is executed based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area.
    Type: Grant
    Filed: January 29, 2015
    Date of Patent: September 20, 2016
    Assignee: GM Global Technology Operations LLC
    Inventors: Frank C. Valeri, Scott M. Reilly, Eli Tzirkel-Hancock, Gaurav Talwar, John L. Holdren, Xufang Zhao
  • Publication number: 20160268987
    Abstract: A system and method of adjusting digital audio sampling used with wideband audio includes: performing audio sampling on an analog audio signal at an initial sampling rate and an initial bit rate over a wideband audio frequency range; generating a digital audio signal based on the audio sampling; detecting a qualitative error rate between the analog audio signal and the digital audio signal; and decreasing the initial sampling rate, the initial bit rate, or both for sampling subsequent analog audio when the qualitative error is below a threshold.
    Type: Application
    Filed: March 10, 2015
    Publication date: September 15, 2016
    Inventors: Gaurav Talwar, Xufang Zhao, MD Foezur Rahman Chowdhury, Eli Tzirkel-Hancock
  • Publication number: 20160267901
    Abstract: A system and method of controlling machine-generated speech in a vehicle includes: receiving a machine-generated voice selection from a vehicle occupant; accessing the machine-generated voice at the vehicle based on the selection; converting text to speech based on the machine-generated voice; and generating the speech through a vehicle audio system using the machine-generated voice selection.
    Type: Application
    Filed: March 10, 2015
    Publication date: September 15, 2016
    Inventors: Xufang Zhao, Bassam S. Shahmurad, Ilan Malka
  • Publication number: 20160221581
    Abstract: A method for classifying a road surface being traversed by a vehicle. The method comprises receiving one or more electrical signals each representative of a vibration detected by a sensor carried by the vehicle. The method further comprises identifying, for at least one of the received electrical signals, a pattern in the detected vibration represented by that/those signal(s), and matching the identified pattern to one of one or more known patterns, wherein each known pattern corresponds to a respective road surface classification. The method further comprises classifying the road surface in accordance with the road surface classification corresponding to the known pattern matching the identified pattern. A system comprising one or more sensors carried by the vehicle that is/are configured to detect a vibration, and a pattern classification system for performing the methodology described above, is also provided.
    Type: Application
    Filed: January 29, 2015
    Publication date: August 4, 2016
    Inventors: Gaurav Talwar, Xufang Zhao, Ron M. Hecht, Thomas M. Forest
  • Publication number: 20160221583
    Abstract: A vehicle including a passenger compartment having a rear seating area is described. A method for monitoring the rear seating area of the passenger compartment includes monitoring a vehicle operating state comprising one of a key-on state and a key-off state and monitoring the rear seating area. A presence or absence of a passenger in the rear seating area is detected based upon the monitoring, and a control routine is executed based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area.
    Type: Application
    Filed: January 29, 2015
    Publication date: August 4, 2016
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Frank C. Valeri, Scott M. Reilly, Eli Tzirkel-Hancock, Gaurav Talwar, John L. Holdren, Xufang Zhao
  • Publication number: 20160118042
    Abstract: An automatic speech recognition engine and a method of using the engine is described. The method pertains to front-end processing an audio signal and includes the steps of: identifying a plurality of voiced-frames of the audio signal; determining that one or more of the plurality of voiced-frames have a signal-to-noise (SNR) value greater than a first predetermined threshold; and based on the determination, bypassing noise suppression for the one or more of the plurality of voiced-frames.
    Type: Application
    Filed: October 22, 2014
    Publication date: April 28, 2016
    Inventors: Gaurav Talwar, Xufang Zhao, III, Robert D. Sims, III, Md Foezur Rahman Chowdhury
  • Publication number: 20160111090
    Abstract: A system and method of providing speech received in a vehicle to an automatic speech recognition (ASR) system includes: receiving speech at the vehicle from a vehicle occupant; providing the received speech to a remotely-located ASR system and a vehicle-based ASR system; and thereafter determining a confidence level for the speech processed by the vehicle-based ASR system; presenting in the vehicle results from the vehicle-based ASR system when the determined confidence level is above a predetermined confidence threshold is not above; presenting in the vehicle results from the remotely-located ASR system when the determined confidence level is not above a predetermined confidence threshold.
    Type: Application
    Filed: October 16, 2014
    Publication date: April 21, 2016
    Inventors: John L. Holdren, Gaurav Talwar, Xufang Zhao, Matthew J. Heger
  • Patent number: 9286030
    Abstract: A method for processing a plurality of audio streams at a computer system onboard a vehicle is provided. The method receives the plurality of audio streams from a plurality of locations within a vehicle; prioritizes each of the plurality of audio streams to obtain a prioritization result; and completes a task associated with each of the plurality of audio streams, according to the prioritization result.
    Type: Grant
    Filed: October 18, 2013
    Date of Patent: March 15, 2016
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: John L. Holdren, Xufang Zhao, Gaurav Talwar
  • Publication number: 20160071509
    Abstract: A method is disclosed that provides text-to-speech (TTS) functionality to a telematics unit of a telematics-equipped vehicle. The method includes: receiving text content to be played back by an audio system of the telematics-equipped vehicle; determining, by a processor, a TTS rendering process to be used for the text content from a plurality of TTS rendering processes, wherein the plurality of TTS rendering processes include local TTS rendering using a local TTS engine at the telematics-equipped vehicle and remote TTS rendering using a remote TTS engine at a communications center; and causing, by the processor, the text content to be rendered as an audio signal for playback by the telematics-equipped vehicle using the determined TTS rendering process.
    Type: Application
    Filed: September 5, 2014
    Publication date: March 10, 2016
    Inventors: XUFANG ZHAO, OMER TSIMHONI, Gaurav Talwar
  • Patent number: 9269352
    Abstract: At least first and second microphones with different frequency responses form part of a speech recognition system. The microphones are coupled to a processor that is configured to recognize a spoken word based on the microphone signals. The processor classifies the spoken word, and weights the signals from the microphones based on the classification of the spoken word.
    Type: Grant
    Filed: May 13, 2013
    Date of Patent: February 23, 2016
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Gaurav Talwar, Xufang Zhao
  • Publication number: 20160039356
    Abstract: A system and method of activating at least some of a plurality of microphones in a vehicle includes: identifying an acoustic zone within the vehicle where a vehicle occupant is located; detecting one or more biometric attributes of the vehicle occupant; determining a location within the acoustic zone where the vehicle occupant utters speech based on the detected biometric attributes; and activating a subset of the plurality of microphones in the vehicle to receive speech within the acoustic zone based on the determined location.
    Type: Application
    Filed: August 8, 2014
    Publication date: February 11, 2016
    Inventors: Gaurav Talwar, MD Foezur Rahman Chowdhury, Xufang Zhao
  • Publication number: 20150350758
    Abstract: A hands-free audio system for a vehicle and method of using the system is described. The method includes controlling the directionality of a vehicle microphone. The steps of the method may include: (a) receiving a sensor value from at least one of a vehicle seat position sensor, a vehicle seat orientation sensor, or a vehicle mirror orientation sensor; (b) based on the received sensor value(s) of step (a), determining an origin of a vehicle user's speech; and (c) controlling the microphone sensitivity directionality based on the determined origin.
    Type: Application
    Filed: June 3, 2014
    Publication date: December 3, 2015
    Applicant: GM Global Technology Operations LLC
    Inventors: Xufang Zhao, Robert D. Sims, III, Md Foezur Rahman Chowdhury, John J. Correia
  • Patent number: 9202459
    Abstract: Methods and systems are provided for managing speech dialog of a speech system. In one embodiment, a method includes: receiving a first utterance from a user of the speech system; determining a first list of possible results from the first utterance, wherein the first list includes at least two elements that each represent a possible result; analyzing the at least two elements of the first list to determine an ambiguity of the elements; and generating a speech prompt to the user based on partial orthography and the ambiguity.
    Type: Grant
    Filed: April 19, 2013
    Date of Patent: December 1, 2015
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Eli Tzirkel-Hancock, Gaurav Talwar, Xufang Zhao, Greg T. Lindemann
  • Patent number: 9202465
    Abstract: A method of automatic speech recognition. An utterance is received from a user in reply to a text message, via a microphone that converts the reply utterance into a speech signal. The speech signal is processed using at least one processor to extract acoustic data from the speech signal. An acoustic model is identified from a plurality of acoustic models to decode the acoustic data, and using a conversational context associated with the text message. The acoustic data is decoded using the identified acoustic model to produce a plurality of hypotheses for the reply utterance.
    Type: Grant
    Filed: March 25, 2011
    Date of Patent: December 1, 2015
    Assignee: General Motors LLC
    Inventors: Gaurav Talwar, Xufang Zhao
  • Publication number: 20150341005
    Abstract: A system and method of regulating automatic speech recognition (ASR) playback of audible prompts includes: generating an audible prompt via a speaker; detecting ambient sound during the audible prompt via a microphone; obtaining a speech recognition confidence value for speech recognition performed on the ambient sound; and reducing a volume level of the audible prompt based on the speech recognition confidence value while continuing to generate the audible prompt.
    Type: Application
    Filed: May 23, 2014
    Publication date: November 26, 2015
    Applicant: General Motors LLC
    Inventors: Gaurav Talwar, Xufang Zhao, Eli Tzirkel-Hancock