Patents by Inventor Patrick Naylor

Patrick Naylor has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11967305
    Abstract: A method, computer program product, and computing system for generating a three-dimensional model of at least a portion of a three-dimensional space incorporating an ACI system via a video recording subsystem of an ACI calibration platform; and generating one or more audio calibration signals for receipt by an audio recording system included within the ACI system via an audio generation subsystem of the ACI calibration platform.
    Type: Grant
    Filed: June 15, 2022
    Date of Patent: April 23, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Dushyant Sharma, Patrick A. Naylor, Joel Praveen Pinto, Daniel Paulino Almendro Barreda
  • Patent number: 11961504
    Abstract: A method, computer program product, and computing system for receiving feature-based voice data associated with a first acoustic domain. One or more rate-based augmentations may be performed on at least a portion of the feature-based voice data, thus defining rate-based augmented feature-based voice data.
    Type: Grant
    Filed: March 10, 2021
    Date of Patent: April 16, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Dushyant Sharma, Patrick A. Naylor
  • Patent number: 11950081
    Abstract: A method, computer program product, and computing system for generating a plurality of acoustic relative transfer functions for a plurality of audio acquisition devices of an audio recording system deployed in an acoustic environment. The plurality of acoustic relative transfer functions may be encoded into a first embedding of acoustic relative transfer functions and at least a second embedding of acoustic relative transfer functions. Information may be extracted from at least the first embedding of acoustic relative transfer functions.
    Type: Grant
    Filed: February 11, 2022
    Date of Patent: April 2, 2024
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Dushyant Sharma, Patrick A. Naylor, Uwe Helmut Jost
  • Patent number: 11924624
    Abstract: A method, computer program product, and computing system for selecting a reference audio acquisition device from a plurality of audio acquisition devices of an audio recording system. Audio encounter information of the reference microphone may be encoded, thus defining encoded reference audio encounter information. A plurality of acoustic relative transfer functions between the reference microphone and the plurality of audio acquisition devices of the audio recording system may be generated. The encoded reference audio encounter information and a representation of the plurality of acoustic relative transfer functions may be transmitted.
    Type: Grant
    Filed: February 11, 2022
    Date of Patent: March 5, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Dushyant Sharma, Patrick A. Naylor, Uwe Helmut Jost
  • Publication number: 20240005946
    Abstract: There is provided a speech processing system that includes a neural encoder module. A processor that receives an audio signal; and the memory that contains instructions that control said processor to perform operations that process speech. In an implementation, a front end module can include a Neural Spatial RTF Estimator and a neural spatial and residual encoder (NSRE) configured accept as inputs a spectral encoded reference channel stream to output Neural Transfer Functions (NTFs). In another implementation, a front end module encodes and outputs a Ch1 bitstream; computes a plurality of relative transfer functions (RTFs) for an N-Channel signal and outputs an N?1 RTFs or an RTF codebook ids and computes and processes an N?1 residual stream; and a back end module comprising a neural encoder module configured to accept the RTFs and output an encoded speech signal comprising an embedding that comprises features extracted from RTFs.
    Type: Application
    Filed: June 30, 2022
    Publication date: January 4, 2024
    Applicant: NUANCE COMMUNICATIONS, INC.
    Inventors: Dushyant SHARMA, Patrick NAYLOR, Daniel T. JONES
  • Patent number: 11837228
    Abstract: A method, computer program product, and computing system for receiving a speech signal from each microphone of a plurality of microphones, thus defining a plurality of signals. One or more noise signals associated with microphone self-noise may be received. One or more self-noise-based augmentations may be performed on the plurality of signals based upon, at least in part, the one or more noise signals associated with microphone self-noise, thus defining one or more self-noise-based augmented signals.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: December 5, 2023
    Assignee: Nuance Communications, Inc.
    Inventors: Dushyant Sharma, Patrick A. Naylor, Rong Gong, Stanislav Kruchinin, Ljubomir Milanovic
  • Patent number: 11835625
    Abstract: A method of performing distance estimation between a first recording device at a first location and a second recording device at a second location includes: estimating acoustic relative transfer function (RTF) between the first recording device and the second recording device for a sound signal, e.g., by applying an improved proportionate normalized least mean square (IPNLMS) filter; and estimating the distance between the first recording device and the second recording device based on the RTF. The at least one acoustic feature extracted from the RTF estimated between the first recording device and the second recording device includes at least one of clarity index, direct-to-reverberant ratio (DRR), and reverberation time. A distributed-gradient-boosting algorithm with regression trees is used in combination with signal-to-reverberation ratio (SRR) and the at least one acoustic feature extracted from the RTF to estimate the distance between the first recording device and the second recording device.
    Type: Grant
    Filed: March 15, 2022
    Date of Patent: December 5, 2023
    Assignee: Microsoft Technology Licensing, LLC.
    Inventors: Francesco Nespoli, Patrick Naylor, Daniel Barreda
  • Patent number: 11783826
    Abstract: A method, computer program product, and computing system for receiving one or more inputs indicative of at least one of: a relative location of a speaker and a microphone array, and a relative orientation of the speaker and the microphone array. One or more reference signals may be received. A speech processing system may be trained using the one or more inputs and the one or more reference signals.
    Type: Grant
    Filed: February 18, 2021
    Date of Patent: October 10, 2023
    Assignee: Nuance Communications, Inc.
    Inventors: Patrick A. Naylor, Dushyant Sharma, Uwe Helmut Jost, William F. Ganong, III
  • Publication number: 20230315815
    Abstract: A method includes: providing a workstation having a playback app configured for audio playback; providing a decryption module having a decryption functionality communicatively connected to the playback app; encrypting, by a server using an encryption key associated with the decryption module, audio data; and decrypting, using the decryption module, the encrypted audio data. The decryption module having the decryption functionality is provided as part of the playback app, as part of firmware of a headphone, or as part of a phone app. The method can additionally include: i) authenticating, using a voice biometric authentication module, a transcriber; ii) enabling decryption by the decryption module only upon input of a decode PIN by the transcriber; and iii) a) modifying the audio data to spatialize speech component and noise component of the audio data at different angles using head-related transfer function (HRTF) filtering, and b) playing back the audio data binaurally.
    Type: Application
    Filed: April 5, 2022
    Publication date: October 5, 2023
    Applicant: NUANCE COMMUNICATIONS, INC.
    Inventors: William F. GANONG, III, Ljubomir MILANOVIC, Uwe JOST, Dushyant SHARMA, Patrick NAYLOR
  • Patent number: 11769486
    Abstract: A method, computer program product, and computing system for defining model representative of a plurality of acoustic variations to a speech signal, thus defining a plurality of time-varying spectral modifications. The plurality of time-varying spectral modifications may be applied to a plurality of feature coefficients of a target domain of a reference signal, thus generating a plurality of time-varying spectrally-augmented feature coefficients of the reference signal.
    Type: Grant
    Filed: February 18, 2021
    Date of Patent: September 26, 2023
    Assignee: Nuance Communications, Inc.
    Inventors: Patrick A. Naylor, Dushyant Sharma, Uwe Helmut Jost, William F. Ganong, III
  • Publication number: 20230296767
    Abstract: A method of performing distance estimation between a first recording device at a first location and a second recording device at a second location includes: estimating acoustic relative transfer function (RTF) between the first recording device and the second recording device for a sound signal, e.g., by applying an improved proportionate normalized least mean square (IPNLMS) filter; and estimating the distance between the first recording device and the second recording device based on the RTF. The at least one acoustic feature extracted from the RTF estimated between the first recording device and the second recording device includes at least one of clarity index, direct-to-reverberant ratio (DRR), and reverberation time. A distributed-gradient-boosting algorithm with regression trees is used in combination with signal-to-reverberation ratio (SRR) and the at least one acoustic feature extracted from the RTF to estimate the distance between the first recording device and the second recording device.
    Type: Application
    Filed: March 15, 2022
    Publication date: September 21, 2023
    Applicant: NUANCE COMMUNICATIONS, INC.
    Inventors: Francesco NESPOLI, Patrick NAYLOR, Daniel BARREDA
  • Publication number: 20230267944
    Abstract: A method of performing at least de-reverberation and noise-reduction of an input sound signal of at least one input channel includes: performing, using at least one filter element, at least one of de-reverberation and noise-reduction of the input sound signal to generate a clean output sound signal; and determining, by a non-intrusive measure (NIM) estimation element, at least one non-intrusive measure (NIM) from the sound signal, wherein the at least one NIM includes at least one of voice activity detection (VAD) posterior, reverberation time, clarity index, direct-to-reverberant ratio (DRR), and signal-to-noise ratio (SNR); the de-reverberation is achieved by applying at least one channel shortening (CS) filter component of the at least one filter element in conjunction with the at least one NIM; and the noise reduction is performed in combination with the de-reverberation by the channel shortening (CS) filter component.
    Type: Application
    Filed: February 18, 2022
    Publication date: August 24, 2023
    Applicant: NUANCE COMMUNICATIONS, INC.
    Inventors: Sharma DUSHYANT, James FOSBURGH, Patrick NAYLOR
  • Publication number: 20230230599
    Abstract: A method, computer program product, and computing system for obtaining one or more speech signals from a first device, thus defining one or more first device speech signals. One or more speech signals may be obtained from a second device, thus defining one or more second device speech signals. One or more acoustic relative transfer functions mapping reverberation from the one or more first device speech signals to the one or more second device speech signals may be generated. One or more augmented second device speech signals may be generated based upon, at least in part, the one or more acoustic relative transfer functions and first device training data.
    Type: Application
    Filed: January 20, 2022
    Publication date: July 20, 2023
    Inventors: Dushyant Sharma, Ljubomir Milanovic, Philipp Salletmayr, Rong Gong, Patrick A. Naylor
  • Publication number: 20230230582
    Abstract: A method, computer program product, and computing system for obtaining one or more speech signals from a first device, thus defining one or more first device speech signals. One or more speech signals may be obtained from a second device, thus defining one or more second device speech signals. An acoustic relative transfer function may be selected from a plurality of acoustic relative transfer functions based upon, at least in part, the one or more first device speech signals and the one or more second device speech signals. The one or more second device speech signals may be augmented, at run-time, based upon, at least in part, the acoustic relative transfer function.
    Type: Application
    Filed: January 20, 2022
    Publication date: July 20, 2023
    Inventors: Dushyant Sharma, Ljubomir Milanovic, Philipp Salletmayr, Rong Gong, Patrick A. Naylor
  • Publication number: 20230230580
    Abstract: A method, computer program product, and computing system for obtaining one or more speech signals from a first device, thus defining one or more first device speech signals. One or more speech signals may be obtained from a second device, thus defining one or more second device speech signals. A noise component model may be selected from a plurality of noise component models based upon, at least in part, the one or more first device speech signals and the one or more second device speech signals. The one or more second device speech signals may be augmented, at run-time, based upon, at least in part, the noise component model.
    Type: Application
    Filed: January 20, 2022
    Publication date: July 20, 2023
    Inventors: Dushyant Sharma, Ljubomir Milanovic, Philipp Salletmayr, Rong Gong, Patrick A. Naylor
  • Publication number: 20230230581
    Abstract: A method, computer program product, and computing system for obtaining one or more speech signals from a first device, thus defining one or more first device speech signals. One or more speech signals may be obtained from a second device, thus defining one or more second device speech signals. One or more noise component models mapping one or more noise components from the one or more first device speech signals to the one or more second device speech signals may be generated. One or more augmented second device speech signals may be generated based upon, at least in part, the one or more noise component models and first device training data.
    Type: Application
    Filed: January 20, 2022
    Publication date: July 20, 2023
    Inventors: Dushyant Sharma, Ljubomir Milanovi, Philip Salletmayr, Rong Gong, Patrick A. Naylor
  • Patent number: 11699440
    Abstract: A method, computer program product, and computing system for receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals. One or more inter-microphone gain-based augmentations may be performed on the plurality of signals, thus defining one or more inter-microphone gain-augmented signals.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: July 11, 2023
    Assignee: Nuance Communications, Inc.
    Inventors: Dushyant Sharma, Patrick A. Naylor, Rong Gong, Stanislav Kruchinin, Ljubomir Milanovic
  • Patent number: 11676598
    Abstract: A method, computer program product, and computing system for receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals. One or more microphone frequency responses associated with at least one microphone may be received. One or more microphone frequency response-based augmentations may be performed on the plurality of signals based upon, at least in part, the one or more microphone frequency responses, thus defining one or more microphone frequency response-based augmented signals.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: June 13, 2023
    Assignee: Nuance Communications, Inc.
    Inventors: Dushyant Sharma, Patrick A. Naylor, Rong Gong, Stanislav Kruchinin, Ljubomir Milanovic
  • Patent number: 11670282
    Abstract: A method, computer program product, and computing system for obtaining calibration information for a three-dimensional space incorporating an ACI system; and processing the calibration information to calibrate the ACI system.
    Type: Grant
    Filed: April 25, 2022
    Date of Patent: June 6, 2023
    Assignee: Nuance Communications, Inc.
    Inventors: Dushyant Sharma, Patrick A. Naylor, Joel Praveen Pinto, Daniel Paulino Almendro Barreda
  • Patent number: 11670298
    Abstract: A method, computer program product, and computing system for receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals. Harmonic distortion associated with at least one microphone may be determined. One or more harmonic distortion-based augmentations may be performed on the plurality of signals based upon, at least in part, the harmonic distortion associated with the at least one microphone, thus defining one or more harmonic distortion-based augmented signals.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: June 6, 2023
    Assignee: Nuance Communications, Inc.
    Inventors: Dushyant Sharma, Patrick A. Naylor, Rong Gong, Stanislav Kruchinin, Ljubomir Milanovic