Patents by Inventor Mohamed Mansour

Mohamed Mansour has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11163428
    Abstract: A device is disclosed, which includes a processor and a memory in communication with the processor. The memory includes executable instructions that, when executed by the processor, cause the processor to control the device to perform functions of providing a graphical user interface for a user on a display; displaying a user interface component on the graphical user interface; providing a pointer on the graphical user interface controlled by the user to interact with the user interface component on the graphical user interface; in response to the pointer being positioned over the displayed user interface component, and displaying after a dynamic hover trigger delay a hover graphic proximate to the component wherein the dynamic hover trigger delay dynamically changes depending on movement of the pointer by the user.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: November 2, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Mohamed Mansour, Federico Paredes Garza, Mathew Paul Siembor, Felix Andrew
  • Publication number: 20210327442
    Abstract: A system may embed audio watermarks in audio data using an Eigenvector matrix. The system may detect audio watermarks in audio data despite the effects of reverberation. For example, the system may embed multiple repetitions of an audio watermark before generating output audio using loudspeaker(s). To detect the audio watermark in audio data generated by a microphone, the system may perform a self-correlation that indicates where the audio watermark is repeated. In some examples, the system may encode the audio watermark using multiple repetitions of a multi-segment Eigenvector. Additionally or alternatively, the system may encode the audio watermark using a binary sequence of positive and negative values, which may be used as a shared key for encoding/decoding the audio watermark. The audio watermark can be embedded in output audio data to enable wakeword suppression (e.g., avoid cross-talk between devices) and/or local signal transmission between devices in proximity to each other.
    Type: Application
    Filed: March 15, 2021
    Publication date: October 21, 2021
    Inventors: Yuan-Yen Tai, Mohamed Mansour, Parind Shah
  • Patent number: 11107488
    Abstract: A system configured to perform echo cancellation using a reduced number of reference signals. The system may perform multi-channel acoustic echo cancellation (MCAEC) processing on a first portion of a microphone audio signal that corresponds to early reflections and may perform single-channel acoustic echo cancellation (AEC) processing on a second portion of the microphone audio signal that corresponds to late reverberations. For example, the system may use MCAEC processing on a plurality of reference audio signals to generate a first echo estimate signal and may subtract the first echo estimate signal from the microphone audio signal to generate a residual audio signal. The system may delay the first echo estimate signal, perform the AEC processing to generate a second echo estimate signal, and subtract the second echo estimate signal from the residual audio signal to generate an output audio signal. This reduces an overall complexity associated with performing echo cancellation.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: August 31, 2021
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Mohamed Mansour, Shobha Devi Kuruba Buchannagari
  • Patent number: 11073545
    Abstract: A forward-backward Kalman filter for estimating phase noise present in a received signal. Both the forward and backward Kalman filters use hard-decision measurements of the received symbols. The phase noise estimate from the forward Kalman filter is used as a coarse phase noise estimate for the backward Kalman filter and vice versa. The final phase noise estimate is an optimal combination of the forward phase noise estimate and backward phase noise estimate.
    Type: Grant
    Filed: December 6, 2019
    Date of Patent: July 27, 2021
    Assignee: Texas Instruments Incorporated
    Inventor: Mohamed Mansour
  • Publication number: 20210134313
    Abstract: A system configured to perform cascade echo cancellation processing to improve a performance when reference signals are asymmetric (e.g., dominant reference signal(s) overshadow weak reference signal(s)). The system may perform cascade echo cancellation processing to separately adapt filter coefficients between the dominant reference signal(s) and the weak reference signal(s). For example, the system may use a dominant reference signal to process a microphone audio signal and generate a residual audio signal, using the residual audio signal to adapt first filter coefficient values corresponding to the dominant reference signal. Separately, the system may use a weak reference signal to process the residual audio signal and generate an output audio signal, using the output audio signal to adapt second filter coefficient values corresponding to the weak reference signal.
    Type: Application
    Filed: July 21, 2020
    Publication date: May 6, 2021
    Inventors: Mohamed Mansour, Shobha Devi Kuruba Buchannagari
  • Patent number: 10986444
    Abstract: Techniques for simulating a microphone array and generating synthetic audio data to analyze the microphone array geometry. This reduces the development cost of new microphone arrays by enabling an evaluation of performance metrics (False Rejection Rate (FRR), Word Error Rate (WER), etc.) without building device hardware or collecting data. To generate the synthetic audio data, the system performs acoustic modeling to determine a room impulse response associated with a prototype device (e.g., potential microphone array) in a room. The acoustic modeling is based on two parameters—a device response (information about acoustics and geometry of the prototype device) and a room response (information about acoustics and geometry of the room). The device response can be simulated based on the microphone array geometry, and the room response can be determined using a specialized microphone and a plane wave decomposition algorithm.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: April 20, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Mohamed Mansour, Guangdong Pan
  • Patent number: 10978081
    Abstract: A system may embed audio watermarks in audio data using a sign sequence. The system may detect audio watermarks in audio data despite the effects of reverberation. For example, the system may embed multiple repetitions of an audio watermark before generating output audio using loudspeaker(s). To detect the audio watermark in audio data generated by a microphone, the system may perform a self-correlation that indicates where the audio watermark is repeated. In some examples, the system may encode the audio watermark using multiple repetitions of a multi-segment Eigenvector. Additionally or alternatively, the system may encode the audio watermark using a binary sequence of positive and negative values, which may be used as a shared key for encoding/decoding the audio watermark. The audio watermark can be embedded in output audio data to enable wakeword suppression (e.g., avoid cross-talk between devices) and/or local signal transmission between devices in proximity to each other.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: April 13, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Yuan-Yen Tai, Mohamed Mansour, Parind Shah
  • Patent number: 10950249
    Abstract: A system may embed audio watermarks in audio data using an Eigenvector matrix. The system may detect audio watermarks in audio data despite the effects of reverberation. For example, the system may embed multiple repetitions of an audio watermark before generating output audio using loudspeaker(s). To detect the audio watermark in audio data generated by a microphone, the system may perform a self-correlation that indicates where the audio watermark is repeated. In some examples, the system may encode the audio watermark using multiple repetitions of a multi-segment Eigenvector. Additionally or alternatively, the system may encode the audio watermark using a binary sequence of positive and negative values, which may be used as a shared key for encoding/decoding the audio watermark. The audio watermark can be embedded in output audio data to enable wakeword suppression (e.g., avoid cross-talk between devices) and/or local signal transmission between devices in proximity to each other.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: March 16, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Yuan-Yen Tai, Mohamed Mansour, Parind Shah
  • Patent number: 10887709
    Abstract: A system configured to perform aligned beam merger (ABM) processing to combine multiple beamformed signals. The system may capture audio data and perform beamforming to generate beamformed audio signals corresponding to a plurality of directions. The system may apply an ABM algorithm to select a number of the beamformed audio signals, align the selected audio signals, and merge the selected audio signals to generate a distortionless output audio signal. The system may scale the selected audio signals based on relative magnitude and apply a complex correction factor to compensate for a phase error for each of the selected audio signals.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: January 5, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Mohamed Mansour, Carlos Renato Nakagawa
  • Patent number: 10811029
    Abstract: A system configured to perform cascade echo cancellation processing to improve a performance when reference signals are asymmetric (e.g., dominant reference signal(s) overshadow weak reference signal(s)). The system may perform cascade echo cancellation processing to separately adapt filter coefficients between the dominant reference signal(s) and the weak reference signal(s). For example, the system may use a dominant reference signal to process a microphone audio signal and generate a residual audio signal, using the residual audio signal to adapt first filter coefficient values corresponding to the dominant reference signal. Separately, the system may use a weak reference signal to process the residual audio signal and generate an output audio signal, using the output audio signal to adapt second filter coefficient values corresponding to the weak reference signal.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: October 20, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Mohamed Mansour, Shobha Devi Kuruba Buchannagari
  • Publication number: 20200196053
    Abstract: Techniques for simulating a microphone array and generating synthetic audio data to analyze the microphone array geometry. This reduces the development cost of new microphone arrays by enabling an evaluation of performance metrics (False Rejection Rate (FRR), Word Error Rate (WER), etc.) without building device hardware or collecting data. To generate the synthetic audio data, the system performs acoustic modeling to determine a room impulse response associated with a prototype device (e.g., potential microphone array) in a room. The acoustic modeling is based on two parameters—a device response (information about acoustics and geometry of the prototype device) and a room response (information about acoustics and geometry of the room). The device response can be simulated based on the microphone array geometry, and the room response can be determined using a specialized microphone and a plane wave decomposition algorithm.
    Type: Application
    Filed: February 24, 2020
    Publication date: June 18, 2020
    Inventors: Mohamed Mansour, Guangdong Pan
  • Patent number: 10657981
    Abstract: Techniques for improving acoustic echo cancellation to attenuate an echo signal generated by a loudspeaker included in a device are described. A system may determine a loudspeaker canceling beam (LCB) (e.g., fixed beam directed to the loudspeaker) and may use the LCB to generate LCB audio data that corresponds to the echo signal. For example, based on a configuration of the loudspeaker relative to microphone(s) of the device, the system may perform simulation(s) to generate a plurality of filter coefficient values corresponding to the loudspeaker. By subtracting the LCB audio data during acoustic echo cancellation, the system may attenuate the echo signal even when there is distortion or nonlinearity or the like caused by the loudspeaker. In some examples, the system may perform acoustic echo cancellation using the LCB audio data and playback audio data.
    Type: Grant
    Filed: May 17, 2018
    Date of Patent: May 19, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Mohamed Mansour, Robert Ayrapetian
  • Publication number: 20200116774
    Abstract: A forward-backward Kalman filter for estimating phase noise present in a received signal. Both the forward and backward Kalman filters use hard-decision measurements of the received symbols. The phase noise estimate from the forward Kalman filter is used as a coarse phase noise estimate for the backward Kalman filter and vice versa. The final phase noise estimate is an optimal combination of the forward phase noise estimate and backward phase noise estimate.
    Type: Application
    Filed: December 6, 2019
    Publication date: April 16, 2020
    Inventor: Mohamed Mansour
  • Publication number: 20200098379
    Abstract: A system may embed audio watermarks in audio data using an Eigenvector matrix. The system may detect audio watermarks in audio data despite the effects of reverberation. For example, the system may embed multiple repetitions of an audio watermark before generating output audio using loudspeaker(s). To detect the audio watermark in audio data generated by a microphone, the system may perform a self-correlation that indicates where the audio watermark is repeated. In some examples, the system may encode the audio watermark using multiple repetitions of a multi-segment Eigenvector. Additionally or alternatively, the system may encode the audio watermark using a binary sequence of positive and negative values, which may be used as a shared key for encoding/decoding the audio watermark. The audio watermark can be embedded in output audio data to enable wakeword suppression (e.g., avoid cross-talk between devices) and/or local signal transmission between devices in proximity to each other.
    Type: Application
    Filed: September 25, 2018
    Publication date: March 26, 2020
    Inventors: Yuan-Yen Tai, Mohamed Mansour, Parind Shah
  • Publication number: 20200098380
    Abstract: A system may embed audio watermarks in audio data using a sign sequence. The system may detect audio watermarks in audio data despite the effects of reverberation. For example, the system may embed multiple repetitions of an audio watermark before generating output audio using loudspeaker(s). To detect the audio watermark in audio data generated by a microphone, the system may perform a self-correlation that indicates where the audio watermark is repeated. In some examples, the system may encode the audio watermark using multiple repetitions of a multi-segment Eigenvector. Additionally or alternatively, the system may encode the audio watermark using a binary sequence of positive and negative values, which may be used as a shared key for encoding/decoding the audio watermark. The audio watermark can be embedded in output audio data to enable wakeword suppression (e.g., avoid cross-talk between devices) and/or local signal transmission between devices in proximity to each other.
    Type: Application
    Filed: September 25, 2018
    Publication date: March 26, 2020
    Inventors: Yuan-Yen Tai, Mohamed Mansour, Parind Shah
  • Patent number: 10598543
    Abstract: A system that performs wall detection, range estimation, corner detection and/or angular estimation. The system may determine an aggregate impulse response (e.g., impulse response of all components in a room) and may perform a deconvolution to remove a system impulse response (e.g., impulse response associated with loudspeaker(s) and microphone(s)). Thus, the system may use a sparse deconvolution algorithm to estimate a room impulse response (e.g., determine acoustic characteristics of the room). The system may detect a peak in the room impulse response and determine a distance and/or direction to an acoustically reflective surface based on the peak.
    Type: Grant
    Filed: December 4, 2017
    Date of Patent: March 24, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Mohamed Mansour, Srivatsan Kandadai, Stefan Vlaski
  • Patent number: 10582299
    Abstract: Techniques for simulating a microphone array and generating synthetic audio data to analyze the microphone array geometry. This reduces the development cost of new microphone arrays by enabling an evaluation of performance metrics (False Rejection Rate (FRR), Word Error Rate (WER), etc.) without building device hardware or collecting data. To generate the synthetic audio data, the system performs acoustic modeling to determine a room impulse response associated with a prototype device (e.g., potential microphone array) in a room. The acoustic modeling is based on two parameters—a device response (information about acoustics and geometry of the prototype device) and a room response (information about acoustics and geometry of the room). The device response can be simulated based on the microphone array geometry, and the room response can be determined using a specialized microphone and a plane wave decomposition algorithm.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: March 3, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Mohamed Mansour, Guangdong Pan
  • Patent number: 10527663
    Abstract: A forward-backward Kalman filter for estimating phase noise present in a received signal. Both the forward and backward Kalman filters use hard-decision measurements of the received symbols. The phase noise estimate from the forward Kalman filter is used as a coarse phase noise estimate for the backward Kalman filter and vice versa. The final phase noise estimate is an optimal combination of the forward phase noise estimate and backward phase noise estimate.
    Type: Grant
    Filed: March 12, 2015
    Date of Patent: January 7, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventor: Mohamed Mansour
  • Patent number: 10187721
    Abstract: A beamformer system that can isolate a desired portion of an audio signal resulting from a microphone array. A fixed beamformer is used to dampen diffuse noise while an adaptive beamformer is used to cancel directional coherent noise. A gain is calculated using a signal quality value such as signal-to-noise ratio, signal-to-null ratio or other value. The adaptive beamformer output is adjusted by the gain prior to combining the fixed beamformer output and the adaptive beamformer output to determine the output audio data.
    Type: Grant
    Filed: June 22, 2017
    Date of Patent: January 22, 2019
    Assignee: Amazon Technologies, Inc.
    Inventor: Mohamed Mansour
  • Patent number: 10147439
    Abstract: A speech-capturing device that can modulate its output audio data volume based on environmental sound conditions at the location of a user speaking to the device. The device detects the sound pressure of a spoken utterance at the device location and determines the distance of the user from the device. The device also detects the sound pressure of noise at the device and uses information about the location of the noise source and user to determine the sound pressure of noise at the location of the talker. The device can then adjust the gain for output audio (such as a spoken response to the utterance) to ensure that the output audio is at a certain desired sound pressure when it reaches the location of the user.
    Type: Grant
    Filed: March 30, 2017
    Date of Patent: December 4, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Trausti Thor Kristjansson, Mohamed Mansour, Amit Singh Chhetri, Ludger Solbach