Patents by Inventor Erik Visser

Erik Visser has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • In-vehicle communication signal processing
    Patent number: 10002601
    Abstract: A system includes a feedback filter configured to receive an audio signal from a microphone and to process the audio signal based on a feedback path between a loudspeaker and the microphone. The system also includes an adaptive filter coupled to the feedback filter. The system further includes a signal combiner coupled to the microphone and to the adaptive filter.
    Type: Grant
    Filed: July 21, 2016
    Date of Patent: June 19, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Asif Mohammad, Sreekanth Narayanaswamy, Wade Heimbigner, Erik Visser
  • Enhanced conversational communications in shared acoustic space
    Patent number: 9947334
    Abstract: A multichannel acoustic system (MAS) comprises an arrangement of microphones and loudspeakers and a multichannel acoustic processor (MAP) to together enhance conversational speech between two or more persons in a shared acoustic space such as an automobile. The enhancements are achieved by receiving sound signals substantially originating from relatively near sound sources; filtering the sound signals to cancel at least one echo signal detected for at least one microphone from among the plurality of microphones; filtering the sound signals received by the plurality of microphones to cancel at least one feedback signal detected for at least one microphone from among the plurality of microphones; and reproducing the filtered sound signals for each microphone from among the plurality of microphones on a subset of loudspeakers corresponding that are relatively far from the source microphone.
    Type: Grant
    Filed: July 24, 2015
    Date of Patent: April 17, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Samir Kumar Gupta, Asif Iqbal Mohammad, Erik Visser, Lae-Hoon Kim, Shaun William Van Dyken
  • Multi-channel echo cancellation and noise suppression
    Patent number: 9936290
    Abstract: A method for multi-channel echo cancellation and noise suppression is described. One of multiple echo estimates is selected for non-linear echo cancellation. Echo notch masking is performed on a noise-suppressed signal based on an echo direction of arrival (DOA) to produce an echo-suppressed signal. Non-linear echo cancellation is performed on the echo-suppressed signal based, at least in part, on the selected echo estimate.
    Type: Grant
    Filed: January 15, 2014
    Date of Patent: April 3, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Asif Iqbal Mohammad, Lae-Hoon Kim, Ian Ernan Liu, Erik Visser
  • Methods and systems for inserting virtual sounds into an environment
    Patent number: 9906885
    Abstract: A method for outputting virtual sound includes detecting an audio signal in an environment at one or more microphones. The method also includes determining, at a processor, a location of a sound source of the audio signal and estimating one or more acoustical characteristics of the environment based on the audio signal. The method further includes inserting a virtual sound into the environment based on the one or more acoustical characteristics. The virtual sound has one or more audio properties of a sound generated from the location of the sound source.
    Type: Grant
    Filed: August 16, 2016
    Date of Patent: February 27, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Erik Visser, Lae-Hoon Kim, Raghuveer Peri
  • FAR-FIELD AUDIO PROCESSING
    Publication number: 20180033428
    Abstract: An apparatus includes multiple microphones to generate audio signals based on sound of a far-field acoustic environment. The apparatus also includes a signal processing system to process the audio signals to generate at least one processed audio signal. The signal processing system is configured to update one or more processing parameters while operating in a first operational mode and is configured to use a static version of the one or more processing parameters while operating in the second operational mode. The apparatus further includes a keyword detection system to perform keyword detection based on the at least one processed audio signal to determine whether the sound includes an utterance corresponding to a keyword and, based on a result of the keyword detection, to send a control signal to the signal processing system to change an operational mode of the signal processing system.
    Type: Application
    Filed: December 21, 2016
    Publication date: February 1, 2018
    Inventors: Lae-Hoon Kim, Erik Visser, Asif Mohammad, Ian Ernan Liu, Ye Jiang
  • Audio processing for an acoustical environment
    Patent number: 9881619
    Abstract: An apparatus for detecting a sound in an acoustical environment includes a microphone array configured to detect an audio signal in the acoustical environment. The apparatus also includes a processor configured to determine an angular location of a sound source of the audio signal. The angular location is relative to the microphone array. The processor is also configured to determine at least one reverberation characteristic of the audio signal. The processor is further configured to determine a distance, relative to the microphone array, of the sound source along an axis associated with the angular location based on the at least one reverberation characteristic.
    Type: Grant
    Filed: March 25, 2016
    Date of Patent: January 30, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Erik Visser, Wenliang Lu, Lae-Hoon Kim, Yinyi Guo, Shuhua Zhang
  • VIRTUAL, AUGMENTED, AND MIXED REALITY
    Publication number: 20180020312
    Abstract: A method for outputting virtual sound includes detecting an audio signal in an environment at one or more microphones. The method also includes determining, at a processor, a location of a sound source of the audio signal and estimating one or more acoustical characteristics of the environment based on the audio signal. The method further includes inserting a virtual sound into the environment based on the one or more acoustical characteristics. The virtual sound has one or more audio properties of a sound generated from the location of the sound source.
    Type: Application
    Filed: August 16, 2016
    Publication date: January 18, 2018
    Inventors: Erik Visser, Lae-Hoon Kim, Raghuveer Peri
  • Liveness determination based on sensor signals
    Patent number: 9858403
    Abstract: A device includes a memory and a processor. The memory is configured to store a threshold. The processor is configured to authenticate a user based on authentication data. The processor is also configured to, in response to determining that the user is authenticated, generate a correlation score indicating a correlation between a first signal received from a first sensor and a second signal received from a second sensor. The processor is also configured to determine liveness of the user based on a comparison of the correlation score and the threshold.
    Type: Grant
    Filed: February 2, 2016
    Date of Patent: January 2, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Yinyi Guo, Minho Jin, JunCheol Cho, Yongwoo Cho, Lae-Hoon Kim, Erik Visser, Shuhua Zhang
  • Systems and methods for mapping a source location
    Patent number: 9857451
    Abstract: A method for mapping a source location by an electronic device is described. The method includes obtaining sensor data. The method also includes mapping a source location to electronic device coordinates based on the sensor data. The method further includes mapping the source location from electronic device coordinates to physical coordinates. The method additionally includes performing an operation based on a mapping.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: January 2, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Lae-Hoon Kim, Erik Visser, Phuong Lam Ton, Jeremy Patrick Toman, Jeffrey Clinton Shaw
  • SUPPRESSING OR REDUCING EFFECTS OF WIND TURBULENCE
    Publication number: 20170353809
    Abstract: A method of operation of a device includes receiving an input signal at the device. The input signal is generated using at least one microphone. The input signal includes a first signal component having a first amount of wind turbulence noise and a second signal component having a second amount of wind turbulence noise that is greater than the first amount of wind turbulence noise. The method further includes generating, based on the input signal, an output signal at the device. The output signal includes the first signal component and a third signal component that replaces the second signal component. A first frequency response of the input signal corresponds to a second frequency response of the output signal.
    Type: Application
    Filed: June 1, 2016
    Publication date: December 7, 2017
    Inventors: Shuhua Zhang, Erik Visser, Lae-Hoon Kim, Raghuveer Peri, Yinyi Guo
  • Suppressing or reducing effects of wind turbulence
    Patent number: 9838815
    Abstract: A method of operation of a device includes receiving an input signal at the device. The input signal is generated using at least one microphone. The input signal includes a first signal component having a first amount of wind turbulence noise and a second signal component having a second amount of wind turbulence noise that is greater than the first amount of wind turbulence noise. The method further includes generating, based on the input signal, an output signal at the device. The output signal includes the first signal component and a third signal component that replaces the second signal component. A first frequency response of the input signal corresponds to a second frequency response of the output signal.
    Type: Grant
    Filed: June 1, 2016
    Date of Patent: December 5, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Shuhua Zhang, Erik Visser, Lae-Hoon Kim, Raghuveer Peri, Yinyi Guo
  • DEVICE FOR GENERATING AUDIO OUTPUT
    Publication number: 20170339491
    Abstract: A headset device includes a first earpiece configured to receive a reference sound and to generate a first reference audio signal based on the reference sound. The headset device further includes a second earpiece configured to receive the reference sound and to generate a second reference audio signal based on the reference sound. The headset device further includes a controller coupled to the first earpiece and to the second earpiece. The controller is configured to generate a first signal and a second signal based on a phase relationship between the first reference audio signal and the second reference audio signal. The controller is further configured to output the first signal to the first earpiece and output the second signal to the second earpiece.
    Type: Application
    Filed: May 18, 2016
    Publication date: November 23, 2017
    Inventors: Lae-Hoon Kim, Hyun Jin Park, Erik Visser, Raghuveer Peri
  • AUDIO USER INTERACTION RECOGNITION AND APPLICATION INTERFACE
    Publication number: 20170308164
    Abstract: Disclosed is an application interface that takes into account the user's gaze direction relative to who is speaking in an interactive multi-participant environment where audio-based contextual information and/or visual-based semantic information is being presented. Among these various implementations, two different types of microphone array devices (MADs) may be used. The first type of MAD is a steerable microphone array (a.k.a. a steerable array) which is worn by a user in a known orientation with regard to the user's eyes, and wherein multiple users may each wear a steerable array. The second type of MAD is a fixed-location microphone array (a.k.a. a fixed array) which is placed in the same acoustic space as the users (one or more of which are using steerable arrays).
    Type: Application
    Filed: July 10, 2017
    Publication date: October 26, 2017
    Inventors: Lae-Hoon KIM, Jongwon Shin, Erik Visser
  • AUDIO PROCESSING FOR AN ACOUSTICAL ENVIRONMENT
    Publication number: 20170278519
    Abstract: An apparatus for detecting a sound in an acoustical environment includes a microphone array configured to detect an audio signal in the acoustical environment. The apparatus also includes a processor configured to determine an angular location of a sound source of the audio signal. The angular location is relative to the microphone array. The processor is also configured to determine at least one reverberation characteristic of the audio signal. The processor is further configured to determine a distance, relative to the microphone array, of the sound source along an axis associated with the angular location based on the at least one reverberation characteristic.
    Type: Application
    Filed: March 25, 2016
    Publication date: September 28, 2017
    Inventors: Erik Visser, Wenliang Lu, Lae-Hoon Kim, Yinyi Guo, Shuhua Zhang
  • CLOUD-BASED PROCESSING USING LOCAL DEVICE PROVIDED SENSOR DATA AND LABELS
    Publication number: 20170270406
    Abstract: A method of training a device specific cloud-based audio processor includes receiving sensor data captured from multiple sensors at a local device. The method also includes receiving spatial information labels computed on the local device using local configuration information. The spatial information labels are associated with the captured sensor data. Lower layers of a first neural network are trained based on the spatial information labels and sensor data. The trained lower layers are incorporated into a second, larger neural network for audio classification. The second, larger neural network may be retrained using the trained lower layers of the first neural network.
    Type: Application
    Filed: September 22, 2016
    Publication date: September 21, 2017
    Inventors: Erik VISSER, Minho JIN, Lae-Hoon KIM, Raghuveer PERI, Shuhua ZHANG
  • Audio user interaction recognition and application interface
    Patent number: 9746916
    Abstract: Disclosed is an application interface that takes into account the user's gaze direction relative to who is speaking in an interactive multi-participant environment where audio-based contextual information and/or visual-based semantic information is being presented. Among these various implementations, two different types of microphone array devices (MADs) may be used. The first type of MAD is a steerable microphone array (a.k.a. a steerable array) which is worn by a user in a known orientation with regard to the user's eyes, and wherein multiple users may each wear a steerable array. The second type of MAD is a fixed-location microphone array (a.k.a. a fixed array) which is placed in the same acoustic space as the users (one or more of which are using steerable arrays).
    Type: Grant
    Filed: November 12, 2012
    Date of Patent: August 29, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Lae-Hoon Kim, Jongwon Shin, Erik Visser
  • Enhanced auditory experience in shared acoustic space
    Patent number: 9743213
    Abstract: A multichannel acoustic system (MAS) comprises an arrangement of microphones, loudspeakers, and filters along with a multichannel acoustic processor (MAP) and other components to together provide and enhance the auditory experience of persons in a shared acoustic space such as, for example, the driver and other passengers in an automobile. Driver-specific features such as navigation and auditory feedback cues are described, as individual auditory customizations and collective communications both within the shared acoustic space as well as with other individuals not located in the space via enhanced conference call facilities.
    Type: Grant
    Filed: July 24, 2015
    Date of Patent: August 22, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Asif Iqbal Mohammad, Erik Visser, Lae-Hoon Kim, Shaun William Van Dyken, Troy Schultz, Samir Kumar Gupta
  • Audio user interaction recognition and context refinement
    Patent number: 9736604
    Abstract: A system which tracks a social interaction between a plurality of participants, includes a fixed beamformer that is adapted to output a first spatially filtered output and configured to receive a plurality of second spatially filtered outputs from a plurality of steerable beamformers. Each steerable beamformer outputs a respective one of the second spatially filtered outputs associated with a different one of the participants. The system also includes a processor capable of determining a similarity between the first spatially filtered output and each of the second spatially filtered outputs. The processor determines the social interaction between the participants based on the similarity between the first spatially filtered output and each of the second spatially filtered outputs.
    Type: Grant
    Filed: November 12, 2012
    Date of Patent: August 15, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Lae-Hoon Kim, Jongwon Shin, Erik Visser
  • DRONE FLIGHT CONTROL
    Publication number: 20170220036
    Abstract: A drone system and method. Audio signals are received via one or more microphones positioned relative to a location on a drone and one or more of the audio signals are identified as of interest. Flight characteristics of the drone are then controlled based on the audio signals that are of interest.
    Type: Application
    Filed: June 17, 2016
    Publication date: August 3, 2017
    Inventors: Erik Visser, Lae-Hoon Kim, Ricardo De Jesus Bernal Castillo, Shuhua Zhang, Raghuveer Peri
  • LIVENESS DETERMINATION BASED ON SENSOR SIGNALS
    Publication number: 20170220786
    Abstract: A device includes a memory and a processor. The memory is configured to store a threshold. The processor is configured to authenticate a user based on authentication data. The processor is also configured to, in response to determining that the user is authenticated, generate a correlation score indicating a correlation between a first signal received from a first sensor and a second signal received from a second sensor. The processor is also configured to determine liveness of the user based on a comparison of the correlation score and the threshold.
    Type: Application
    Filed: February 2, 2016
    Publication date: August 3, 2017
    Inventors: Yinyi Guo, Minho Jin, JunCheol Cho, Yongwoo Cho, Lae-Hoon Kim, Erik Visser, Shuhua Zhang