Patents by Inventor Paul Holmberg

Paul Holmberg has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12374349
    Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.
    Type: Grant
    Filed: December 15, 2022
    Date of Patent: July 29, 2025
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Dong Shi, Kai Li, Hannes Muesch, David Gunawan, Paul Holmberg, Glenn N. Dickins
  • Publication number: 20250201260
    Abstract: Some disclosed methods involve receiving, by a control system configured to implement at least one neural network, input audio data and feature weightings and producing, by the control system and based at least in part on the input audio data and the feature weightings, latent space embeddings. In some examples, the input audio data corresponds to an input mathematical space and the latent space embeddings may correspond with unmasked portions of the input audio data. According to some examples, the latent space embeddings may be mathematical representations of the input audio data indicated by the feature weightings in a latent space that is a different mathematical space from the input mathematical space. In some examples, the feature weightings may be, or may be based on, mask data.
    Type: Application
    Filed: March 28, 2023
    Publication date: June 19, 2025
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Paul Holmberg, Hadis Nosrati, Richard J. Cartwright
  • Publication number: 20250174236
    Abstract: Some disclosed methods involve: receiving multi-channel audio data including unlabeled multi-channel audio data; extracting audio feature data from the unlabeled multi-channel audio data; applying a spatial masking process to a portion of the audio feature data; applying a contextual encoding process to the masked audio feature data, to produce predicted spatial embeddings in a latent space; obtaining reference spatial embeddings in the latent space; determining a loss function gradient based, at least in part, on a variance between the predicted spatial embeddings and the reference spatial embeddings; and updating the contextual encoding process according to the loss function gradient until one or more convergence metrics are attained.
    Type: Application
    Filed: February 28, 2023
    Publication date: May 29, 2025
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Paul HOLMBERG, Hadis NOSRATI, Richard J. CARTWRIGHT
  • Patent number: 12302073
    Abstract: Embodiments are disclosed for non-intrusive transducer health detection in an audio system. In an embodiment, a method performed by the audio system comprises outputting one or more encoded inaudible acoustic signals into an acoustic transmission medium using a first transducer. The one or more encoded inaudible acoustic signals are received from the acoustic transmission medium using a second transducer of the audio system. The received one or more encoded inaudible acoustic signals are used to identify failure or degradation of the first or second transducer.
    Type: Grant
    Filed: June 21, 2021
    Date of Patent: May 13, 2025
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Joseph McKee, Timothy Alan Port, Paul Holmberg
  • Publication number: 20250111470
    Abstract: A communication client device operated by a first user in a communication session receives a viewing direction tracking data portion indicating a view direction of a second user in the communication session. It is determined that the view direction of the second user is towards a third user at a first time point in the communication session. The view direction of the second user is used to modify a pre-adapted visual depiction of the second user into an adapted visual depiction of the second user. The adapted visual depiction of the second user is rendered, to the first user, on an image display operating with the communication client device.
    Type: Application
    Filed: January 30, 2023
    Publication date: April 3, 2025
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Ajit Ninan, Paul Holmberg
  • Publication number: 20230368807
    Abstract: A system for suppressing noise and enhancing speech and a related method are disclosed. The system trains a neural network model that takes banded energies corresponding to an original noisy waveform and produces a speech value indicating the amount of speech present in each band at each frame. The neural model comprises a feature extraction block that implements some lookahead. The feature extraction block is followed by an encoder with steady down-sampling along the frequency domain forming a contracting path. The encoder is followed by a corresponding decoder with steady up-sampling along the frequency domain forming an expanding path. The decoder receives scaled output feature maps from the encoder at a corresponding level. The decoder is followed by a classification block that generates a speech value indicating an amount of speech present for each frequency band of the plurality of frequency bands at each frame of the plurality of frames.
    Type: Application
    Filed: October 29, 2021
    Publication date: November 16, 2023
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Xiaoyu LIU, Michael Getty HORGAN, Roy M. FEJGIN, Paul HOLMBERG
  • Patent number: 11803351
    Abstract: A communication system, method, and computer-readable medium therefor comprise a media server configured to receive a plurality of audio streams from a corresponding plurality of client devices, the media server including circuitry configured to rank the plurality of audio streams based on a predetermined metric, group a first portion of the plurality of audio streams into a first set, the first portion of the plurality of audio streams being the N highest-ranked audio streams, group a second portion of the plurality of audio streams into a second set, the second portion of the plurality of audio streams being the M lowest-ranked audio streams, forward respective audio streams of the first set to a receiver device, and discard respective audio streams of the second set, wherein N and M are independent integers.
    Type: Grant
    Filed: April 3, 2020
    Date of Patent: October 31, 2023
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Glenn N. Dickins, Feng Deng, Michael Eckert, Craig Johnston, Paul Holmberg
  • Publication number: 20230232174
    Abstract: Embodiments are disclosed for non-intrusive transducer health detection in an audio system. In an embodiment, a method performed by the audio system comprises outputting one or more encoded inaudible acoustic signals into an acoustic transmission medium using a first transducer. The one or more encoded inaudible acoustic signals are received from the acoustic transmission medium using a second transducer of the audio system. The received one or more encoded inaudible acoustic signals are used to identify failure or degradation of the first or second transducer.
    Type: Application
    Filed: June 21, 2021
    Publication date: July 20, 2023
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Joseph McKee, Timothy Alan Port, Paul Holmberg
  • Publication number: 20230121651
    Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.
    Type: Application
    Filed: December 15, 2022
    Publication date: April 20, 2023
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Dong SHI, Kai LI, Hannes MUESCH, David GUNAWAN, Paul HOLMBERG, Glenn N. DICKINS
  • Patent number: 11538486
    Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: December 27, 2022
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Dong Shi, Kai Li, Hannes Muesch, David Gunawan, Paul Holmberg, Glenn N. Dickins
  • Publication number: 20220197592
    Abstract: A communication system, method, and computer-readable medium therefor comprise a media server configured to receive a plurality of audio streams from a corresponding plurality of client devices, the media server including circuitry configured to rank the plurality of audio streams based on a predetermined metric, group a first portion of the plurality of audio streams into a first set, the first portion of the plurality of audio streams being the N highest-ranked audio streams, group a second portion of the plurality of audio streams into a second set, the second portion of the plurality of audio streams being the M lowest-ranked audio streams, forward respective audio streams of the first set to a receiver device, and discard respective audio streams of the second set, wherein N and M are independent integers.
    Type: Application
    Filed: April 3, 2020
    Publication date: June 23, 2022
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Glenn N. DICKINS, Feng DENG, Michael ECKERT, Craig JOHNSTON, Paul HOLMBERG
  • Patent number: 11100942
    Abstract: Systems and methods are described for compensating for inaccurate echo prediction in audio systems. A signal may be received at a microphone of an audio system, the signal including audio rendered using a spatial audio renderer across a multi-channel audio output. A signal may be received from the spatial audio renderer that indicates a change in rendering of audio. The audio system may then determine if there is echo power within the received signal greater than an expected echo power. After the signal from the spatial audio renderer has been received, the echo suppression applied to the received signal may be modified in response to a determination that the echo power is greater than the expected echo power, the echo suppression attenuating pre-selected frequency bands of the received signal.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: August 24, 2021
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Glenn N. Dickins, Tet Fei Yap, Guodong Li, Paul Holmberg
  • Publication number: 20210104254
    Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.
    Type: Application
    Filed: October 20, 2020
    Publication date: April 8, 2021
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Dong SHI, Kai LI, Hannes MUESCH, David GUNAWAN, Paul HOLMBERG, Glenn N. DICKINS
  • Patent number: 10811027
    Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.
    Type: Grant
    Filed: June 7, 2017
    Date of Patent: October 20, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Dong Shi, Kai Li, Hannes Muesch, David Gunawan, Paul Holmberg, Glenn N. Dickins
  • Publication number: 20200227063
    Abstract: Systems and methods are described for compensating for inaccurate echo prediction in audio systems. A signal may be received at a microphone of an audio system, the signal including audio rendered using a spatial audio renderer across a multi-channel audio output. A signal may be received from the spatial audio renderer that indicates a change in rendering of audio. The audio system may then determine if there is echo power within the received signal greater than an expected echo power. After the signal from the spatial audio renderer has been received, the echo suppression applied to the received signal may be modified in response to a determination that the echo power is greater than the expected echo power, the echo suppression attenuating pre-selected frequency bands of the received signal.
    Type: Application
    Filed: July 13, 2018
    Publication date: July 16, 2020
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Glenn N. Dickins, Tet Fei Yap, Guodong Li, Paul Holmberg
  • Patent number: 10601689
    Abstract: In a packet switched voice delivery application which utilizes a jitter buffer for the delivery of sequential packet data, a method of determining a measure of the output jitter of taking packets out of the buffer, the method including the step of: (a) forming a pull jitter measure comprising the differential fetch times between sequential pull packets dived by an expected time interval between packets.
    Type: Grant
    Filed: September 27, 2016
    Date of Patent: March 24, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Xuejing Sun, JiaQuan Huo, Paul Holmberg
  • Patent number: 10446166
    Abstract: Example embodiments disclosed herein relate to assessment and adjustment for an audio environment. A computer-implemented method is provided. The method includes obtaining a first audio signal captured by a device located in an environment. The method also includes analyzing a characteristic of the first audio signal to determine an acoustic performance metric for the environment. The method further includes, in response to the acoustic performance metric being below a threshold, providing a first task for a user to perform based on the characteristic of the first audio signal. The first task is related to an adjustment to a setting of the environment. Embodiments in this regard further provide a corresponding computer program product. Corresponding system and computer program product are also disclosed.
    Type: Grant
    Filed: July 12, 2017
    Date of Patent: October 15, 2019
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Glenn N. Dickins, Paul Holmberg, Dong Shi
  • Publication number: 20190156852
    Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.
    Type: Application
    Filed: June 7, 2017
    Publication date: May 23, 2019
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Dong SHI, Kai LI, Hannes MUESCH, David GUNAWAN, Paul HOLMBERG, Glenn N. DICKINS
  • Publication number: 20180287910
    Abstract: In a packet switched voice delivery application which utilizes a jitter buffer for the delivery of sequential packet data, a method of determining a measure of the output jitter of taking packets out of the buffer, the method including the step of: (a) forming a pull jitter measure comprising the differential fetch times between sequential pull packets dived by an expected time interval between packets.
    Type: Application
    Filed: September 27, 2016
    Publication date: October 4, 2018
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Xuejing Sun, JiaQuan Huo, Paul Holmberg
  • Patent number: 10051400
    Abstract: A method of outputting audio in a teleconferencing environment includes receiving audio streams, processing the audio streams according to information regarding effective spatial positions, and outputting, by at least three speakers arranged in more than one dimension, the audio streams having been processed. The information regarding the plurality of effective spatial positions corresponds to a perceived spatial scene that extends beyond the speakers in at least two dimensions. In this manner, participants in the teleconference perceive the audio from the remote participants as originating at different positions in the teleconference room.
    Type: Grant
    Filed: March 21, 2013
    Date of Patent: August 14, 2018
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: David S. McGrath, Glenn N. Dickins, Paul Holmberg, Gary Spittle, Michael Eckert