Patents by Inventor Paul Holmberg
Paul Holmberg has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12374349Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.Type: GrantFiled: December 15, 2022Date of Patent: July 29, 2025Assignee: Dolby Laboratories Licensing CorporationInventors: Dong Shi, Kai Li, Hannes Muesch, David Gunawan, Paul Holmberg, Glenn N. Dickins
-
Publication number: 20250201260Abstract: Some disclosed methods involve receiving, by a control system configured to implement at least one neural network, input audio data and feature weightings and producing, by the control system and based at least in part on the input audio data and the feature weightings, latent space embeddings. In some examples, the input audio data corresponds to an input mathematical space and the latent space embeddings may correspond with unmasked portions of the input audio data. According to some examples, the latent space embeddings may be mathematical representations of the input audio data indicated by the feature weightings in a latent space that is a different mathematical space from the input mathematical space. In some examples, the feature weightings may be, or may be based on, mask data.Type: ApplicationFiled: March 28, 2023Publication date: June 19, 2025Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Paul Holmberg, Hadis Nosrati, Richard J. Cartwright
-
Publication number: 20250174236Abstract: Some disclosed methods involve: receiving multi-channel audio data including unlabeled multi-channel audio data; extracting audio feature data from the unlabeled multi-channel audio data; applying a spatial masking process to a portion of the audio feature data; applying a contextual encoding process to the masked audio feature data, to produce predicted spatial embeddings in a latent space; obtaining reference spatial embeddings in the latent space; determining a loss function gradient based, at least in part, on a variance between the predicted spatial embeddings and the reference spatial embeddings; and updating the contextual encoding process according to the loss function gradient until one or more convergence metrics are attained.Type: ApplicationFiled: February 28, 2023Publication date: May 29, 2025Applicant: Dolby Laboratories Licensing CorporationInventors: Paul HOLMBERG, Hadis NOSRATI, Richard J. CARTWRIGHT
-
Patent number: 12302073Abstract: Embodiments are disclosed for non-intrusive transducer health detection in an audio system. In an embodiment, a method performed by the audio system comprises outputting one or more encoded inaudible acoustic signals into an acoustic transmission medium using a first transducer. The one or more encoded inaudible acoustic signals are received from the acoustic transmission medium using a second transducer of the audio system. The received one or more encoded inaudible acoustic signals are used to identify failure or degradation of the first or second transducer.Type: GrantFiled: June 21, 2021Date of Patent: May 13, 2025Assignee: Dolby Laboratories Licensing CorporationInventors: Joseph McKee, Timothy Alan Port, Paul Holmberg
-
Publication number: 20250111470Abstract: A communication client device operated by a first user in a communication session receives a viewing direction tracking data portion indicating a view direction of a second user in the communication session. It is determined that the view direction of the second user is towards a third user at a first time point in the communication session. The view direction of the second user is used to modify a pre-adapted visual depiction of the second user into an adapted visual depiction of the second user. The adapted visual depiction of the second user is rendered, to the first user, on an image display operating with the communication client device.Type: ApplicationFiled: January 30, 2023Publication date: April 3, 2025Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Ajit Ninan, Paul Holmberg
-
Publication number: 20230368807Abstract: A system for suppressing noise and enhancing speech and a related method are disclosed. The system trains a neural network model that takes banded energies corresponding to an original noisy waveform and produces a speech value indicating the amount of speech present in each band at each frame. The neural model comprises a feature extraction block that implements some lookahead. The feature extraction block is followed by an encoder with steady down-sampling along the frequency domain forming a contracting path. The encoder is followed by a corresponding decoder with steady up-sampling along the frequency domain forming an expanding path. The decoder receives scaled output feature maps from the encoder at a corresponding level. The decoder is followed by a classification block that generates a speech value indicating an amount of speech present for each frequency band of the plurality of frequency bands at each frame of the plurality of frames.Type: ApplicationFiled: October 29, 2021Publication date: November 16, 2023Applicant: Dolby Laboratories Licensing CorporationInventors: Xiaoyu LIU, Michael Getty HORGAN, Roy M. FEJGIN, Paul HOLMBERG
-
Patent number: 11803351Abstract: A communication system, method, and computer-readable medium therefor comprise a media server configured to receive a plurality of audio streams from a corresponding plurality of client devices, the media server including circuitry configured to rank the plurality of audio streams based on a predetermined metric, group a first portion of the plurality of audio streams into a first set, the first portion of the plurality of audio streams being the N highest-ranked audio streams, group a second portion of the plurality of audio streams into a second set, the second portion of the plurality of audio streams being the M lowest-ranked audio streams, forward respective audio streams of the first set to a receiver device, and discard respective audio streams of the second set, wherein N and M are independent integers.Type: GrantFiled: April 3, 2020Date of Patent: October 31, 2023Assignee: Dolby Laboratories Licensing CorporationInventors: Glenn N. Dickins, Feng Deng, Michael Eckert, Craig Johnston, Paul Holmberg
-
Publication number: 20230232174Abstract: Embodiments are disclosed for non-intrusive transducer health detection in an audio system. In an embodiment, a method performed by the audio system comprises outputting one or more encoded inaudible acoustic signals into an acoustic transmission medium using a first transducer. The one or more encoded inaudible acoustic signals are received from the acoustic transmission medium using a second transducer of the audio system. The received one or more encoded inaudible acoustic signals are used to identify failure or degradation of the first or second transducer.Type: ApplicationFiled: June 21, 2021Publication date: July 20, 2023Applicant: Dolby Laboratories Licensing CorporationInventors: Joseph McKee, Timothy Alan Port, Paul Holmberg
-
Publication number: 20230121651Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.Type: ApplicationFiled: December 15, 2022Publication date: April 20, 2023Applicant: Dolby Laboratories Licensing CorporationInventors: Dong SHI, Kai LI, Hannes MUESCH, David GUNAWAN, Paul HOLMBERG, Glenn N. DICKINS
-
Patent number: 11538486Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.Type: GrantFiled: October 20, 2020Date of Patent: December 27, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Dong Shi, Kai Li, Hannes Muesch, David Gunawan, Paul Holmberg, Glenn N. Dickins
-
Publication number: 20220197592Abstract: A communication system, method, and computer-readable medium therefor comprise a media server configured to receive a plurality of audio streams from a corresponding plurality of client devices, the media server including circuitry configured to rank the plurality of audio streams based on a predetermined metric, group a first portion of the plurality of audio streams into a first set, the first portion of the plurality of audio streams being the N highest-ranked audio streams, group a second portion of the plurality of audio streams into a second set, the second portion of the plurality of audio streams being the M lowest-ranked audio streams, forward respective audio streams of the first set to a receiver device, and discard respective audio streams of the second set, wherein N and M are independent integers.Type: ApplicationFiled: April 3, 2020Publication date: June 23, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Glenn N. DICKINS, Feng DENG, Michael ECKERT, Craig JOHNSTON, Paul HOLMBERG
-
Patent number: 11100942Abstract: Systems and methods are described for compensating for inaccurate echo prediction in audio systems. A signal may be received at a microphone of an audio system, the signal including audio rendered using a spatial audio renderer across a multi-channel audio output. A signal may be received from the spatial audio renderer that indicates a change in rendering of audio. The audio system may then determine if there is echo power within the received signal greater than an expected echo power. After the signal from the spatial audio renderer has been received, the echo suppression applied to the received signal may be modified in response to a determination that the echo power is greater than the expected echo power, the echo suppression attenuating pre-selected frequency bands of the received signal.Type: GrantFiled: July 13, 2018Date of Patent: August 24, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Glenn N. Dickins, Tet Fei Yap, Guodong Li, Paul Holmberg
-
Publication number: 20210104254Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.Type: ApplicationFiled: October 20, 2020Publication date: April 8, 2021Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Dong SHI, Kai LI, Hannes MUESCH, David GUNAWAN, Paul HOLMBERG, Glenn N. DICKINS
-
Patent number: 10811027Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.Type: GrantFiled: June 7, 2017Date of Patent: October 20, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Dong Shi, Kai Li, Hannes Muesch, David Gunawan, Paul Holmberg, Glenn N. Dickins
-
Publication number: 20200227063Abstract: Systems and methods are described for compensating for inaccurate echo prediction in audio systems. A signal may be received at a microphone of an audio system, the signal including audio rendered using a spatial audio renderer across a multi-channel audio output. A signal may be received from the spatial audio renderer that indicates a change in rendering of audio. The audio system may then determine if there is echo power within the received signal greater than an expected echo power. After the signal from the spatial audio renderer has been received, the echo suppression applied to the received signal may be modified in response to a determination that the echo power is greater than the expected echo power, the echo suppression attenuating pre-selected frequency bands of the received signal.Type: ApplicationFiled: July 13, 2018Publication date: July 16, 2020Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Glenn N. Dickins, Tet Fei Yap, Guodong Li, Paul Holmberg
-
Patent number: 10601689Abstract: In a packet switched voice delivery application which utilizes a jitter buffer for the delivery of sequential packet data, a method of determining a measure of the output jitter of taking packets out of the buffer, the method including the step of: (a) forming a pull jitter measure comprising the differential fetch times between sequential pull packets dived by an expected time interval between packets.Type: GrantFiled: September 27, 2016Date of Patent: March 24, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Xuejing Sun, JiaQuan Huo, Paul Holmberg
-
Patent number: 10446166Abstract: Example embodiments disclosed herein relate to assessment and adjustment for an audio environment. A computer-implemented method is provided. The method includes obtaining a first audio signal captured by a device located in an environment. The method also includes analyzing a characteristic of the first audio signal to determine an acoustic performance metric for the environment. The method further includes, in response to the acoustic performance metric being below a threshold, providing a first task for a user to perform based on the characteristic of the first audio signal. The first task is related to an adjustment to a setting of the environment. Embodiments in this regard further provide a corresponding computer program product. Corresponding system and computer program product are also disclosed.Type: GrantFiled: July 12, 2017Date of Patent: October 15, 2019Assignee: Dolby Laboratories Licensing CorporationInventors: Glenn N. Dickins, Paul Holmberg, Dong Shi
-
Publication number: 20190156852Abstract: Methods for echo estimation or echo management (echo suppression or cancellation) on an input audio signal, with at least one of adaptation of a sparse prediction filter set, modification (for example, truncation) of adapted prediction filter impulse responses, generation of a composite impulse response from adapted prediction filter impulse responses, or use of echo estimation and/or echo management resources in a manner determined at least in part by classification of the input audio signal as being (or not being) echo free. Other aspects are systems configured to perform any embodiment of any of the methods.Type: ApplicationFiled: June 7, 2017Publication date: May 23, 2019Applicant: Dolby Laboratories Licensing CorporationInventors: Dong SHI, Kai LI, Hannes MUESCH, David GUNAWAN, Paul HOLMBERG, Glenn N. DICKINS
-
Publication number: 20180287910Abstract: In a packet switched voice delivery application which utilizes a jitter buffer for the delivery of sequential packet data, a method of determining a measure of the output jitter of taking packets out of the buffer, the method including the step of: (a) forming a pull jitter measure comprising the differential fetch times between sequential pull packets dived by an expected time interval between packets.Type: ApplicationFiled: September 27, 2016Publication date: October 4, 2018Applicant: Dolby Laboratories Licensing CorporationInventors: Xuejing Sun, JiaQuan Huo, Paul Holmberg
-
Patent number: 10051400Abstract: A method of outputting audio in a teleconferencing environment includes receiving audio streams, processing the audio streams according to information regarding effective spatial positions, and outputting, by at least three speakers arranged in more than one dimension, the audio streams having been processed. The information regarding the plurality of effective spatial positions corresponds to a perceived spatial scene that extends beyond the speakers in at least two dimensions. In this manner, participants in the teleconference perceive the audio from the remote participants as originating at different positions in the teleconference room.Type: GrantFiled: March 21, 2013Date of Patent: August 14, 2018Assignee: Dolby Laboratories Licensing CorporationInventors: David S. McGrath, Glenn N. Dickins, Paul Holmberg, Gary Spittle, Michael Eckert