Patents by Inventor Frank M. Baumgarte

Frank M. Baumgarte has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11315579
    Abstract: A system for encoding and applying Dynamic Range Control/Compression (DRC) gain values to a piece of sound program content is described. In particular, a set of DRC gain values representing a DRC gain curve for the piece of content may be divided into frames corresponding to frames of the piece of content. A set of fields may be included with an audio signal representing the piece of content. The additional fields may represent the DRC gain values using linear or spline interpolation. The additional fields may include 1) an initial gain value for each DRC frame, 2) a set of slope values at particular points in the DRC curve, 3) a set of time delta values for each consecutive pair of slope values, and/or 4) one or more gain delta values representing changes of DRC gain values in the DRC gain curve between points of the slope values.
    Type: Grant
    Filed: August 21, 2019
    Date of Patent: April 26, 2022
    Assignee: APPLE INC.
    Inventor: Frank M. Baumgarte
  • Patent number: 10992276
    Abstract: An audio encoding device and an audio decoding device are described herein. The audio encoding device may examine a set of audio channels/channel groups representing a piece of sound program content and produce a set of ducking values to associate with one of the channels/channel groups. During playback of the piece of sound program content, the ducking values may be applied to all other channels/channel groups. Application of these ducking values may cause (1) the reduction in dynamic range of ducked channels/channel groups and/or (2) movement of channels/channel groups in the sound field. This ducking may improve intelligibility of audio in the non-ducked channel/channel group. For instance, a narration channel/channel group may be more clearly heard by listeners through the use of selective ducking of other channels/channel groups during playback.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: April 27, 2021
    Assignee: APPLE INC.
    Inventors: Tomlinson M. Holman, Frank M. Baumgarte, Eric A. Allamanche
  • Publication number: 20190378524
    Abstract: A system for encoding and applying Dynamic Range Control/Compression (DRC) gain values to a piece of sound program content is described. In particular, a set of DRC gain values representing a DRC gain curve for the piece of content may be divided into frames corresponding to frames of the piece of content. A set of fields may be included with an audio signal representing the piece of content. The additional fields may represent the DRC gain values using linear or spline interpolation. The additional fields may include 1) an initial gain value for each DRC frame, 2) a set of slope values at particular points in the DRC curve, 3) a set of time delta values for each consecutive pair of slope values, and/or 4) one or more gain delta values representing changes of DRC gain values in the DRC gain curve between points of the slope values.
    Type: Application
    Filed: August 21, 2019
    Publication date: December 12, 2019
    Inventor: Frank M. Baumgarte
  • Patent number: 10453463
    Abstract: A system for encoding and applying Dynamic Range Control/Compression (DRC) gain values to a piece of sound program content is described. In particular, a set of DRC gain values representing a DRC gain curve for the piece of content may be divided into frames corresponding to frames of the piece of content. A set of fields may be included with an audio signal representing the piece of content. The additional fields may represent the DRC gain values using linear or spline interpolation. The additional fields may include 1) an initial gain value for each DRC frame, 2) a set of slope values at particular points in the DRC curve, 3) a set of time delta values for each consecutive pair of slope values, and/or 4) one or more gain delta values representing changes of DRC gain values in the DRC gain curve between points of the slope values.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: October 22, 2019
    Assignee: APPLE INC.
    Inventor: Frank M. Baumgarte
  • Publication number: 20190181822
    Abstract: An audio encoding device and an audio decoding device are described herein. The audio encoding device may examine a set of audio channels/channel groups representing a piece of sound program content and produce a set of ducking values to associate with one of the channels/channel groups. During playback of the piece of sound program content, the ducking values may be applied to all other channels/channel groups. Application of these ducking values may cause (1) the reduction in dynamic range of ducked channels/channel groups and/or (2) movement of channels/channel groups in the sound field. This ducking may improve intelligibility of audio in the non-ducked channel/channel group. For instance, a narration channel/channel group may be more clearly heard by listeners through the use of selective ducking of other channels/channel groups during playback.
    Type: Application
    Filed: February 7, 2019
    Publication date: June 13, 2019
    Inventors: Tomlinson M. Holman, Frank M. Baumgarte, Eric A. Allamanche
  • Patent number: 10224894
    Abstract: An audio encoding device and an audio decoding device are described herein. The audio encoding device may examine a set of audio channels/channel groups representing a piece of sound program content and produce a set of ducking values to associate with one of the channels/channel groups. During playback of the piece of sound program content, the ducking values may be applied to all other channels/channel groups. Application of these ducking values may cause (1) the reduction in dynamic range of ducked channels/channel groups and/or (2) movement of channels/channel groups in the sound field. This ducking may improve intelligibility of audio in the non-ducked channel/channel group. For instance, a narration channel/channel group may be more clearly heard by listeners through the use of selective ducking of other channels/channel groups during playback.
    Type: Grant
    Filed: May 15, 2017
    Date of Patent: March 5, 2019
    Assignee: Apple Inc.
    Inventors: Tomlinson M. Holman, Frank M. Baumgarte, Eric A. Allamanche
  • Patent number: 10109288
    Abstract: An audio encoding device is described herein. The audio encoding device includes a compressor that is based on a nonlinear filter. In particular, the nonlinear filter may be selected from the class of edge-preserving smoothing filters, which avoids common artifacts of conventional compressors. Edge-preserving smoothing filters have been used in image processing algorithms for their de-noising properties while preserving edges in the image. These properties are useful for audio compression because macro-dynamic loudness changes can be tracked precisely while micro-dynamic loudness changes can be ignored for the compression. Due to these advantages, more aggressive compression can be achieved with less distortion.
    Type: Grant
    Filed: May 27, 2015
    Date of Patent: October 23, 2018
    Assignee: APPLE INC.
    Inventor: Frank M. Baumgarte
  • Publication number: 20180006621
    Abstract: An audio encoding device and an audio decoding device are described herein. The audio encoding device may examine a set of audio channels/channel groups representing a piece of sound program content and produce a set of ducking values to associate with one of the channels/channel groups. During playback of the piece of sound program content, the ducking values may be applied to all other channels/channel groups. Application of these ducking values may cause (1) the reduction in dynamic range of ducked channels/channel groups and/or (2) movement of channels/channel groups in the sound field. This ducking may improve intelligibility of audio in the non-ducked channel/channel group. For instance, a narration channel/channel group may be more clearly heard by listeners through the use of selective ducking of other channels/channel groups during playback.
    Type: Application
    Filed: May 15, 2017
    Publication date: January 4, 2018
    Inventors: Tomlinson M. Holman, Frank M. Baumgarte, Eric A. Allamanche
  • Patent number: 9774976
    Abstract: A system and method for rendering a piece of sound program content to include data and parameters that describe perceptual, acoustic, and geometric object properties is provided. The perceptual, acoustic, and geometric properties may include one or more of 1) a three-dimensional location of an audio object, 2) a width of an audio object, 3) ambience characteristics of an audio object, 4) diffuseness characteristics of an audio object, and 5) a direct-to-reverberant sound ratio of an audio object. Based on these pieces of data, an audio playback system may produce one or more beam patterns that reproduce three-dimensional properties of audio objects and/or audio channels of the piece of sound program content. Accordingly, the system and method for rendering a piece of sound program content may accurately represent the multi-dimensional properties of the piece of sound program content through the use of beam patterns.
    Type: Grant
    Filed: September 26, 2014
    Date of Patent: September 26, 2017
    Assignee: APPLE INC.
    Inventor: Frank M. Baumgarte
  • Publication number: 20170229134
    Abstract: A system for encoding and applying Dynamic Range Control/Compression (DRC) gain values to a piece of sound program content is described. In particular, a set of DRC gain values representing a DRC gain curve for the piece of content may be divided into frames corresponding to frames of the piece of content. A set of fields may be included with an audio signal representing the piece of content. The additional fields may represent the DRC gain values using linear or spline interpolation. The additional fields may include 1) an initial gain value for each DRC frame, 2) a set of slope values at particular points in the DRC curve, 3) a set of time delta values for each consecutive pair of slope values, and/or 4) one or more gain delta values representing changes of DRC gain values in the DRC gain curve between points of the slope values.
    Type: Application
    Filed: February 17, 2017
    Publication date: August 10, 2017
    Inventor: Frank M. Baumgarte
  • Patent number: 9654076
    Abstract: An audio encoding device and an audio decoding device are described herein. The audio encoding device may examine a set of audio channels/channel groups representing a piece of sound program content and produce a set of ducking values to associate with one of the channels/channel groups. During playback of the piece of sound program content, the ducking values may be applied to all other channels/channel groups. Application of these ducking values may cause (1) the reduction in dynamic range of ducked channels/channel groups and/or (2) movement of channels/channel groups in the sound field. This ducking may improve intelligibility of audio in the non-ducked channel/channel group. For instance, a narration channel/channel group may be more clearly heard by listeners through the use of selective ducking of other channels/channel groups during playback.
    Type: Grant
    Filed: February 3, 2015
    Date of Patent: May 16, 2017
    Assignee: Apple Inc.
    Inventors: Tomlinson M. Holman, Frank M. Baumgarte, Eric A. Allamanche
  • Patent number: 9607624
    Abstract: A system for encoding and applying Dynamic Range Control/Compression (DRC) gain values to a piece of sound program content is described. In particular, a set of DRC gain values representing a DRC gain curve for the piece of content may be divided into frames corresponding to frames of the piece of content. A set of fields may be included with an audio signal representing the piece of content. The additional fields may represent the DRC gain values using linear or spline interpolation. The additional fields may include 1) an initial gain value for each DRC frame, 2) a set of slope values at particular points in the DRC curve, 3) a set of time delta values for each consecutive pair of slope values, and/or 4) one or more gain delta values representing changes of DRC gain values in the DRC gain curve between points of the slope values.
    Type: Grant
    Filed: March 26, 2014
    Date of Patent: March 28, 2017
    Assignee: Apple Inc.
    Inventor: Frank M. Baumgarte
  • Patent number: 9608588
    Abstract: A system and method applying Dynamic Range Control/Compression (DRC) to an audio signal. The dynamic range controller presented here differs from conventional DRC techniques by providing a much larger look-ahead time. In particular, the system and method takes advantage of the look-ahead by analyzing macroscopic loudness changes in the order of seconds as opposed to the microscopic changes most conventional DRCs are designed to control. This approach avoids most of the typical DRC distortions associated with conventional DRC techniques and preserves the micro-dynamics of the audio signal. Gain changes are applied at a rate comparable with manual volume adjustments by mixing and mastering engineers to balance a mix. Ideally, the DRC will approach what a professional sound engineer would do to reduce the dynamic range if there were only a volume control to accomplish the task on the final mix.
    Type: Grant
    Filed: June 10, 2014
    Date of Patent: March 28, 2017
    Assignee: Apple Inc.
    Inventor: Frank M. Baumgarte
  • Publication number: 20160351202
    Abstract: An audio encoding device is described herein. The audio encoding device includes a compressor that is based on a nonlinear filter. In particular, the nonlinear filter may be selected from the class of edge-preserving smoothing filters, which avoids common artifacts of conventional compressors. Edge-preserving smoothing filters have been used in image processing algorithms for their de-noising properties while preserving edges in the image. These properties are useful for audio compression because macro-dynamic loudness changes can be tracked precisely while micro-dynamic loudness changes can be ignored for the compression. Due to these advantages, more aggressive compression can be achieved with less distortion.
    Type: Application
    Filed: May 27, 2015
    Publication date: December 1, 2016
    Inventor: Frank M. Baumgarte
  • Patent number: 9293146
    Abstract: A system and method for selectively applying Intensity Stereo coding to an audio signal is described. The system and method make decisions on whether to apply Intensity Stereo coding to each scale factor band of the audio signal based on (1) the number of bits necessary to encode each scale factor band using Intensity Stereo coding, (2) spatial distortions generated by using Intensity Stereo coding with each scale factor band, and (3) switching distortions for each scale factor band resulting from switching Intensity Stereo coding on or off in relation to a previous scale factor band.
    Type: Grant
    Filed: September 4, 2012
    Date of Patent: March 22, 2016
    Assignee: Apple Inc.
    Inventor: Frank M. Baumgarte
  • Patent number: 9276544
    Abstract: A system and method is provided for converting Dynamic Range Control/Compression (DRC) gain values into a spline representation that is compatible with the current standards. The system and method may: 1) minimize the bitrate for encoding and/or 2) minimize the approximation error between reference gain and interpolation values. A strategy for bitrate minimization may be the reduction of the number of spline nodes since gain and slope information must be transmitted for each node. Accordingly, an efficient heuristics based approach is provided that reduces the number of spline nodes needed to represent a series of DRC gain values using interpolation while accounting for overshoots and other inaccuracies.
    Type: Grant
    Filed: May 16, 2014
    Date of Patent: March 1, 2016
    Assignee: Apple Inc.
    Inventor: Frank M. Baumgarte
  • Patent number: 9240763
    Abstract: A system for performing loudness normalization based on user feedback is described herein. The system includes a content delivery system and a plurality of audio playback devices. The audio playback devices may communicate volume settings used during playback of pieces of sound program content to the content delivery system. Based on these collected data points, a statistical analysis may be performed to generate loudness adjustment values for pieces of sound program content. The loudness adjustment values may be communicated to the audio playback devices through metadata in associated pieces of sound program content or as separate communications from the content delivery system. An offline version is also described that supports individual loudness normalization adjustments based on a single user's preferences. Under either system, loudness normalization may be achieved based on real world volume settings for individual pieces of sound program content played using various playback configurations.
    Type: Grant
    Filed: November 25, 2013
    Date of Patent: January 19, 2016
    Assignee: Apple Inc.
    Inventor: Frank M. Baumgarte
  • Publication number: 20150280676
    Abstract: An audio encoding device and an audio decoding device are described herein. The audio encoding device may examine a set of audio channels/channel groups representing a piece of sound program content and produce a set of ducking values to associate with one of the channels/channel groups. During playback of the piece of sound program content, the ducking values may be applied to all other channels/channel groups. Application of these ducking values may cause (1) the reduction in dynamic range of ducked channels/channel groups and/or (2) movement of channels/channel groups in the sound field. This ducking may improve intelligibility of audio in the non-ducked channel/channel group. For instance, a narration channel/channel group may be more clearly heard by listeners through the use of selective ducking of other channels/channel groups during playback.
    Type: Application
    Filed: February 3, 2015
    Publication date: October 1, 2015
    Inventors: Tomlinson M. Holman, Frank M. Baumgarte, Eric A. Allamanche
  • Publication number: 20150207479
    Abstract: A system and method applying Dynamic Range Control/Compression (DRC) to an audio signal. The dynamic range controller presented here differs from conventional DRC techniques by providing a much larger look-ahead time. In particular, the system and method takes advantage of the look-ahead by analyzing macroscopic loudness changes in the order of seconds as opposed to the microscopic changes most conventional DRCs are designed to control. This approach avoids most of the typical DRC distortions associated with conventional DRC techniques and preserves the micro-dynamics of the audio signal. Gain changes are applied at a rate comparable with manual volume adjustments by mixing and mastering engineers to balance a mix. Ideally, the DRC will approach what a professional sound engineer would do to reduce the dynamic range if there were only a volume control to accomplish the task on the final mix.
    Type: Application
    Filed: June 10, 2014
    Publication date: July 23, 2015
    Inventor: Frank M. Baumgarte
  • Publication number: 20150162884
    Abstract: A system and method is provided for converting Dynamic Range Control/Compression (DRC) gain values into a spline representation that is compatible with the current standards. The system and method may: 1) minimize the bitrate for encoding and/or 2) minimize the approximation error between reference gain and interpolation values. A strategy for bitrate minimization may be the reduction of the number of spline nodes since gain and slope information must be transmitted for each node. Accordingly, an efficient heuristics based approach is provided that reduces the number of spline nodes needed to represent a series of DRC gain values using interpolation while accounting for overshoots and other inaccuracies.
    Type: Application
    Filed: May 16, 2014
    Publication date: June 11, 2015
    Applicant: Apple Inc.
    Inventor: Frank M. Baumgarte