Patents by Inventor Nils Günther Peters

Nils Günther Peters has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200105282
    Abstract: In general, techniques are described for obtaining audio rendering information from a bitstream. A method of rendering audio data includes receiving, at an interface of a device, an encoded audio bitstream, storing, to a memory of the device, encoded audio data of the encoded audio bitstream, parsing, by one or more processors of the device, a portion of the encoded audio data stored to the memory to select a renderer for the encoded audio data, the selected renderer comprising one of an object-based renderer or an ambisonic renderer, rendering, by the one or more processors of the device, the encoded audio data using the selected renderer to generate one or more rendered speaker feeds, and outputting, by one or more loudspeakers of the device, the one or more rendered speaker feeds.
    Type: Application
    Filed: September 25, 2019
    Publication date: April 2, 2020
    Inventors: Moo Young Kim, Nils Günther Peters
  • Publication number: 20200107147
    Abstract: In general, techniques are described for modeling occlusions when rendering audio data. A device comprising a memory and one or more processors may perform the techniques. The memory may store audio data representative of a soundfield. The one or more processors may obtain occlusion metadata representative of an occlusion within the soundfield in terms of propagation of sound through the occlusion, the occlusion separating the soundfield into two or more sound spaces. The one or more processors may obtain a location of the device, and obtain, based on the occlusion metadata and the location, a renderer by which to render the audio data into one or more speaker feeds that account for propagation of the sound in one of the two or more sound spaces in which the device resides. The one or more processors may apply the renderer to the audio data to generate the speaker feeds.
    Type: Application
    Filed: September 26, 2019
    Publication date: April 2, 2020
    Inventors: Isaac Garcia Munoz, Siddhartha Goutham Swaminathan, S M Akramus Salehin, Moo Young Kim, Nils Günther Peters, Dipanjan Sen
  • Publication number: 20200013414
    Abstract: In general, techniques are described by which to embed enhanced audio transports in backward compatible bitstreams. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store the backward compatible bitstream, which conforms to a legacy transport format. The processor(s) may obtain, from the backward compatible bitstream, legacy audio data that conforms to a legacy audio format, and obtain, from the backward compatible bitstream, extended audio data that enhances the legacy audio data. The processor(s) may also obtain, based on the legacy audio data and the extended audio data, enhanced audio data that conforms to an enhanced audio format, and output the enhanced audio data to one or more speakers.
    Type: Application
    Filed: June 24, 2019
    Publication date: January 9, 2020
    Inventors: Shankar Thagadur Shivappa, Richard Paul Walters, Dipanjan Sen, Nils Günther Peters, Moo Young Kim
  • Publication number: 20200013426
    Abstract: In general, techniques are described by which to synchronize enhanced audio transports with backward compatible audio transports. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store a backward compatible bitstream conforming to a legacy transport format. The processor may obtain, from the backward compatible bitstream, a first audio transport stream, and obtain, from the backward compatible bitstream, a second audio transport stream. The processor(s) may also obtain, from the backward compatible bitstream, indications representative of synchronization information for the first audio transport stream and the second audio transport stream. The processor(s) may synchronize, based on the indications, the first audio transport stream and the second audio transport to obtain synchronized audio data stream.
    Type: Application
    Filed: June 24, 2019
    Publication date: January 9, 2020
    Inventors: Dipanjan Sen, Shankar Thagadur Shivappa, Nils Günther Peters, Ferdinando Olivieri
  • Publication number: 20190392845
    Abstract: In general, techniques are described by which to specify spatially formatted enhanced audio data for backward compatible audio bitstreams. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store the backward compatible bitstream that conforms to a legacy transport format. The processor(s) may obtain, from the backward compatible bitstream, legacy audio data that conforms to a legacy audio format and a spatially formatted extended audio stream. The processor(s) may process the spatially formatted extended audio stream to obtain extended audio data that enhances the legacy audio data. The processor(s) may next obtain, based on the legacy audio data and the extended audio data, enhanced audio data that conforms to an enhanced audio format. The processor(s) may output the enhanced audio data to one or more speakers.
    Type: Application
    Filed: June 24, 2019
    Publication date: December 26, 2019
    Inventors: Nils Günther Peters, Ferdinando Olivieri, Moo Young Kim, Dipanjan Sen, Shankar Thagadur Shivappa
  • Publication number: 20190392846
    Abstract: In general, techniques are described by which to obtain demixing data for backward compatible rendering of higher order ambisonic audio data. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store the higher order ambisonic (HOA) audio data. The processor may obtain, from a bitstream, legacy audio data that conforms to a legacy audio format, and obtain, from the bitstream, de-mixing data. The processor(s) may process, based on the de-mixing data, the legacy audio data to obtain the first portion of the HOA audio data. The processor(s) may next obtain, from the bitstream, a second portion of the HOA audio data. The processor(s) may render the first portion and the second portion to obtain a speaker feed. Further, the processor(s) may output the speaker feed to a speaker to reproduce a soundfield represented by the HOA audio data.
    Type: Application
    Filed: June 24, 2019
    Publication date: December 26, 2019
    Inventors: Moo Young Kim, Dipanjan Sen, Nils Günther Peters, Ferdinando Olivieri
  • Publication number: 20190387348
    Abstract: An example device includes a memory device, and a processor coupled to the memory device. The memory is configured to store a plurality of representations of a soundfield. The processor is configured to track a steering angle provided by one or more angles associated with the device, and to select, based on the steering angle, a representation of the soundfield from the plurality of representations stored to the memory device.
    Type: Application
    Filed: August 30, 2019
    Publication date: December 19, 2019
    Inventors: Nils Günther Peters, Dipanjan Sen, Thomas Stockhammer
  • Publication number: 20190385622
    Abstract: In general, techniques are described for signaling layers for scalable coding of higher order ambisonic audio data. A device comprising a memory and a processor may be configured to perform the techniques. The memory may be configured to store the bitstream. The processor may be configured to obtain, from the bitstream, an indication of a number of layers specified in the bitstream, and obtain the layers of the bitstream based on the indication of the number of layers.
    Type: Application
    Filed: August 30, 2019
    Publication date: December 19, 2019
    Inventors: Moo Young KIM, Nils Günther Peters, Dipanjan Sen
  • Patent number: 10469968
    Abstract: In general, techniques are described for adapting higher order ambisonic audio data to include three degrees of freedom plus effects. An example device configured to perform the techniques includes a memory, and a processor coupled to the memory. The memory may be configured to store higher order ambisonic audio data representative of a soundfield. The processor may be configured to obtain a translational distance representative of a translational head movement of a user interfacing with the device. The processor may further be configured to adapt, based on the translational distance, higher order ambisonic audio data to provide three degrees of freedom plus effects that adapt the soundfield to account for the translational head movement, and generate speaker feeds based on the adapted higher order ambient audio data.
    Type: Grant
    Filed: October 12, 2017
    Date of Patent: November 5, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Nils Günther Peters, S M Akramus Salehin, Shankar Thagadur Shivappa, Moo Young Kim, Dipanjan Sen
  • Patent number: 10433087
    Abstract: A method for reducing vibration noise by an electronic device is described. The method includes obtaining an audio signal. The audio signal includes vibration noise. The method also includes obtaining vibration data from one or more motion sensor signals. The method further includes processing the vibration data to produce microphone-response matched vibration data based on a transfer function. The method additionally includes reducing the vibration noise based on the microphone-response matched vibration data.
    Type: Grant
    Filed: September 15, 2016
    Date of Patent: October 1, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Ricardo De Jesus Bernal Castillo, Daniel Weber, Dipanjan Sen, Eric Mattis, Mark Cherry, Nils Günther Peters
  • Patent number: 10412522
    Abstract: In general, techniques are described for inserting audio channels into descriptions of soundfields. A device comprising a processor may be configured to perform the techniques. The processor may be configured to obtain an audio channel separate from a higher-order ambisonic representation of a soundfield. The processor may further be configured to insert the audio channel at a spatial location within the soundfield such that the audio channel is able to be extracted from the soundfield.
    Type: Grant
    Filed: March 19, 2015
    Date of Patent: September 10, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Dipanjan Sen, Nils Günther Peters
  • Patent number: 10405126
    Abstract: An example device includes a memory device, and a processor coupled to the memory device. The memory is configured to store a plurality of representations of a soundfield. The processor is configured to track a steering angle provided by one or more angles associated with the device, and to select, based on the steering angle, a representation of the soundfield from the plurality of representations stored to the memory device.
    Type: Grant
    Filed: August 8, 2017
    Date of Patent: September 3, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Nils Günther Peters, Dipanjan Sen, Thomas Stockhammer
  • Patent number: 10403294
    Abstract: In general, techniques are described for signaling layers for scalable coding of higher order ambisonic audio data. A device comprising a memory and a processor may be configured to perform the techniques. The memory may be configured to store the bitstream. The processor may be configured to obtain, from the bitstream, an indication of a number of layers specified in the bitstream, and obtain the layers of the bitstream based on the indication of the number of layers.
    Type: Grant
    Filed: November 7, 2018
    Date of Patent: September 3, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Moo Young Kim, Nils Günther Peters, Dipanjan Sen
  • Publication number: 20190239015
    Abstract: In general, techniques are described by which to support scalable unified audio rendering. A device comprising an audio decoder, a memory, and a processor may be configured to perform various aspects of the techniques. The audio decoder may decode, from a bitstream, first audio data and second audio data. The memory may store the first audio data and the second audio data. The processor may render the first audio data into first spatial domain audio data for playback by virtual speakers at a set of virtual speaker locations, and render the second audio data into second spatial domain audio data for playback by the virtual speakers at the set of virtual speaker locations. The processor may also mix the first spatial domain audio data and the second spatial domain audio data to obtain mixed spatial domain audio data, and convert the mixed spatial domain audio data to scene-based audio data.
    Type: Application
    Filed: January 31, 2019
    Publication date: August 1, 2019
    Inventors: Andre Gustavo P. Schevciw, Nils Günther Peters
  • Patent number: 10346126
    Abstract: Methods and apparatuses are disclosed for streaming audio between a source device and a destination device. An example method may include determining an available bandwidth between the source device and the destination device. The example method may also include determining a bit rate for streaming audio from the source device to the destination device, wherein the bit rate is based on the available bandwidth. The example method may further include determining a preferred audio characteristic for streaming audio from the source device to the destination device, wherein the preferred audio characteristic is based on a user preference. The example method may also include determining encoded audio to be transmitted from the source device to the destination device based on the preferred audio characteristic and the bit rate.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: July 9, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Nils Günther Peters, Moo Young Kim, Dipanjan Sen
  • Publication number: 20190198028
    Abstract: In general, techniques are described by which to provide priority information for higher order ambisonic (HOA) audio data. A device comprising a memory and a processor may perform the techniques. The memory stores HOA coefficients of the HOA audio data, the HOA coefficients representative of a soundfield. The processor may decompose the HOA coefficients into a sound component and a corresponding spatial component, the corresponding spatial component defining shape, width, and directions of the sound component, and the corresponding spatial component defined in a spherical harmonic domain. The processor may also determine, based on one or more of the sound component and the corresponding spatial component, priority information indicative of a priority of the sound component relative to other sound components of the soundfield, and specify, in a data object representative of a compressed version of the HOA audio data, the sound component and the priority information.
    Type: Application
    Filed: December 20, 2018
    Publication date: June 27, 2019
    Inventors: Moo Young Kim, Nils Günther Peters, Shankar Thagadur Shivappa, Dipanjan Sen
  • Publication number: 20190116440
    Abstract: In general, techniques are described for adapting higher order ambisonic audio data to include three degrees of freedom plus effects. An example device configured to perform the techniques includes a memory, and a processor coupled to the memory. The memory may be configured to store higher order ambisonic audio data representative of a soundfield. The processor may be configured to obtain a translational distance representative of a translational head movement of a user interfacing with the device. The processor may further be configured to adapt, based on the translational distance, higher order ambisonic audio data to provide three degrees of freedom plus effects that adapt the soundfield to account for the translational head movement, and generate speaker feeds based on the adapted higher order ambient audio data.
    Type: Application
    Filed: October 12, 2017
    Publication date: April 18, 2019
    Inventors: Nils Günther Peters, S M Akramus Salehin, Shankar Thagadur Shivappa, Moo Young Kim, Dipanjan Sen
  • Publication number: 20190074020
    Abstract: In general, techniques are described for signaling layers for scalable coding of higher order ambisonic audio data. A device comprising a memory and a processor may be configured to perform the techniques. The memory may be configured to store the bitstream. The processor may be configured to obtain, from the bitstream, an indication of a number of layers specified in the bitstream, and obtain the layers of the bitstream based on the indication of the number of layers.
    Type: Application
    Filed: November 7, 2018
    Publication date: March 7, 2019
    Inventors: Moo Young Kim, Nils Günther Peters, Dipanjan Sen
  • Patent number: 10178489
    Abstract: In general, techniques are described for specifying audio rendering information in a bitstream. A device configured to generate the bitstream may perform various aspects of the techniques. The bitstream generation device may comprise one or more processors configured to specify audio rendering information that includes a signal value identifying an audio renderer used when generating the multi-channel audio content. A device configured to render multi-channel audio content from a bitstream may also perform various aspects of the techniques. The rendering device may comprise one or more processors configured to determine audio rendering information that includes a signal value identifying an audio renderer used when generating the multi-channel audio content, and render a plurality of speaker feeds based on the audio rendering information.
    Type: Grant
    Filed: February 6, 2014
    Date of Patent: January 8, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Dipanjan Sen, Martin James Morrell, Nils Günther Peters
  • Publication number: 20190005986
    Abstract: An example device includes a memory device, and a processor coupled to the memory device. The memory is configured to store audio spatial metadata associated with a soundfield and video data. The processor is configured to identify one or more foreground audio objects of the soundfield using the audio spatial metadata stored to the memory device, and to select, based on the identified one or more foreground audio objects, one or more viewports associated with the video data. Display hardware coupled to the processor and the memory device is configured to output a portion of the video data being associated with the one or more viewports selected by the processor.
    Type: Application
    Filed: August 8, 2017
    Publication date: January 3, 2019
    Inventors: Nils Günther Peters, Shankar Thagadur Shivappa, Dipanjan Sen