Patents by Inventor Nils Gunther Peters

Nils Gunther Peters has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10659906
    Abstract: An example audio decoding device includes processing circuitry and a memory device coupled to the processing circuitry. The processing circuitry is configured to receive, in a bitstream, encoded representations of audio objects of a three-dimensional (3D) soundfield, to receive metadata associated with the bitstream, to obtain, from the received metadata, one or more transmission factors associated with one or more of the audio objects, and to apply the transmission factors to the one or more audio objects to obtain parallax-adjusted audio objects of the 3D soundfield. The memory device is configured to store at least a portion of the received bitstream, the received metadata, or the parallax-adjusted audio objects of the 3D soundfield.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: May 19, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Moo Young Kim, Nils Günther Peters, Dipanjan Sen
  • Patent number: 10657974
    Abstract: In general, techniques are described by which to provide priority information for higher order ambisonic (HOA) audio data. A device comprising a memory and a processor may perform the techniques. The memory stores HOA coefficients of the HOA audio data, the HOA coefficients representative of a soundfield. The processor may decompose the HOA coefficients into a sound component and a corresponding spatial component, the corresponding spatial component defining shape, width, and directions of the sound component, and the corresponding spatial component defined in a spherical harmonic domain. The processor may also determine, based on one or more of the sound component and the corresponding spatial component, priority information indicative of a priority of the sound component relative to other sound components of the soundfield, and specify, in a data object representative of a compressed version of the HOA audio data, the sound component and the priority information.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: May 19, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Moo Young Kim, Nils Günther Peters, Shankar Thagadur Shivappa, Dipanjan Sen
  • Publication number: 20200112814
    Abstract: A device and method for backward compatibility for virtual reality (VR), mixed reality (MR), augmented reality (AR), computer vision, and graphics systems. The device and method enable rendering audio data with more degrees of freedom on devices that support fewer degrees of freedom. The device includes memory configured to store audio data representative of a soundfield captured at a plurality of capture locations, metadata that enables the audio data to be rendered to support N degrees of freedom, and adaptation metadata that enables the audio data to be rendered to support M degrees of freedom. The device also includes one or more processors coupled to the memory, and configured to adapt, based on the adaptation metadata, the audio data to provide the M degrees of freedom, and generate speaker feeds based on the adapted audio data.
    Type: Application
    Filed: September 11, 2019
    Publication date: April 9, 2020
    Inventors: Moo Young Kim, Nils Günther Peters, S M Akramus Salehin, Siddhartha Goutham Swaminathan, Dipanjan Sen
  • Publication number: 20200105282
    Abstract: In general, techniques are described for obtaining audio rendering information from a bitstream. A method of rendering audio data includes receiving, at an interface of a device, an encoded audio bitstream, storing, to a memory of the device, encoded audio data of the encoded audio bitstream, parsing, by one or more processors of the device, a portion of the encoded audio data stored to the memory to select a renderer for the encoded audio data, the selected renderer comprising one of an object-based renderer or an ambisonic renderer, rendering, by the one or more processors of the device, the encoded audio data using the selected renderer to generate one or more rendered speaker feeds, and outputting, by one or more loudspeakers of the device, the one or more rendered speaker feeds.
    Type: Application
    Filed: September 25, 2019
    Publication date: April 2, 2020
    Inventors: Moo Young Kim, Nils Günther Peters
  • Publication number: 20200107147
    Abstract: In general, techniques are described for modeling occlusions when rendering audio data. A device comprising a memory and one or more processors may perform the techniques. The memory may store audio data representative of a soundfield. The one or more processors may obtain occlusion metadata representative of an occlusion within the soundfield in terms of propagation of sound through the occlusion, the occlusion separating the soundfield into two or more sound spaces. The one or more processors may obtain a location of the device, and obtain, based on the occlusion metadata and the location, a renderer by which to render the audio data into one or more speaker feeds that account for propagation of the sound in one of the two or more sound spaces in which the device resides. The one or more processors may apply the renderer to the audio data to generate the speaker feeds.
    Type: Application
    Filed: September 26, 2019
    Publication date: April 2, 2020
    Inventors: Isaac Garcia Munoz, Siddhartha Goutham Swaminathan, S M Akramus Salehin, Moo Young Kim, Nils Günther Peters, Dipanjan Sen
  • Publication number: 20200053505
    Abstract: One or more processors may obtain a first distance between a first audio zone of the two or more audio zones associated with the one or more interest points within the first audio zone, and a first device position of a device, obtain a second distance between a second audio zone of the two or more audio zones associated with the one or more interest points within the second audio zone, and the first device position of the device, and obtain an updated first distance and updated second distance after movement of the device has changed from the first device position to a second device position. The one or more processor(s) may independently control the first audio zone and the second audio zone, such that the audio data within the first audio zone and the second audio zone are adjusted based on the updated first distance and updated second distance.
    Type: Application
    Filed: August 8, 2018
    Publication date: February 13, 2020
    Inventors: Nils Gunther PETERS, S M Akramus SALEHIN, Shankar THAGADUR SHIVAPPA, Moo Young KIM, Dipanjan SEN
  • Publication number: 20200053464
    Abstract: Disclosed are techniques and devices which include a memory configured to store audio data within a first audio zone, or a second audio zone in a layered soundfield. The memory is coupled to one or more processors and the memory is configured to store the audio data in the first audio zone and the second audio data in the layered soundfield. The one or more processors are configured to receive an interaction command to control the audio data in the first audio zone and the second audio zone in the layered soundfield, and generate one or more indicators that the interaction command was received to control the audio data, in the first audio zone or the second audio zone of the layered soundfield.
    Type: Application
    Filed: August 8, 2018
    Publication date: February 13, 2020
    Inventor: Nils Gunther PETERS
  • Publication number: 20200013426
    Abstract: In general, techniques are described by which to synchronize enhanced audio transports with backward compatible audio transports. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store a backward compatible bitstream conforming to a legacy transport format. The processor may obtain, from the backward compatible bitstream, a first audio transport stream, and obtain, from the backward compatible bitstream, a second audio transport stream. The processor(s) may also obtain, from the backward compatible bitstream, indications representative of synchronization information for the first audio transport stream and the second audio transport stream. The processor(s) may synchronize, based on the indications, the first audio transport stream and the second audio transport to obtain synchronized audio data stream.
    Type: Application
    Filed: June 24, 2019
    Publication date: January 9, 2020
    Inventors: Dipanjan Sen, Shankar Thagadur Shivappa, Nils Günther Peters, Ferdinando Olivieri
  • Publication number: 20200013414
    Abstract: In general, techniques are described by which to embed enhanced audio transports in backward compatible bitstreams. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store the backward compatible bitstream, which conforms to a legacy transport format. The processor(s) may obtain, from the backward compatible bitstream, legacy audio data that conforms to a legacy audio format, and obtain, from the backward compatible bitstream, extended audio data that enhances the legacy audio data. The processor(s) may also obtain, based on the legacy audio data and the extended audio data, enhanced audio data that conforms to an enhanced audio format, and output the enhanced audio data to one or more speakers.
    Type: Application
    Filed: June 24, 2019
    Publication date: January 9, 2020
    Inventors: Shankar Thagadur Shivappa, Richard Paul Walters, Dipanjan Sen, Nils Günther Peters, Moo Young Kim
  • Publication number: 20190392846
    Abstract: In general, techniques are described by which to obtain demixing data for backward compatible rendering of higher order ambisonic audio data. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store the higher order ambisonic (HOA) audio data. The processor may obtain, from a bitstream, legacy audio data that conforms to a legacy audio format, and obtain, from the bitstream, de-mixing data. The processor(s) may process, based on the de-mixing data, the legacy audio data to obtain the first portion of the HOA audio data. The processor(s) may next obtain, from the bitstream, a second portion of the HOA audio data. The processor(s) may render the first portion and the second portion to obtain a speaker feed. Further, the processor(s) may output the speaker feed to a speaker to reproduce a soundfield represented by the HOA audio data.
    Type: Application
    Filed: June 24, 2019
    Publication date: December 26, 2019
    Inventors: Moo Young Kim, Dipanjan Sen, Nils Günther Peters, Ferdinando Olivieri
  • Publication number: 20190392845
    Abstract: In general, techniques are described by which to specify spatially formatted enhanced audio data for backward compatible audio bitstreams. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store the backward compatible bitstream that conforms to a legacy transport format. The processor(s) may obtain, from the backward compatible bitstream, legacy audio data that conforms to a legacy audio format and a spatially formatted extended audio stream. The processor(s) may process the spatially formatted extended audio stream to obtain extended audio data that enhances the legacy audio data. The processor(s) may next obtain, based on the legacy audio data and the extended audio data, enhanced audio data that conforms to an enhanced audio format. The processor(s) may output the enhanced audio data to one or more speakers.
    Type: Application
    Filed: June 24, 2019
    Publication date: December 26, 2019
    Inventors: Nils Günther Peters, Ferdinando Olivieri, Moo Young Kim, Dipanjan Sen, Shankar Thagadur Shivappa
  • Publication number: 20190385622
    Abstract: In general, techniques are described for signaling layers for scalable coding of higher order ambisonic audio data. A device comprising a memory and a processor may be configured to perform the techniques. The memory may be configured to store the bitstream. The processor may be configured to obtain, from the bitstream, an indication of a number of layers specified in the bitstream, and obtain the layers of the bitstream based on the indication of the number of layers.
    Type: Application
    Filed: August 30, 2019
    Publication date: December 19, 2019
    Inventors: Moo Young KIM, Nils Günther Peters, Dipanjan Sen
  • Publication number: 20190387348
    Abstract: An example device includes a memory device, and a processor coupled to the memory device. The memory is configured to store a plurality of representations of a soundfield. The processor is configured to track a steering angle provided by one or more angles associated with the device, and to select, based on the steering angle, a representation of the soundfield from the plurality of representations stored to the memory device.
    Type: Application
    Filed: August 30, 2019
    Publication date: December 19, 2019
    Inventors: Nils Günther Peters, Dipanjan Sen, Thomas Stockhammer
  • Patent number: 10477310
    Abstract: A method includes performing, at a processor, signal processing operations on signals captured by each microphone in a microphone array. The method also includes performing a first directivity adjustment by applying a first set of multiplicative factors to the signals to generate a first set of ambisonic signals. The first set of multiplicative factors is determined based on a position of each microphone in the microphone array, an orientation of each microphone in the microphone array, or both.
    Type: Grant
    Filed: December 8, 2017
    Date of Patent: November 12, 2019
    Assignee: Qualcomm Incorporated
    Inventors: S M Akramus Salehin, Ricardo De Jesus Bernal Castillo, Michael Ericson, Ferdinando Olivieri, Nils Gunther Peters, Dipanjan Sen
  • Patent number: 10469968
    Abstract: In general, techniques are described for adapting higher order ambisonic audio data to include three degrees of freedom plus effects. An example device configured to perform the techniques includes a memory, and a processor coupled to the memory. The memory may be configured to store higher order ambisonic audio data representative of a soundfield. The processor may be configured to obtain a translational distance representative of a translational head movement of a user interfacing with the device. The processor may further be configured to adapt, based on the translational distance, higher order ambisonic audio data to provide three degrees of freedom plus effects that adapt the soundfield to account for the translational head movement, and generate speaker feeds based on the adapted higher order ambient audio data.
    Type: Grant
    Filed: October 12, 2017
    Date of Patent: November 5, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Nils Günther Peters, S M Akramus Salehin, Shankar Thagadur Shivappa, Moo Young Kim, Dipanjan Sen
  • Patent number: 10433087
    Abstract: A method for reducing vibration noise by an electronic device is described. The method includes obtaining an audio signal. The audio signal includes vibration noise. The method also includes obtaining vibration data from one or more motion sensor signals. The method further includes processing the vibration data to produce microphone-response matched vibration data based on a transfer function. The method additionally includes reducing the vibration noise based on the microphone-response matched vibration data.
    Type: Grant
    Filed: September 15, 2016
    Date of Patent: October 1, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Ricardo De Jesus Bernal Castillo, Daniel Weber, Dipanjan Sen, Eric Mattis, Mark Cherry, Nils Günther Peters
  • Patent number: 10412522
    Abstract: In general, techniques are described for inserting audio channels into descriptions of soundfields. A device comprising a processor may be configured to perform the techniques. The processor may be configured to obtain an audio channel separate from a higher-order ambisonic representation of a soundfield. The processor may further be configured to insert the audio channel at a spatial location within the soundfield such that the audio channel is able to be extracted from the soundfield.
    Type: Grant
    Filed: March 19, 2015
    Date of Patent: September 10, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Dipanjan Sen, Nils Günther Peters
  • Patent number: 10403294
    Abstract: In general, techniques are described for signaling layers for scalable coding of higher order ambisonic audio data. A device comprising a memory and a processor may be configured to perform the techniques. The memory may be configured to store the bitstream. The processor may be configured to obtain, from the bitstream, an indication of a number of layers specified in the bitstream, and obtain the layers of the bitstream based on the indication of the number of layers.
    Type: Grant
    Filed: November 7, 2018
    Date of Patent: September 3, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Moo Young Kim, Nils Günther Peters, Dipanjan Sen
  • Patent number: 10405126
    Abstract: An example device includes a memory device, and a processor coupled to the memory device. The memory is configured to store a plurality of representations of a soundfield. The processor is configured to track a steering angle provided by one or more angles associated with the device, and to select, based on the steering angle, a representation of the soundfield from the plurality of representations stored to the memory device.
    Type: Grant
    Filed: August 8, 2017
    Date of Patent: September 3, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Nils Günther Peters, Dipanjan Sen, Thomas Stockhammer
  • Patent number: 10390166
    Abstract: A device includes a mixer configured to mix first ambisonic data and second ambisonic data to generate mixed ambisonic data. The first ambisonic data and the second ambisonic data correspond to different spatial orders. The device also includes ambisonic adjustment circuitry configured to adjust the mixed ambisonic data based on position data to generate an adjusted mixed ambisonic output.
    Type: Grant
    Filed: September 25, 2017
    Date of Patent: August 20, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Gang Chen, Vasudev Nayak, Shankar Thagadur Shivappa, S M Akramus Salehin, Nils Gunther Peters