Patents by Inventor Nils Gunther Peters
Nils Gunther Peters has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11558707Abstract: A device includes one or more processors configured to receive, via wireless transmission from a streaming device, encoded ambisonics audio data representing a sound field. The one or more processors are also configured to perform decoding of the ambisonics audio data to generate decoded ambisonics audio data. The decoding of the ambisonics audio data includes base layer decoding of a base layer of the encoded ambisonics audio data and selectively includes enhancement layer decoding in response to an amount of movement of the device. The one or more processors are further configured to adjust the decoded ambisonics audio data to alter the sound field based on data associated with at least one of a translation or an orientation associated with the movement of the device. The one or more processors are also configured to output the adjusted decoded ambisonics audio data to two or more loudspeakers for playback.Type: GrantFiled: June 28, 2021Date of Patent: January 17, 2023Assignee: Qualcomm IncorporatedInventors: Andre Schevciw, Vinay Melkote Krishnaprasad, Nils Gunther Peters, Isaac Garcia Munoz
-
Patent number: 11538489Abstract: In general, techniques are described by which to correlate scene-based audio data for psychoacoustic audio coding. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store a bitstream including a plurality of encoded correlated components of a soundfield represented by scene-based audio data. The one or more processors may perform psychoacoustic audio decoding with respect to one or more of the plurality of encoded correlated components to obtain a plurality of correlated components, and obtain, from the bitstream, an indication representative of how the one or more of the plurality of correlated components were reordered in the bitstream. The one or more processors may reorder, based on the indication, the plurality of correlated components to obtain a plurality of reordered components, and reconstruct, based on the plurality of reordered components, the scene-based audio data.Type: GrantFiled: June 22, 2020Date of Patent: December 27, 2022Assignee: Qualcomm IncorporatedInventors: Ferdinando Olivieri, Taher Shahbazi Mirzahasanloo, Nils Günther Peters
-
Publication number: 20220382509Abstract: A device for managing sound playback includes one or more processors configured to receive an indication of a user-device interaction between a user and an audio interface device during a sound playback operation of a multi-speaker audio playback system. The one or more processors are also configured to, based on receiving the indication of the user-device interaction, initiate a selective adjustment of the sound playback operation to reduce a playback sound of the multi-speaker audio playback system based on a position of the user.Type: ApplicationFiled: November 17, 2020Publication date: December 1, 2022Inventors: Jason FILOS, Ferdinando Olivieri, Nils Gunther Peters
-
Publication number: 20220386060Abstract: Methods, systems, computer-readable media, and apparatuses for manipulating a soundfield are presented. Some configurations include receiving a bitstream that comprises metadata and a soundfield description; parsing the metadata to obtain an effect identifier and at least one effect parameter value; and applying, to the soundfield description, an effect identified by the effect identifier. The applying may include using the at least one effect parameter value to apply the identified effect to the soundfield description.Type: ApplicationFiled: October 29, 2020Publication date: December 1, 2022Inventors: Nils Gunther PETERS, Shankar THAGADUR SHIVAPPA, S M Akramus SALEHIN, Jason FILOS, Siddhartha Goutham SWAMINATHAN, Ferdinando OLIVIERI
-
Publication number: 20220377490Abstract: A device may be configured to play one or more of a plurality of audio streams. The device may include a memory configured to store the plurality of audio streams, each of the audio streams representative of a soundfield. The device also may include one or more processors coupled to the memory, and configured to present a user interface to a user, obtain an indication from the user via the user interface representing a desired listening position, select, based on the indication, at least one audio stream of the plurality of audio streams, and output, for a display and in response to obtaining the indication representing the desired listening position, a graphical user interface element suggesting an alternative listening position.Type: ApplicationFiled: August 2, 2022Publication date: November 24, 2022Inventors: Isaac Garcia Munoz, Siddhartha Goutham Swaminathan, Nils Günther Peters, S M Akramus Salehin
-
Patent number: 11432097Abstract: A device may be configured to play one or more of a plurality of audio streams. The device may include a memory configured to store the plurality of audio streams, each of the audio streams representative of a soundfield. The device also may include one or more processors coupled to the memory, and configured to present a user interface to a user, obtain an indication from a user via the user interface representing a desired listening position; and select, based on the indication, at least one audio stream of the plurality of audio streams.Type: GrantFiled: July 1, 2020Date of Patent: August 30, 2022Assignee: Qualcomm IncorporatedInventors: Isaac Garcia Munoz, Siddhartha Goutham Swaminathan, Nils Günther Peters, S M Akramus Salehin
-
Patent number: 11432071Abstract: Disclosed are techniques and devices which include a memory configured to store audio data within a first audio zone, or a second audio zone in a layered soundfield. The memory is coupled to one or more processors and the memory is configured to store the audio data in the first audio zone and the second audio data in the layered soundfield. The one or more processors are configured to receive an interaction command to control the audio data in the first audio zone and the second audio zone in the layered soundfield, and generate one or more indicators that the interaction command was received to control the audio data, in the first audio zone or the second audio zone of the layered soundfield.Type: GrantFiled: August 8, 2018Date of Patent: August 30, 2022Assignee: Qualcomm IncorporatedInventor: Nils Gunther Peters
-
Patent number: 11429340Abstract: In some examples, a content consumer device configured to play one or more of a plurality of audio streams includes a memory configured to store the plurality of audio streams and audio location information associated with the plurality of audio streams and representative of audio stream coordinates in an acoustical space where an audio stream was captured or synthesized or both. Each of the audio streams is representative of a soundfield. The content consumer device also includes one or more processors coupled to the memory, and configured to determine device location information representative of device coordinates of the content consumer device in the acoustical space. The one or more processors are configured to select, based on the device location information and the audio location information, a subset of the plurality of audio streams, and output, based on the subset of the plurality of audio streams, one or more speaker feeds.Type: GrantFiled: July 1, 2020Date of Patent: August 30, 2022Assignee: Qualcomm IncorporatedInventors: Isaac Garcia Munoz, Siddhartha Goutham Swaminathan, S M Akramus Salehin, Nils Günther Peters
-
Patent number: 11405699Abstract: An example device for accessing media data includes a memory configured to store media data; and one or more processors implemented in circuitry and configured to: receive a scene description of a GL Transmission Format 2.0 (glTF2) bitstream including a timed media object; determine a position of the timed media object in a presentation environment using the scene description; retrieve current timed media data for the timed media object for a current presentation time; and present the current timed media data according to the position of the timed media object at the current presentation time.Type: GrantFiled: September 30, 2020Date of Patent: August 2, 2022Assignee: QUALCOMM IncorporatedInventors: Imed Bouazizi, Thomas Stockhammer, Nils Günther Peters
-
Patent number: 11395083Abstract: In general, techniques are described by which to support scalable unified audio rendering. A device comprising an audio decoder, a memory, and a processor may be configured to perform various aspects of the techniques. The audio decoder may decode, from a bitstream, first audio data and second audio data. The memory may store the first audio data and the second audio data. The processor may render the first audio data into first spatial domain audio data for playback by virtual speakers at a set of virtual speaker locations, and render the second audio data into second spatial domain audio data for playback by the virtual speakers at the set of virtual speaker locations. The processor may also mix the first spatial domain audio data and the second spatial domain audio data to obtain mixed spatial domain audio data, and convert the mixed spatial domain audio data to scene-based audio data.Type: GrantFiled: January 31, 2019Date of Patent: July 19, 2022Assignee: QUALCOMM IncorporatedInventors: Andre Gustavo P. Schevciw, Nils Günther Peters
-
CORRELATION-BASED RENDERING WITH MULTIPLE DISTRIBUTED STREAMS FOR SIX DEGREE OF FREEDOM APPLICATIONS
Publication number: 20220201418Abstract: An example device includes a memory configured to store audio data and location data associated with a plurality of audio streams and one or more processors coupled to the memory. The one or more processors are configured to obtain a first location of a first audio stream that includes an audio source and obtain a second location of a second audio stream that includes the audio source. The one or more processors are configured to generate direction vectors originating at the first location and the second location, based on a location of the audio source and the first location, and the location of the audio source and the second location, respectively. The one or more processors are also configured to determine parameters that describe a vector field based on the first direction vector and the second direction vector.Type: ApplicationFiled: December 18, 2020Publication date: June 23, 2022Inventors: S M Akramus Salehin, Nils Günther Peters, Siddhartha Goutham Swaminathan, Isaac Garcia Munoz -
Publication number: 20220201419Abstract: An example device for processing one or more audio streams includes a memory configured to store the one or more audio streams and one or more processors implemented in circuitry coupled to the memory. The one or more processors are configured to determine a listener position. The one or more processors are also configured to determine one or more clusters of the one or more audio streams. The one or more processors are also configured to determine a rendering mode based on the listener position and the one or more clusters. The device also includes a renderer configured to render at least one of the one or more clusters of audio streams based on the rendering mode.Type: ApplicationFiled: December 18, 2020Publication date: June 23, 2022Inventors: Siddhartha Goutham Swaminathan, S M Akramus Salehin, Nils Günther Peters, Isaac Garcia Munoz
-
Patent number: 11361776Abstract: In general, techniques are described by which to code scaled spatial components. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store a bitstream including an encoded foreground audio signal and a corresponding quantized spatial component. The one or more processors may perform psychoacoustic audio decoding with respect to the encoded foreground audio signal to obtain a foreground audio signal, and determine, when performing psychoacoustic audio decoding, a bit allocation for the encoded foreground audio signal. The one or more processors may dequantize the quantized spatial component to obtain a scaled spatial component, and descale, based on the bit allocation, the scaled spatial component to obtain a spatial component. The one or more processors may reconstruct, based on the foreground audio signal and the spatial component, scene-based audio data.Type: GrantFiled: June 22, 2020Date of Patent: June 14, 2022Assignee: Qualcomm IncorporatedInventors: Ferdinando Olivieri, Taher Shahbazi Mirzahasanloo, Nils Günther Peters
-
Patent number: 11356793Abstract: A device may be configured to process one or more audio streams in accordance with the techniques described herein. The device may comprise: one or more processors and a memory. The one or more processors may be configured to obtain an indication of a boundary separating an interior area from an exterior area, and obtain a listener location indicative of a location of the device relative to the interior area. The one or more processors may be configured to obtain, based on the boundary and the listener location, a current renderer as either an interior renderer configured to render audio data for the interior area or an exterior renderer configured to render the audio data for the exterior area, and apply, to the audio data, the current renderer to obtain one or more speaker feeds. The memory may be configured to store the one or more speaker feeds.Type: GrantFiled: September 30, 2020Date of Patent: June 7, 2022Assignee: Qualcomm IncorporatedInventors: S M Akramus Salehin, Nils Günther Peters, Siddhartha Goutham Swaminathan, Isaac Garcia Munoz
-
Patent number: 11356796Abstract: An example device configured to obtain image data includes a memory configured to store one or more priority values, each of the one or more priority values being associated with a type of image object associated with the image data. The device includes one or more processors coupled to the memory, and configured to associate image objects in the image data with one or more audio sources represented in one or more audio streams. The one or more processors are also configured to assign a respective priority value to each of the one or more audio sources represented in the one or more streams and code ambisonic coefficients based on the assigned priority value.Type: GrantFiled: November 18, 2020Date of Patent: June 7, 2022Assignee: Qualcomm IncorporatedInventors: Ferdinando Olivieri, Taher Shahbazi Mirzahasanloo, Nils Günther Peters
-
Patent number: 11354085Abstract: Example devices and methods are disclosed. An example device includes a memory configured to store a plurality of audio streams and an associated level of authorization for each of the plurality of audio streams. The device also includes one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to select, based on the associated levels of authorization, a subset of the plurality of audio streams, the subset of the plurality of audio streams excluding at least one of the plurality of audio streams.Type: GrantFiled: July 1, 2020Date of Patent: June 7, 2022Assignee: Qualcomm IncorporatedInventors: Siddhartha Goutham Swaminathan, Isaac Garcia Munoz, S M Akramus Salehin, Nils Günther Peters
-
Patent number: 11317236Abstract: An example device includes a memory configured to store at least one spatial component and at least one audio source within a plurality of audio streams. The device also includes one or more processors coupled to the memory. The one or more processors are configured to receive, from motion sensors, rotation information. The one or more processors are configured to rotate the at least one spatial component based on the rotation information to form at least one rotated spatial component. The one or more processors are also configured to reconstruct ambisonic signals from the at least one rotated spatial component and the at least one audio source, wherein the at least one spatial component describes spatial characteristics associated with the at least one audio source in a spherical harmonic domain representation.Type: GrantFiled: November 18, 2020Date of Patent: April 26, 2022Assignee: Qualcomm IncorporatedInventors: Ferdinando Olivieri, Taher Shahbazi Mirzahasanloo, Nils Günther Peters
-
Patent number: 11270711Abstract: In general, techniques are described by which to provide priority information for higher order ambisonic (HOA) audio data. A device comprising a memory and a processor may perform the techniques. The memory stores HOA coefficients of the HOA audio data, the HOA coefficients representative of a soundfield. The processor may decompose the HOA coefficients into a sound component and a corresponding spatial component, the corresponding spatial component defining shape, width, and directions of the sound component, and the corresponding spatial component defined in a spherical harmonic domain. The processor may also determine, based on one or more of the sound component and the corresponding spatial component, priority information indicative of a priority of the sound component relative to other sound components of the soundfield, and specify, in a data object representative of a compressed version of the HOA audio data, the sound component and the priority information.Type: GrantFiled: May 6, 2020Date of Patent: March 8, 2022Assignee: Qualcomm IncorproatedInventors: Moo Young Kim, Nils Günther Peters, Shankar Thagadur Shivappa, Dipanjan Sen
-
Patent number: 11240623Abstract: One or more processors may obtain a first distance between a first audio zone of the two or more audio zones associated with the one or more interest points within the first audio zone, and a first device position of a device, obtain a second distance between a second audio zone of the two or more audio zones associated with the one or more interest points within the second audio zone, and the first device position of the device, and obtain an updated first distance and updated second distance after movement of the device has changed from the first device position to a second device position. The one or more processor(s) may independently control the first audio zone and the second audio zone, such that the audio data within the first audio zone and the second audio zone are adjusted based on the updated first distance and updated second distance.Type: GrantFiled: August 8, 2018Date of Patent: February 1, 2022Assignee: Qualcomm IncorporatedInventors: Nils Gunther Peters, S M Akramus Salehin, Shankar Thagadur Shivappa, Moo Young Kim, Dipanjan Sen
-
Publication number: 20220028401Abstract: A device configured to decode a bitstream, where the device includes a memory configured to store a temporally encoded representation of spatial audio signals. The device is also configured to receive the bitstream that includes an indication of a spatial transformation, and includes a temporal decoding unit, coupled to the memory, configured to decode one or more spatial audio signals represented in a spatial domain, where the one or more spatial audio signals are associated with different angles in the spatial domain. In addition, the device includes an inverse spatial transformation unit, coupled to the temporal decoding unit, is configured to convert the one or more spatial audio signals represented in the spatial domain into at least three ambisonic coefficients that, in part, represent a soundfield in an ambisonics domain, and perform a spatial transformation of the soundfield based on the indication of the spatial transformation received in the bitstream.Type: ApplicationFiled: October 4, 2021Publication date: January 27, 2022Inventors: Nils Gunther Peters, Moo Young Kim, Dipanjan Sen