Optimization Patents (Class 381/303)
  • Patent number: 12245018
    Abstract: A method processes binaural sound to externally localize to a first user at a first location. This location is shared such that an electronic device processes the binaural sound to externally localize to a second user at a second location. The first and second locations occur at a same or similar location such that the first and second users hear the binaural sound as originating from the same or similar location.
    Type: Grant
    Filed: January 5, 2024
    Date of Patent: March 4, 2025
    Inventor: Philip Scott Lyren
  • Patent number: 12238505
    Abstract: An audio system is proposed, dynamically playing optimized audio signals based on user position. A sensor circuits dynamically senses a target space to generate field context information. First speaker and second speaker are arranged for audio playback. A host device recognizes a user from the field context information, determines the user position corresponding to the target space, and adaptively assigns the user position as a target listening spot. A sensor circuit contains a camera capturing an ambient image out of the target space. A recognizer circuit analyzes the ambient image to obtain from the target space, the location, size and acoustic attribute information of an ambient object, allowing the control circuit to accordingly perform an object-based compensation operation on the target listening spot to generate optimized first channel audio signal and second channel audio signal.
    Type: Grant
    Filed: November 23, 2022
    Date of Patent: February 25, 2025
    Assignee: REALTEK SEMICONDUCTOR CORP.
    Inventor: Kai-Hsiang Chou
  • Patent number: 12228686
    Abstract: A computer-implemented method including: triggering, with at least one processor, an acoustic wave generator to generate a predefined acoustic wave directed toward a 3-dimensional (3D) layout associated with an entity from plurality of entities, wherein each of the plurality of entities is registered with a corresponding 3D layout embedded with a predefined number of 3D geometric figures; in response to receiving a modified acoustic wave from the 3D layout, comparing, with at least one processor, the modified acoustic wave with a plurality of calibrated acoustic waves associated with the plurality of entities to determine identification details comprising a match between the modified acoustic wave and a calibrated acoustic wave from the plurality of calibrated acoustic waves; and based on the identification details, identifying, with at least one processor, the entity related to the calibrated acoustic wave. A system and medium are also disclosed.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: February 18, 2025
    Assignee: Visa International Service Association
    Inventor: Ved Prakash Sajjan K Agarwal
  • Patent number: 12207075
    Abstract: A real-time communication software application for generating spatial audio with uniform reverberation in a real-time communication session is performed by an electronic communication device. The application is adapted to remove the reverberation of recorded speech signals from far-end participants by the dereverberation approach, render the direct sound parts by filtering the output signals by head-related transfer functions of desired directions, generate reverberant sound parts by convolving the output signals from with uniform room impulse responses or an artificial reverberator, and combine direct and reverberant sound components to generate spatialized speech signals. When speakers and listeners are located in two virtual conference rooms, the reverberation of the two rooms are coupled. The reverberant sound parts are then generated by convolving the output signals and coupled RIRs from the two rooms.
    Type: Grant
    Filed: March 1, 2024
    Date of Patent: January 21, 2025
    Assignee: Agora Lab, Inc.
    Inventors: Song Li, Jianyuan Feng, Bo Wu, Jimeng Zheng
  • Patent number: 12207066
    Abstract: The present disclosure provides a display device, a sound-emitting control method, and a sound-emitting control device. The device includes: a display screen which includes a first display region, a middle display region, and a second display region; a plurality of sound-emitting units, which include: a plurality of first sound-emitting units, a plurality of second sound-emitting units and a plurality of third sound-emitting units; the plurality of first sound-emitting units and the plurality of second sound-emitting units respectively include a sound-emitting unit which emits sounds at a first frequency band, a sound-emitting unit which emits sounds at a second frequency band, and a sound-emitting unit which emits sounds at a third frequency band; the first, second, and third frequency bands increase in turn; and all of the plurality of third sound-emitting units are the sound-emitting units emitting sound in the second frequency band.
    Type: Grant
    Filed: May 19, 2021
    Date of Patent: January 21, 2025
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Minglei Chu, Yanhui Xi, Xiaomang Zhang, Xiangjun Peng, Wenchao Han, Lianghao Zhang, Wei Sun, Rui Liu, Xin Duan, Tiankuo Shi
  • Patent number: 12192736
    Abstract: An information processing method receives settings of a plurality of pieces of information on a plurality of physical spaces that respectively correspond to a plurality of pieces of information on a plurality of logical spaces, receives a first group of a plurality of pieces of first acoustic image localization information that indicates a position of an acoustic image to be localized in each of the plurality of logical spaces using first coordinates in the plurality of logical spaces, receives a change in one piece of first acoustic image localization information, among the first group of the plurality of pieces of first acoustic image localization information, changes other pieces of first acoustic image localization information, among the first group of the plurality of pieces of first acoustic image localization, in response to the received change in the one piece of first acoustic image localization information, and transforms the first group of the plurality of pieces of first acoustic image localizatio
    Type: Grant
    Filed: September 9, 2022
    Date of Patent: January 7, 2025
    Assignee: YAMAHA CORPORATION
    Inventor: Tadashi Morikawa
  • Patent number: 12192716
    Abstract: A method and an associated device for the combined conversion of multiple characteristics of an audio signal are disclosed. The changes allow the signal to be typed on the basis of a profile selected by a control unit. The method and the device are particularly intended for the field of loudspeakers.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: January 7, 2025
    Assignee: INNOVATION ELECTRO ACOUSTIQUE
    Inventors: Jefferson Williams Torno, Julien Pierre Michel Santini
  • Patent number: 12185086
    Abstract: Examples of wearable devices that can present to a user of the display device an audible or visual representation of an audio file comprising a plurality of stem tracks that represent different audio content of the audio file are described. Systems and methods are described that determine the pose of the user; generate, based on the pose of the user, an audio mix of at least one of the plurality of stem tracks of the audio file; generate, based on the pose of the user and the audio mix, a visualization of the audio mix; communicate an audio signal representative of the audio mix to the speaker; and communicate a visual signal representative of the visualization of the audio mix to the display.
    Type: Grant
    Filed: August 8, 2023
    Date of Patent: December 31, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Stephen Vincent Mangiat, Michael Benson Tucker, Anastasia Andreyevna Tajik
  • Patent number: 12183316
    Abstract: A method is provided, including: executing an interactive application, wherein executing the interactive application includes rendering video and audio of a virtual environment, the video being presented on a display viewed by a user, and the audio being presented through headphones worn by the user, and wherein executing the interactive application is responsive to user input generated from interactivity by the user with the presented video and audio; receiving environmental input from at least one sensor that senses a local environment in which the user is disposed; analyzing the environmental input to identify activity occurring in the local environment; responsive to identifying the activity, then adjusting a level of active noise cancellation applied by the headphones.
    Type: Grant
    Filed: May 28, 2022
    Date of Patent: December 31, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Celeste Bean, Tatianna Manzon-Gutzman, Sarah Karp
  • Patent number: 12177648
    Abstract: Sound objects are identified within a content item, and location metadata is extracted from the content item for each sound object. A reference layout is generated, relative to a user position, for the sound objects based on the location metadata. A user's gaze is then determined using pupil tracking, body movement data, head orientation data, or other techniques. Using the reference layout, a sound object along a path defined by the gaze of the user is identified, and audio of the identified object is enhanced.
    Type: Grant
    Filed: June 24, 2022
    Date of Patent: December 24, 2024
    Assignee: Adeia Guides Inc.
    Inventor: Warren Keith Edwards
  • Patent number: 12177646
    Abstract: An audio bitstream is decoded into audio objects and audio metadata for the audio objects. The audio objects include a specific audio object. The audio metadata specifies frame-level gains that include a first gain and a second gain respectively for a first audio frame and a second audio frame. It is determined, based on the first and second gains, whether sub-frame gains are to be generated for the specific audio object. If so, a ramp length is determined for a ramp used to generate the sub-frame gains for the specific audio object. The ramp of the ramp length is used to generate the sub-frame gains for the specific audio object. A sound field represented by the audio objects with the sub-frame gains is rendered by audio speakers.
    Type: Grant
    Filed: May 20, 2021
    Date of Patent: December 24, 2024
    Assignee: DOLBY INTERNATIONAL AB
    Inventors: Jens Popp, Claus-Christian Spenger, Celine Merpillat, Tobias Mueller, Holger Hoerich
  • Patent number: 12170883
    Abstract: Spatial audio is rendered at a companion device or server connected to a wearable device, where the spatial audio is rendered based on a first pose estimate of the wearable device that is estimated at the companion device or server. The rendered spatial audio is then transmitted to the wearable device. The rendered spatial audio is refined at the wearable device based on a second pose estimate of the wearable device that is estimated at the wearable device. The refined spatial audio is then provided for playback via speakers of the wearable device.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: December 17, 2024
    Assignee: GOOGLE LLC
    Inventors: Mugur Marculescu, John D. Muir, Pierric Gimmig
  • Patent number: 12156002
    Abstract: A self-diagnosis method performed in audio playback equipment including an audio playback unit having at least one loudspeaker and an audio capture unit having at least one microphone includes the steps of acquiring or producing emission audio test signals and outputting them via the loudspeaker(s), thereby producing sound test signals; acquiring reception audio test signals produced by the microphone(s) as a result of the microphones receiving the sound test signals; and analyzing the reception audio test signals in order to establish a first diagnosis of the audio playback unit and a second diagnosis of the audio capture unit.
    Type: Grant
    Filed: April 7, 2022
    Date of Patent: November 26, 2024
    Assignee: SAGEMCOM BROADBAND SAS
    Inventors: Stéphane Delplace, Gilles Bourgoin, Jérôme Berger
  • Patent number: 12137322
    Abstract: An audio device is disclosed, the audio device comprising an interface, memory, and a processor, wherein the processor is configured according to any of the following: obtain a first microphone input signal and a second microphone input signal; process the first microphone input signal and the second microphone input signal for provision of an output audio signal; and output the output audio signal. Processing of the input signals includes determine a first set of covariance parameters and a second set of covariance parameters; determine a first beamforming; apply the first beamforming to the first microphone input signal and the second microphone input signal; determine a second beamforming; apply the second beamforming to the first microphone input signal and the second microphone input signal; and provide the output audio signal based on first beamforming output signal and/or second beamforming output signal.
    Type: Grant
    Filed: September 28, 2022
    Date of Patent: November 5, 2024
    Assignee: GN AUDIO A/S
    Inventors: Bolaji James Adesokan, Allan Mejlgren Von Bülow
  • Patent number: 12137336
    Abstract: Aspects of the disclosure provide methods and apparatuses for audio processing. In some examples, an apparatus for media processing includes processing circuitry. The processing circuitry receives first six degrees of freedom (6 DoF) information associated with a media content for a scene in a media application. The first 6 DoF information includes a first spatial location and a first rotation orientation for rotation about a center at the first spatial location. The processing circuitry determines that a rendering platform for rendering the media content is a three degrees of freedom (3 DoF) platform; and calculates, a revolution orientation of the media content on a sphere centered other than the first spatial location, according to at least the first spatial location. The revolution orientation is 3 DoF information associated with the media content for rendering on the 3 DoF platform.
    Type: Grant
    Filed: August 22, 2022
    Date of Patent: November 5, 2024
    Assignee: Tencent America LLC
    Inventors: Jun Tian, Xiaozhong Xu, Shan Liu
  • Patent number: 12131097
    Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.
    Type: Grant
    Filed: April 13, 2023
    Date of Patent: October 29, 2024
    Assignee: Apple Inc.
    Inventors: Stuart John Wood, Martin E. Johnson, Darius A. Satongar
  • Patent number: 12133062
    Abstract: A method and apparatus for rendering an object-based audio signal considering an obstacle are disclosed. A method for rendering an object-based audio signal according to an example embodiment, the method includes identifying an object-based input signal and metadata for the input signal, generating a binaural filter based on the metadata using a binaural room impulse response (BRIR), determining, based on the metadata, whether an obstacle is present between a listener and an object, modifying the generated binaural filter when it is determined that the obstacle is present, and generating a rendered output signal by convolving the modified binaural filter and the input signal.
    Type: Grant
    Filed: April 4, 2022
    Date of Patent: October 29, 2024
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Yong Ju Lee, Jae-Hyoun Yoo, Dae Young Jang, Kyeongok Kang, Tae Jin Lee
  • Patent number: 12126988
    Abstract: An apparatus includes at least one memory, instructions, and processor circuitry to execute the instructions to track movement of a head of a user wearing earphones, the earphones to move with the movement of the head of the user, the earphones to be communicatively coupled to a computing device. The processor circuitry is to obtain media content, the media content including first audio data for a first channel and second audio data for a second channel. The processor circuitry is to adjust, based on the movement of the head of the user, the first audio data for the first channel and the second audio data for the second channel. The processor circuitry is to cause the adjusted first audio data and the adjusted second audio data to be played by the earphones.
    Type: Grant
    Filed: August 14, 2023
    Date of Patent: October 22, 2024
    Assignee: Intel Corporation
    Inventors: Nikos Kaburlasos, Scott W. Cheng, Devon Worrell
  • Patent number: 12120497
    Abstract: A device includes one or more processors configured to receive, via wireless transmission from a playback device, data associated with a pose of the playback device. The one or more processors are also configured to select, based on the data, a particular representation of a sound field from a plurality of representations of the sound field. Each respective representation of the sound field corresponds to a different sector of a set of sectors. A sector represents a range of values associated with movement of the playback device. The one or more processors are further configured to generate audio data corresponding to the selected representation of the sound field. one or more processors are also configured to send, via wireless transmission, the audio data as streaming data to the playback device.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: October 15, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Andre Schevciw, Nils Gunther Peters, Isaac Garcia Munoz, Vinay Melkote Krishnaprasad
  • Patent number: 12114148
    Abstract: There is disclosed inter alia a method for rendering a virtual reality audio scene comprising: receiving information defining a limited area audio scene within the virtual reality audio scene (301), wherein the limited area audio scene defines a sub space of the virtual reality audio scene (304), wherein the information defines the limited area audio scene by defining an extent a user can move within the virtual audio scene; determining if the movement of the user within the limited area audio scene meets a condition of an audio scene change (302); and processing the audio scene change when the movement of the user within the limited area audio scene meets the condition of an audio scene change (306).
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: October 8, 2024
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Sujeet Shyamsundar Mate, Kari Järvinen, Jussi Leppänen, Lasse Laaksonen
  • Patent number: 12112521
    Abstract: A method comprises: receiving an image of a real-world environment; using a machine learning classifier, classifying the image to produce classifications associated with acoustic presets for an acoustic environment simulation, the acoustic presets each including acoustic parameters that represent sound reverberation; and selecting an acoustic preset among the acoustic presets based on the classifications.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: October 8, 2024
    Assignee: DTS Inc.
    Inventors: Martin Walsh, Aoife McDonagh, Michael M. Goodwin, Edward Stein, Peter Corcoran
  • Patent number: 12096203
    Abstract: An audio system is proposed, dynamically playing optimized audio signals based on user position. A sensor circuits dynamically senses a target space to generate field context information. First speaker and second speaker are arranged for audio playback. A host device recognizes a user from the field context information, determines the user position corresponding to the target space, and adaptively assigns the user position as a target listening spot. A sensor circuit contains a camera capturing an ambient image out of the target space. A control circuit utilizes a user interface circuit to perform a configuration procedure which determines location, size and acoustic attribute information of an ambient object, allowing the control circuit to accordingly perform an object-based compensation operation on the target listening spot to generate optimized first channel audio signal and second channel audio signal.
    Type: Grant
    Filed: November 23, 2022
    Date of Patent: September 17, 2024
    Assignee: Realtek Semiconductor Corp.
    Inventor: Kai-Hsiang Chou
  • Patent number: 12061586
    Abstract: A system for clustering data into corresponding files comprises one or more processors and a memory. The one or more processors is/are configured to: 1) determine to cluster a set of data into a set of files; 2) determine a set of split points in a corresponding set of dimensions of the set of data to determine the set of files, wherein each file of the set of files has an approximate target size; and 3) store one or more items of the set of data into a corresponding file of the set of files based at least in part on the set of split points. The memory is coupled to the one or more processors and configured to provide the processor with instructions.
    Type: Grant
    Filed: May 6, 2022
    Date of Patent: August 13, 2024
    Assignee: Databricks, Inc.
    Inventors: Bart Samwel, Prakhar Jain
  • Patent number: 12052559
    Abstract: A situation awareness system is provided and includes sensors configured to sense an object and generate signals of the sensed object. An identification and classification module is in communication with the sensors. The identification and classification module is configured to identify the sensed object and determine the position, speed and direction of each sensed object. A sound synthesis module is in communication with the identification and classification module. The sound synthesis module is configured to create sounds for the sensed object and further configured to create a binaural virtual acoustic model for the sensed object. The binaural virtual acoustic model is used to position the sensed object in virtual space at a location corresponding to its location in real space. One or more beam forming arrays is in communication with the sound synthesis module and configured to delivery sound. The delivered sound increases the situational awareness of a vehicle operator.
    Type: Grant
    Filed: November 20, 2019
    Date of Patent: July 30, 2024
    Assignee: Google LLC
    Inventors: Perry Teevens, Robert J. E. Dalton, Jr., David E. Romblom, Peter G. Otto, Elliot M. Patros
  • Patent number: 12052113
    Abstract: An information processing apparatus for causing a rhythm providing device to provide a rhythm to be shared among a plurality of participants participating in an online communication includes circuitry. The circuitry obtains first setting information and second setting information respectively set by a first participant and a second participant of the plurality of participants with respect to a level of intensity of the rhythm to be provided to the second participant. The circuitry adjusts the level of intensity of the rhythm to be provided to the second participant based on the first setting information and the second setting information, and generates intensity information related to the adjusted level of intensity of the rhythm.
    Type: Grant
    Filed: May 22, 2023
    Date of Patent: July 30, 2024
    Assignee: Ricoh Company, Ltd.
    Inventors: Yuuta Yoshino, Soh Okumura
  • Patent number: 12020680
    Abstract: Provided is a sound image localization device capable of flexibly controlling directivity with a short calculation time. A sound image localization device that reflects, on a reflector 50, a sound signal radiated from a speaker array 40 arranged with a plurality of speakers SP1 to SPQ on a straight line to localize a sound image includes an expansion coefficient calculation unit 10 configured to analytically calculate expansion coefficients by performing a spherical harmonic function expansion on a window function representing desired directivity, a filter coefficient generation unit 20 configured to convert the expansion coefficients into filter coefficients corresponding to each of the speakers SP1 to SPQ, and a speaker drive unit 30 configured to generate a speaker drive signal for driving each of the speakers SP1 to SPQ by convolving the filter coefficients in a voice signal.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: June 25, 2024
    Assignee: Nippon Telegraph and Telephone Corporation
    Inventors: Kenta Imaizumi, Kimitaka Tsutsumi, Atsushi Nakadaira
  • Patent number: 12014744
    Abstract: The present invention relates to a method and an apparatus for binaural rendering an audio signal using variable order filtering in frequency domain. To this end, provided are a method for processing an audio signal including: receiving an input audio signal; receiving a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing FFT by a predetermined block size; generating at least one subframe for each subband; generating at least one filtered subframe for each subband; performing inverse FFT on the filtered subframe for each subband; and generating a filtered subband signal by overlap-adding the transformed subframe for each subband and an apparatus for processing an audio signal using the same.
    Type: Grant
    Filed: November 2, 2021
    Date of Patent: June 18, 2024
    Assignees: INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY, WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC., ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Taegyu Lee, Hyunoh Oh, Youngcheol Park, Daehee Youn, Jeongil Seo, Yongju Lee, Seungkwon Beack, Kyeongok Kang, Daeyoung Jang
  • Patent number: 12015907
    Abstract: A transmission apparatus includes a first transmission unit that transmits sound data to a first sound channel in a transmission path, and a second transmission unit that transmits meta data related to the sound data to a second sound channel in the transmission path while ensuring synchronization with the sound data.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: June 18, 2024
    Assignee: Sony Group Corporation
    Inventor: Takeshi Yamaguchi
  • Patent number: 12003952
    Abstract: A method improves performance of a computer that provides binaural sound to a listener. A memory stores coordinate locations that follow a path of how the head of the listener moves. This path is retrieved in anticipation of subsequent head movements of the listener to improve computer performance of executing binaural sound.
    Type: Grant
    Filed: April 11, 2023
    Date of Patent: June 4, 2024
    Inventors: Philip Scott Lyren, Glen A. Norris
  • Patent number: 11997463
    Abstract: A method performed by a programmed processor, the method including receiving an input noise signal, generating, using a machine learning model that has an input based on the input noise signal, a mono audio signal that includes a sound and a spatial parameter for the mono audio signal, and generating spatial audio data by spatially encoding the mono audio signal according to the spatial parameter.
    Type: Grant
    Filed: May 5, 2022
    Date of Patent: May 28, 2024
    Assignee: Apple Inc.
    Inventors: Jonathan D. Sheaffer, Yelena V. Menyaylenko
  • Patent number: 11997456
    Abstract: Spatial audio signals can include audio objects that can be respectively encoded and rendered at each of multiple different depths. In an example, a method for encoding a spatial audio signal can include receiving audio scene information from an audio capture source in an environment, and receiving a depth characteristic of a first object in the environment. The depth characteristic can be determined using information from a depth sensor. A correlation can be identified between at least a portion of the audio scene information and the first object. The spatial audio signal can be encoded using the portion of the audio scene and the depth characteristic of the first object.
    Type: Grant
    Filed: October 10, 2019
    Date of Patent: May 28, 2024
    Assignee: DTS, Inc.
    Inventor: Edward Stein
  • Patent number: 11997473
    Abstract: System and method for projecting audio signals to an operator of a teleoperational surgical system to convey spatial orientation associated with the audio signals to the operator. Characteristics of the audio signals such as direction and volume may be selected to give the impression that the remote operator is positioned locally next to the patient. Characteristics of the audio signals may also be modified to provide spatial translations between actual locations of audio sources within a physical audio environment and simulations locations of the audio sources with a virtual audio environment.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: May 28, 2024
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventor: Mahdi Azizian
  • Patent number: 11997470
    Abstract: A method for processing a sound effect is provided. The method includes obtaining relative orientation information of a first electronic device worn by a first user relative to at least one sound source object in a preset virtual environment, obtaining a processed sound source signal by performing sound effect processing on a sound source signal of the at least one sound source object based on the relative orientation information, and providing the processed sound source signal to the first user through the first electronic device.
    Type: Grant
    Filed: September 7, 2021
    Date of Patent: May 28, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Junyan Bao, Weiyi Gu
  • Patent number: 11979739
    Abstract: A sound controlling system including a user terminal having a sound source, a wireless communication device, a digital to analog converter (DAC) and first processing electronics. The first processing electronics are configured to: provide data of a backing sound to the sound source; control the sound source to generate a sound signal based on the data; receive a first input instruction including a first instruction to transmit the sound signal and a second instruction to play back the backing sound; provide the sound signal to the wireless communication device as the first input instruction being the first instruction, and provide the sound signal to the DAC as being the second instruction; control the wireless communication device to convert the sound signal to a wireless signal and transmit the wireless signal; and convert the sound signal from a digital signal to an analog signal for play back of the backing sound.
    Type: Grant
    Filed: March 29, 2023
    Date of Patent: May 7, 2024
    Assignee: Roland Corporation
    Inventor: Masato Ueno
  • Patent number: 11979732
    Abstract: An apparatus, method and computer program is described comprising capturing spatial audio data during an image capturing process, determining an orientation of an image capturing device during the spatial audio data capture, generating an audio focus signal from said captured spatial audio data (wherein said audio focus signal is focused in an image capturing direction of said image capturing device), generating modified spatial audio data (e.g. by modifying the captured spatial audio data to compensate for changes in orientation during the spatial audio data capture), and generating an audio output signal from a combination of the audio focus signal and the modified spatial audio data.
    Type: Grant
    Filed: April 20, 2020
    Date of Patent: May 7, 2024
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Jussi Artturi Leppänen, Antti Johannes Eronen, Arto Juhani Lehtiniemi, Miikka Tapani Vilermo
  • Patent number: 11979737
    Abstract: A display device and an operation method of the display device are provided in the present disclosure. The display device includes a display screen a sound-generation driving module, and further includes an acoustic scanning module, arranged on a non-display side of the display screen and configured to determine a spatial contour of a space where the display device is located through acoustic scanning; a viewer position detection module, configured to detect viewer coordinates in the space where the display device is located; and a control module, configured to control the sound-generation driving module to generate sound in accordance with the spatial contour and the viewer coordinates.
    Type: Grant
    Filed: April 15, 2021
    Date of Patent: May 7, 2024
    Assignee: BOE Technology Group Co., Ltd.
    Inventors: Yue Gou, Yingming Liu, Yaqian Ji, Xiufeng Li, Yanling Han, Chenyang Zhang, Peixiao Li, Yuzhen Guo, Wenchao Han, Lianghao Zhang
  • Patent number: 11956623
    Abstract: Processing sound in an enhanced reality environment can include generating, based on an image of a physical environment, an acoustic model of the physical environment. Audio signals captured by a microphone array, can capture a sound in the physical environment. Based on these audio signals, one or more measured acoustic parameters of the physical environment can be generated. A target audio signal can be processed using the model of the physical environment and the measured acoustic parameters, resulting in a plurality of output audio channels having a virtual sound source with a virtual location. The output audio channels can be used to drive a plurality of speakers. Other aspects are also described and claimed.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: April 9, 2024
    Assignee: Apple Inc.
    Inventors: Christopher T. Eubank, Joshua D. Atkins, Soenke Pelzer, Dirk Schroeder
  • Patent number: 11942096
    Abstract: Provided are a computer system for transmitting audio content to realize a user-customized being-there and a method thereof. The computer system may be configured to detect audio files that are generated for a plurality of objects at a venue, respectively, and metadata including spatial features that are set for the objects at the venue, respectively, and to transmit the audio files and the metadata for a user. An electronic device of the user may realize a being-there at the venue by rendering the audio files based on the spatial features in the metadata. That is, the user may feel a user-customized being-there as if the user directly listens to audio signals generated from corresponding objects at a venue in which the objects are provided.
    Type: Grant
    Filed: November 24, 2021
    Date of Patent: March 26, 2024
    Assignee: NAVER CORPORATION
    Inventors: Dae Hwang Kim, Jung Sik Kim, Dong Hwan Kim, Ted Lee, Jaegyu Noh, Jeonghun Seo
  • Patent number: 11937070
    Abstract: Aspects of the disclosure provide methods and apparatuses for audio processing. In some examples, an apparatus for media processing includes processing circuitry. The processing circuitry receive audio inputs associated with a layered description for a space of interest in an audio scene. The space of interest includes a plurality of subspaces. The layered description includes a first layer and a second layer. The first layer has a common node with a first value that is a common attribute value of two or more subspaces in the plurality of subspaces. The second layer has individual nodes respectively associated with each of the plurality of subspaces. The processing circuitry determines the plurality of subspaces of the space of interest based on the layered description, and renders an audio output based on the audio inputs in response to a location of a subject of the audio scene being in the space of interest.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: March 19, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Jun Tian, Xiaozhong Xu, Shan Liu
  • Patent number: 11937073
    Abstract: A system and method includes generating a virtual n-dimensional space that includes one or more positions of one or more source nodes and a position of a receiver node; executing a plurality of simulations including simulating acoustic signals emanating from the one or more source nodes within the virtual n-dimensional room; estimating a measure of the acoustic signals received at the receiver node; computing a plurality of acoustic signal data samples based on the estimation for each of the plurality of simulations; and creating a training data corpus for training an artificial neural network, the training data corpus including at least a sampling of the plurality of acoustic data samples, and the artificial neural network, once trained, is configured to generate an inference indicating a likely intended sound to a target receiver of a mixture of acoustic signals.
    Type: Grant
    Filed: November 1, 2023
    Date of Patent: March 19, 2024
    Assignee: AudioFocus, Inc
    Inventor: Shariq Mobin
  • Patent number: 11930348
    Abstract: A method by a computer system including generating audio files based on respective audio signals, the audio signals having been respectively generated from a plurality of objects at a venue, generating metadata including spatial features at the venue that are respectively set for the objects, and transmitting the audio files and the metadata for the objects to a first electronic device to cause the first electronic device to realize a being-there at the venue by rendering the audio files based on the spatial features in the metadata may be provided.
    Type: Grant
    Filed: November 24, 2021
    Date of Patent: March 12, 2024
    Assignees: NAVER CORPORATION, GAUDIO LAB, INC.
    Inventors: Dae Hwang Kim, Jung Sik Kim, Dong Hwan Kim, Ted Lee, Jeonghun Seo, Hyeonsu Seo
  • Patent number: 11914146
    Abstract: Methods and systems are provided for integrating media cues into virtual reality scenes presented on a head mounted display (HMD) is disclosed. The method includes presenting a virtual reality scene on a display of an HMD. The method further includes receiving sensor data from one or more sensors in a real-world space in which the HMD is located. Then, identifying an object location of an object in the real-world space that produces a sound. The method includes generating a media cue in the virtual reality scene presented in the HMD. The media cue is presented in a virtual location that is correlated to the object location of the object in the real-world space.
    Type: Grant
    Filed: May 27, 2022
    Date of Patent: February 27, 2024
    Assignees: Sony Interactive Entertainment LLC, Sony Interactive Entertainment Inc.
    Inventors: Victoria Dorn, Celeste Bean, Tatianna Manzon-Gutzman, Sarah Karp
  • Patent number: 11910170
    Abstract: A microphone device comprising, for example, a mid microphone cartridge and two side microphone cartridges. The mid microphone cartridge may be, for example, a cardioid microphone cartridge, and the side microphone cartridges may each be, for example, a bidirectional microphone cartridge. Each of the mid microphone cartridge and of the two side microphone cartridges may be orthogonal to the other two microphone cartridges. The microphone device, which may be referred to herein as a mid dual-side microphone, may provide a combined pickup pattern, such as a beam and/or a toroid, that may be steerable.
    Type: Grant
    Filed: February 18, 2022
    Date of Patent: February 20, 2024
    Assignee: Shure Acquisition Holdings, Inc.
    Inventor: Brent Robert Shumard
  • Patent number: 11900913
    Abstract: A sound signal processing method includes: obtaining a plurality of sound signals respectively collected by a plurality of microphones arranged in a space; adjusting respective levels of the plurality of sound signals in accordance with respective positions of the plurality of microphones; mixing the plurality of sound signals having the adjusted respective levels to thereby obtain a mixed signal; and generating a reflected sound by using the obtained mixed signal.
    Type: Grant
    Filed: September 16, 2022
    Date of Patent: February 13, 2024
    Assignee: YAMAHA CORPORATION
    Inventors: Takayuki Watanabe, Dai Hashimoto
  • Patent number: 11895468
    Abstract: In at least one embodiment, a system for synchronizing an audio stream is provided. The system includes a first loudspeaker and an audio controller. The first loudspeaker plays back a first audio output signal including first signature information. The audio controller provides a first audio input signal and superimpose the first signature information on the first audio input signal. The audio controller receives the first audio output signal including the first audio packets and the first signature information and to detect the first signature information. The audio controller determines a delay attributed to a transmission of the first audio input signal and the first audio output signal based on the first signature information and synchronizes the transmission of a second audio input signal from the audio controller to the first loudspeaker with the playback of another audio output signal from a second loudspeaker based at least on the delay.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: February 6, 2024
    Assignee: Harman International Industries, Incorporated
    Inventors: Hussnain Ali, Srinath Arunachalam, Kadagattur Gopinatha Srinidhi
  • Patent number: 11895484
    Abstract: An audio signal processing method detects a position, in a sound space, of a sound source that generates an audio signal, the sound space being divisible into a plurality of areas, and generates an initial reflected sound control signal by convolving (i) an impulse response of an initial reflected sound linked to a first area of the sound space, among the plurality of areas of the sound space, corresponding to the detected position of the sound source to (ii) the audio signal of the sound source without convolving (iii) an impulse response of an initial reflected sound linked to any of the plurality of areas of the sound space other than the first area of the sound space corresponding to the detected position of the sound source to (ii) the audio signal of the sound source.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: February 6, 2024
    Assignee: YAMAHA CORPORATION
    Inventors: Takayuki Watanabe, Dai Hashimoto, Hiroomi Shidoji
  • Patent number: 11881206
    Abstract: Systems and methods for spatially emulating a sound source. An apparatus includes a microphone array including microphones; and a sound profiler communicatively connected to the microphone array, the sound profiler including a processing circuitry and a memory which contains instructions that, when executed by the processing circuitry, configure the apparatus to: generate synthesized audio based on sound beam metadata, a sound profile, and target listener location data, wherein the sound beam metadata includes timed sound beams defining a directional dependence of a spatial sound wave, wherein the sound profile includes timed sound coefficients determined based on audio signals captured in a space wherein the target listener location data includes a position and an orientation, wherein the synthesized audio emulates sound that would be heard by a listener at the position and orientation of the target listener location data; and providing the synthesized audio for projection.
    Type: Grant
    Filed: May 6, 2022
    Date of Patent: January 23, 2024
    Assignee: INSOUNDZ LTD.
    Inventors: Ron Ziv, Tomer Goshen, Emil Winebrand, Yadin Aharoni
  • Patent number: 11877143
    Abstract: The description relates to representing acoustic characteristics of real or virtual scenes. One method includes generating directional impulse responses for a scene. The directional impulse responses can correspond to sound departing from multiple sound source locations and arriving at multiple listener locations in the scene. The method can include processing the directional impulse responses to obtain coherent sound signals and incoherent sound signals. The method can also include encoding first perceptual acoustic parameters from the coherent sound signals and second perceptual acoustic parameters from the incoherent sound signals, and outputting the encoded first perceptual acoustic parameters and the encoded second perceptual acoustic parameters.
    Type: Grant
    Filed: December 30, 2021
    Date of Patent: January 16, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Nikunj Raghuvanshi, Andrew Stewart Allen, John Michael Snyder
  • Patent number: 11871210
    Abstract: A method processes binaural sound to externally localize to a first user at a first location. This location is shared such that an electronic device processes the binaural sound to externally localize to a second user at a second location. The first and second locations occur at a same or similar location such that the first and second users hear the binaural sound as originating from the same or similar location.
    Type: Grant
    Filed: April 26, 2023
    Date of Patent: January 9, 2024
    Inventor: Philip Scott Lyren
  • Patent number: 11856388
    Abstract: A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is separately processed with an early part and a late reverberation of the room impulse response, and the processed early part of the audio signal and the reverberated signal are combined. A transition from the early part to the late reverberation in the room impulse response is reached when a correlation measure reaches a threshold, the threshold being set dependent on the correlation measure for a selected one of the early reflections in the early part of the room impulse response.
    Type: Grant
    Filed: February 4, 2022
    Date of Patent: December 26, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Simone Neukam, Jan Plogsties