Patents by Inventor Rintaro IKESHITA

Rintaro IKESHITA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240144952
    Abstract: A sound source signal is estimated with high accuracy in a noise environment. A sound source signal estimation unit (15) estimates each sound source signal using a separation matrix from an observation signal obtained by collecting a mixed acoustic signal in which a plurality of sound source signals and diffusive noise are mixed by a microphone array formed by a plurality of microphones The separation matrix is configured to convert steering vectors from each sound source to the microphone into unit vectors and convert a spatial covariance matrix of the diffusive noise into a matrix including a diagonal matrix with a size of the number of sound sources.
    Type: Application
    Filed: February 15, 2021
    Publication date: May 2, 2024
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Rintaro IKESHITA, Nobutaka ITO, Tomohiro NAKATANI
  • Patent number: 11967328
    Abstract: A sound source separation filter information estimation device (10) estimates a covariance matrix having information on a correlation between sound source spectra and information on a correlation between channels as information on sound source separation filter information for separating an individual sound source signal from a mixed acoustic signal.
    Type: Grant
    Filed: August 21, 2019
    Date of Patent: April 23, 2024
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Rintaro Ikeshita, Nobutaka Ito, Tomohiro Nakatani, Hiroshi Sawada
  • Publication number: 20240129666
    Abstract: An estimation apparatus 10 is a signal processing apparatus for processing an acoustic signal and estimates an observation signal of a virtual microphone arranged virtually from an input observation signal of a real microphone using a deep learning model having a neural network (NN) 11.
    Type: Application
    Filed: January 29, 2021
    Publication date: April 18, 2024
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Tsubasa OCHIAI, Marc DELCROIX, Tomohiro NAKATANI, Rintaro IKESHITA, Keisuke KINOSHITA, Shoko ARAKI
  • Publication number: 20240127841
    Abstract: An acoustic signal enhancement device includes: a spatiotemporal covariance matrix estimation unit 2 configured to estimate spatiotemporal covariance matrices Rf(j) and Pf(j); a reverberation suppression unit 3 configured to obtain a reverberation suppression filter Gf(j) of the sound source j using the estimated spatiotemporal covariance matrices Rf(j) and Pf(j) for each sound source j and to generate a reverberation suppression signal vector using the obtained reverberation suppression filter Gf(j) and the observation signal vector Xt,f; a sound source separation unit 4 configured to obtain an enhanced sound yt,f(j) of the sound source j and power of the sound source j using the generated reverberation suppression signal vector for each sound source j (where 1?j?J) corresponding to the target sound; and a control unit 5 configured to perform control such that processes of these units are repeatedly performed.
    Type: Application
    Filed: February 25, 2021
    Publication date: April 18, 2024
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Tomohiro NAKATANI, Rintaro IKESHITA, Keisuke KINOSHITA, Hiroshi SAWADA, Shoko ARAKI
  • Publication number: 20240105202
    Abstract: Provided is a reverberation removal device that is highly accurate even in noisy environments and underdetermined conditions. Reverberation is removed by applying a plurality of reverberation prediction filters to an observation signal while switching the plurality of reverberation prediction filters according to each time frequency bin of the observation signal.
    Type: Application
    Filed: February 4, 2021
    Publication date: March 28, 2024
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Rintaro IKESHITA, Naoyuki KAMO, Tomohiro NAKATANI
  • Patent number: 11915717
    Abstract: The signal separation device includes: cross product calculation means receiving an input of an observed signal that is a mixture of a plurality of target signals, and calculating a cross product of the observed signal; model calculation means updating a parameter of a model for estimating the cross product with a predetermined algorithm using an inverse matrix of a matrix that represents an estimate of the cross product; inverse matrix calculation means calculating the inverse matrix of a matrix by a SIMD command when the parameter is updated; and separation means calculating the target signals using a matrix representing an estimate of the cross product, the updated parameter, and the observed signal.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: February 27, 2024
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Hiroshi Sawada, Rintaro Ikeshita, Nobutaka Ito, Tomohiro Nakatani
  • Publication number: 20240038253
    Abstract: A sound source signal generation technology based on an optimization algorithm that enables high-speed processing of sound source extraction is provided. A sound source signal generation device includes an optimization unit that optimizes a separation matrix W(f)=[w1(f), . . . , wK(f), WZ(f)] using an observed signal x(f, t), the optimization unit includes an auxiliary function calculation unit that calculates an auxiliary function Vi(f) (i=1, . . . , K) according to a predetermined equation, a first separation filter calculation unit that calculates a separation filters wi(f) (i=1, . . . , K) using auxiliary functions Vi(f) (i=1, . . . , K) and Vz(f), and a second separation filter calculation unit that calculates a separation filter WZ(f) according to a predetermined equation when a convergence condition is satisfied.
    Type: Application
    Filed: December 14, 2020
    Publication date: February 1, 2024
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Rintaro IKESHITA, Tomohiro NAKATANI, Shoko ARAKI
  • Publication number: 20230370778
    Abstract: Provided is an acoustic signal enhancement device, including a time-space covariance matrix estimation unit 2 configured to estimate a time-space covariance matrix Rf(n),Pf(n) corresponding to a sound source n, using a power ?t,f(n) of the sound source n and an observation signal vector Xt,f composed of an observation signal xm,t,f from a microphone m; a reverberation suppression unit 3 configured to obtain a reverberation removal filter Gf(n) of the sound source n using the time-space covariance matrix Rf(n),Pf(n), and to generate a reverberation suppression signal vector Zt,f(n) corresponding to the observation signal xm,t,f for an emphasized sound of the sound source n using the reverberation removal filter Gf(n) and the observation signal vector Xt,f; and a sound source separation unit 4 configured to obtain an emphatic sound yt,f(n) of the sound source n and the power ?t,f(n) of the sound source n using the reverberation suppression signal vector Zt,f(n).
    Type: Application
    Filed: October 15, 2020
    Publication date: November 16, 2023
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Tomohiro NAKATANI, Rintaro IKESHITA, Keisuke KINOSHITA, Hiroshi SAWADA, Shoko ARAKI
  • Publication number: 20230087982
    Abstract: A signal processing device applies a convolutional separation filter, which is a combined filter of: a rear reverberation removal filter for suppressing a rear reverberation component from a mixed acoustic signal obtained by converting an observed mixed acoustic signal obtained by observing a source signal into a time-frequency domain; and a sound source separation filter for emphasizing components corresponding to source signals from the mixed acoustic signal, to a mixed acoustic signal string including the mixed acoustic signal and a delay signal of the mixed acoustic signal and estimates model parameters of a model for obtaining information corresponding to signals in which the rear reverberation component is suppressed and target signals emitted from target sound sources in the source signal are emphasized.
    Type: Application
    Filed: February 26, 2020
    Publication date: March 23, 2023
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Rintaro IKESHITA, Tomohiro NAKATANI, Shoko ARAKI
  • Publication number: 20230067132
    Abstract: A signal processing apparatus includes a neural network (“NN”), a sorting unit, and a spatial covariance matrix calculation unit. The NN converts a mixed signal, in which sounds of a plurality of sound sources input by a plurality of channels are mixed, into a separated signal separated into a signal for each sound source as a signal in a time domain as it is and outputs the separated signal. The sorting unit sorts, for the separated signal of each channel output from the NN, the separated signal of each channel such that the plurality of sound sources of a plurality of the separated signals are aligned among the plurality of channels. The spatial covariance matrix calculation unit calculates a spatial covariance matrix corresponding to each sound source in accordance with the separated signal for each channel output from the sorting unit and sorted.
    Type: Application
    Filed: February 14, 2020
    Publication date: March 2, 2023
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Tsubasa OCHIAI, Marc DELCROIX, Rintaro IKESHITA, Keisuke KINOSHITA, Tomohiro NAKATANI, Shoko ARAKI
  • Publication number: 20220301570
    Abstract: A sound source separation filter information estimation device (10) estimates a covariance matrix having information on a correlation between sound source spectra and information on a correlation between channels as information on sound source separation filter information for separating an individual sound source signal from a mixed acoustic signal.
    Type: Application
    Filed: August 21, 2019
    Publication date: September 22, 2022
    Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Rintaro IKESHITA, Nobutaka ITO, Tomohiro NAKATANI, Hiroshi SAWADA
  • Publication number: 20210398549
    Abstract: The signal separation device includes: cross product calculation means receiving an input of an observed signal that is a mixture of a plurality of target signals, and calculating a cross product of the observed signal; model calculation means updating a parameter of a model for estimating the cross product with a predetermined algorithm using an inverse matrix of a matrix that represents an estimate of the cross product; inverse matrix calculation means calculating the inverse matrix of a matrix by a SIMD command when the parameter is updated; and separation means calculating the target signals using a matrix representing an estimate of the cross product, the updated parameter, and the observed signal.
    Type: Application
    Filed: July 1, 2019
    Publication date: December 23, 2021
    Inventors: Hiroshi SAWADA, Rintaro IKESHITA, Nobutaka ITO, Tomohiro NAKATANI
  • Patent number: 10720174
    Abstract: There is provided a sound source separation method of carrying out sound source separation of an audio signal inputted from an input device by using a modeled sound source distribution, by an information processing apparatus provided with a processing device, a storage device, the input device, and an output device. In this method, as a condition followed by the model, sound sources are independent of one another, powers which the sound sources have are modeled for each of frequency bands obtained through band division, a relationship among the powers for the frequency bands different from each other is modeled by nonnegative matrix factorization, and components obtained through the division of the sound source follow a complex normal distribution.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: July 21, 2020
    Assignee: Hitachi, Ltd.
    Inventors: Rintaro Ikeshita, Yohei Kawaguchi
  • Publication number: 20190115043
    Abstract: There is provided a sound source separation method of carrying out sound source separation of an audio signal inputted from an input device by using a modeled sound source distribution, by an information processing apparatus provided with a processing device, a storage device, the input device, and an output device. In this method, as a condition followed by the model, sound sources are independent of one another, powers which the sound sources have are modeled for each of frequency bands obtained through band division, a relationship among the powers for the frequency bands different from each other is modeled by nonnegative matrix factorization, and components obtained through the division of the sound source follow a complex normal distribution.
    Type: Application
    Filed: August 31, 2018
    Publication date: April 18, 2019
    Applicant: HITACHI, LTD.
    Inventors: Rintaro IKESHITA, Yohei KAWAGUCHI