Patents by Inventor Bastiaan Kleijn

Bastiaan Kleijn has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11908444
    Abstract: An apparatus for providing active noise control, includes: one or more microphones configured to detect sound entering through an aperture of a building structure; a set of speakers configured to provide sound output for cancelling or reducing at least some of the sound; and a processing unit communicatively coupled to the set of speakers, wherein the processing unit is configured to provide control signals to operate the speakers, wherein the control signals are independent of an error-microphone output.
    Type: Grant
    Filed: October 25, 2021
    Date of Patent: February 20, 2024
    Assignee: GN HEARING A/S
    Inventors: Willem Bastiaan Kleijn, Daan Ratering
  • Publication number: 20230368804
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for coding speech using neural networks. One of the methods includes obtaining a bitstream of parametric coder parameters characterizing spoken speech; generating, from the parametric coder parameters, a conditioning sequence; generating a reconstruction of the spoken speech that includes a respective speech sample at each of a plurality of decoder time steps, comprising, at each decoder time step: processing a current reconstruction sequence using an auto-regressive generative neural network, wherein the auto-regressive generative neural network is configured to process the current reconstruction to compute a score distribution over possible speech sample values, and wherein the processing comprises conditioning the auto-regressive generative neural network on at least a portion of the conditioning sequence; and sampling a speech sample from the possible speech sample values.
    Type: Application
    Filed: May 8, 2023
    Publication date: November 16, 2023
    Inventors: Willem Bastiaan Kleijn, Jan K. Skoglund, Alejandro Luebs, Sze Chie Lim
  • Publication number: 20230352036
    Abstract: A method includes receiving sampled audio data corresponding to utterances and training a machine learning (ML) model, using the sampled audio data, to generate a high-fidelity audio stream from a low bitrate input bitstream. The training of the ML model includes de-emphasizing the influence of low-probability distortion events in the sampled audio data on the trained ML model, where the de-emphasizing of the distortion events is achieved by the inclusion of a term in an objective function of the ML model, which term encourages low-variance predictive distributions of a next sample in the sampled audio data, based on previous samples of the audio data.
    Type: Application
    Filed: January 22, 2021
    Publication date: November 2, 2023
    Inventors: Willem Bastiaan Kleijn, Andrew Storus
  • Patent number: 11676613
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for coding speech using neural networks. One of the methods includes obtaining a bitstream of parametric coder parameters characterizing spoken speech; generating, from the parametric coder parameters, a conditioning sequence; generating a reconstruction of the spoken speech that includes a respective speech sample at each of a plurality of decoder time steps, comprising, at each decoder time step: processing a current reconstruction sequence using an auto-regressive generative neural network, wherein the auto-regressive generative neural network is configured to process the current reconstruction to compute a score distribution over possible speech sample values, and wherein the processing comprises conditioning the auto-regressive generative neural network on at least a portion of the conditioning sequence; and sampling a speech sample from the possible speech sample values.
    Type: Grant
    Filed: May 27, 2021
    Date of Patent: June 13, 2023
    Assignee: Google LLC
    Inventors: Willem Bastiaan Kleijn, Jan K. Skoglund, Alejandro Luebs, Sze Chie Lim
  • Publication number: 20230125941
    Abstract: An apparatus for providing active noise control, includes: one or more microphones configured to detect sound entering through an aperture of a building structure; a set of speakers configured to provide sound output for cancelling or reducing at least some of the sound; and a processing unit communicatively coupled to the set of speakers, wherein the processing unit is configured to provide control signals to operate the speakers, wherein the control signals are independent of an error-microphone output.
    Type: Application
    Filed: October 25, 2021
    Publication date: April 27, 2023
    Applicant: GN Hearing A/S
    Inventors: Willem Bastiaan Kleijn, Daan Ratering
  • Publication number: 20220416944
    Abstract: An aspect of the invention provides a method of performing a distributed task over a network comprising a plurality of nodes. The method comprises: a plurality of network nodes observing (300) data; applying a first linear code function to the data observed by at least one network node of the plurality of network nodes to obtain (302) at least one function output; applying errors (304) to the at least one function output; a query node selected from the network nodes performing (308) a mixing procedure to aggregate node observations to obtain a first set of aggregated values until a stopping criteria (306) is satisfied; applying (312) a second linear code function to the set of aggregated values to obtain a second set of aggregated values returned to their observed domain; and the query node outputting (314) the second set of aggregated values.
    Type: Application
    Filed: November 20, 2020
    Publication date: December 29, 2022
    Inventors: Willem Bastiaan KLEIJN, Matthew Michael O'CONNOR
  • Patent number: 11417351
    Abstract: According to an aspect, a method for multi-channel echo cancellation includes receiving a microphone signal and a multi-channel loudspeaker driving signal. The multi-channel loudspeaker driving signal includes a first driving signal that drives a first loudspeaker, and a second driving signal that drives a second loudspeaker. The first driving signal is substantially the same as second driving signal. The microphone signal includes a near-end signal with echo. The method includes determining a unique solution for acoustic transfer functions for a present acoustic scenario based on the microphone signal and the multi-channel loudspeaker driving signal. The acoustic transfer functions include first and second acoustic transfer function. The unique solution is determined based on time-frequency transforms of observations from the present acoustic scenario and at least one previous acoustic scenario.
    Type: Grant
    Filed: June 26, 2018
    Date of Patent: August 16, 2022
    Assignee: GOOGLE LLC
    Inventors: Willem Bastiaan Kleijn, Turaj Zakizadeh Shabestary
  • Patent number: 11380342
    Abstract: Provided are methods, systems, and apparatus for hierarchical decorrelation of multichannel audio. A hierarchical decorrelation algorithm is designed to adapt to possibly changing characteristics of an input signal, and also preserves the energy of the original signal. The algorithm is invertible in that the original signal can be retrieved if needed. Furthermore, the proposed algorithm decomposes the decorrelation process into multiple low-complexity steps. The contribution of these steps is generally in a decreasing order, and thus the complexity of the algorithm can be scaled.
    Type: Grant
    Filed: February 3, 2020
    Date of Patent: July 5, 2022
    Assignee: GOOGLE LLC
    Inventors: Minyue Li, Willem Bastiaan Kleijn, Jan Skoglund
  • Patent number: 11297424
    Abstract: Techniques of source localization and acquisition involve a wideband joint acoustic source localization and acquisition approach in light of sparse optimization framework based on an orthogonal matching pursuit-based grid-shift procedure. Along these lines, a specific grid structure is constructed with the same number of grid points as compared to the on-grid case, but which is “shifted” across the acoustic scene. More specifically, it is expected that each source will be located close to a grid point in at least one of the set of shifted grids. The sparse solutions corresponding to the set of shifted grids are combined to obtain the source location estimates. The estimated source positions are used as side information to obtain the original source signals.
    Type: Grant
    Filed: October 10, 2018
    Date of Patent: April 5, 2022
    Assignee: GOOGLE LLC
    Inventors: Willem Bastiaan Kleijn, Jan Skoglund, Christos Tzagkarakis
  • Publication number: 20210366495
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for coding speech using neural networks. One of the methods includes obtaining a bitstream of parametric coder parameters characterizing spoken speech; generating, from the parametric coder parameters, a conditioning sequence; generating a reconstruction of the spoken speech that includes a respective speech sample at each of a plurality of decoder time steps, comprising, at each decoder time step: processing a current reconstruction sequence using an auto-regressive generative neural network, wherein the auto-regressive generative neural network is configured to process the current reconstruction to compute a score distribution over possible speech sample values, and wherein the processing comprises conditioning the auto-regressive generative neural network on at least a portion of the conditioning sequence; and sampling a speech sample from the possible speech sample values.
    Type: Application
    Filed: May 27, 2021
    Publication date: November 25, 2021
    Inventors: Willem Bastiaan Kleijn, Jan K. Skoglund, Alejandro Luebs, Sze Chie Lim
  • Publication number: 20210287038
    Abstract: Implementations identify a small set of independent, salient features from an input signal. The salient features may be used for conditioning a generative network, making the generative network robust to noise. The salient features may facilitate compression and data transmission. An example method includes receiving an input signal and extracting salient features for the input signal by providing the input signal to an encoder trained to extract salient features. The salient features may be independent and have a sparse distribution. The encoder may be configured to generate almost identical features from two input signals a system designer deems equivalent. The method also includes conditioning a generative network using the salient features. In some implementations, the method may also include extracting a plurality of time sequences from the input signal and extracting the salient features for each time sequence.
    Type: Application
    Filed: May 16, 2019
    Publication date: September 16, 2021
    Inventors: Willem Bastiaan Kleijn, Sze Chie Lim, Michael Chinen, Jan Skoglund
  • Patent number: 11024321
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for coding speech using neural networks. One of the methods includes obtaining a bitstream of parametric coder parameters characterizing spoken speech; generating, from the parametric coder parameters, a conditioning sequence; generating a reconstruction of the spoken speech that includes a respective speech sample at each of a plurality of decoder time steps, comprising, at each decoder time step: processing a current reconstruction sequence using an auto-regressive generative neural network, wherein the auto-regressive generative neural network is configured to process the current reconstruction to compute a score distribution over possible speech sample values, and wherein the processing comprises conditioning the auto-regressive generative neural network on at least a portion of the conditioning sequence; and sampling a speech sample from the possible speech sample values.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: June 1, 2021
    Assignee: Google LLC
    Inventors: Willem Bastiaan Kleijn, Jan K. Skoglund, Alejandro Luebs, Sze Chie Lim
  • Publication number: 20210158226
    Abstract: Machine learning techniques which allow machine learning to be performed even when a cost function is not a convex function are provided. A machine learning system includes a plurality of node portions which learn mapping that uses one common primal variable by machine learning based on their respective input data while sending and receiving information to and from each other. The machine learning is performed so as to minimize, instead of a cost function of a non-convex function originally corresponding to the machine learning, a proxy convex function serving as an upper bound on the cost function. The proxy convex function is represented by a formula of a first-order gradient of the cost function with respect to the primal variable or by a formula of a first-order gradient and a formula of a second-order gradient of the cost function with respect to the primal variable.
    Type: Application
    Filed: April 12, 2019
    Publication date: May 27, 2021
    Applicants: NIPPON TELEGRAPH AND TELEPHONE CORPORATION, VICTORIA UNIVERSITY OF WELLINGTON
    Inventors: Kenta NIWA, Willem Bastiaan KLEIJN
  • Patent number: 10984818
    Abstract: The disclosure relates to an apparatus for determining a quality score (MOS) for an audio signal sample, the apparatus comprising: an extractor configured to extract a feature vector from the audio signal sample, wherein the feature vector comprises a plurality of feature values and wherein each feature value is associated to a different feature of the feature vector; a pre-processor configured to pre-process a feature value of the feature vector based on a cumulative distribution function associated to the feature represented by the feature value to obtain a pre-processed feature value; and a processor configured to implement a neural network and to determine the quality score (MOS) for the audio signal sample based on the pre-processed feature value and a set of neural network parameters for the neural network associated to the cumulative distribution function.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: April 20, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Wei Xiao, Mona Hakami, Willem Bastiaan Kleijn
  • Publication number: 20210073615
    Abstract: Techniques for achieving a scalable DNN and a multi-task DNN, for example, are provided. A neural network system is a neural network system including a plurality of models. Each one of the plurality of models is a DNN including a plurality of layers. Some or all of the plurality of models include at least one layer for which some or all of model variables are equivalent or common (hereinafter referred to as a “shared layer”) and also include at least one layer for which the model variables are not equivalent nor common (hereinafter referred to as an “unshared layer”).
    Type: Application
    Filed: April 12, 2019
    Publication date: March 11, 2021
    Applicants: NIPPON TELEGRAPH AND TELEPHONE CORPORATION, VICTORIA UNIVERSITY OF WELLINGTON
    Inventors: Kenta NIWA, Willem Bastiaan KLEIJN
  • Patent number: 10869125
    Abstract: A sound processing node is provided for an arrangement of sound processing nodes configured to receive a plurality of sound signals. The sound processing node comprises a processor configured to generate an output signal based on the plurality of sound signals weighted by a plurality of beamforming weights. The processor is configured to adaptively determine the plurality of beamforming weights on the basis of an adaptive linearly constrained minimum variance beamformer using a transformed version of a least mean squares formulation of a constrained gradient descent approach. The transformed version of the least mean squares formulation of the constrained gradient descent approach is based on a transformation of the least mean squares formulation of the constrained gradient descent approach to the dual domain.
    Type: Grant
    Filed: May 21, 2019
    Date of Patent: December 15, 2020
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Wenyu Jin, Thomas Sherson, Willem Bastiaan Kleijn, Richard Heusdens, Yue Lang
  • Patent number: 10861479
    Abstract: Techniques of performing linear acoustic echo cancellation performing a phase correction operation on the estimate of the echo signal based on a clock drift between a capture of an input microphone signal and a playout of a loudspeaker signal. Along these lines, the existence of the clock drift, i.e., a small difference in the sampling rates of the input microphone signal and the loudspeaker signal, can cause processing circuitry in a device configured to perform LAEC operations to generate a filter based on the magnitudes of the short-term Fourier transforms (STFTs) of the input microphone signal and the loudspeaker signal. Such a filter is real-valued and results in a positive estimate of the acoustic echo signal included in the input microphone signal. The phase of this estimate may then be aligned with the phase of the input microphone signal.
    Type: Grant
    Filed: October 10, 2019
    Date of Patent: December 8, 2020
    Assignee: GOOGLE LLC
    Inventors: Turaj Zakizadeh Shabestary, Willem Bastiaan Kleijn, Jan Skoglund
  • Patent number: 10839815
    Abstract: A method includes: receiving a representation of a soundfield, the representation characterizing the soundfield around a point in space; decomposing the received representation into independent signals; and encoding the independent signals, wherein a quantization noise for any of the independent signals has a common spatial profile with the independent signal.
    Type: Grant
    Filed: May 6, 2019
    Date of Patent: November 17, 2020
    Assignee: Google LLC
    Inventors: Willem Bastiaan Kleijn, Jan Skoglund, Sze Chie Lim
  • Patent number: 10770091
    Abstract: A method includes: receiving time instants of audio signals generated by a set of microphones at a location; determining a distortion measure between frequency components of at least some of the received audio signals; determining a similarity measure for the frequency components using the determined distortion measure; and processing the audio signals based on the determined similarity measure.
    Type: Grant
    Filed: January 23, 2017
    Date of Patent: September 8, 2020
    Assignee: GOOGLE LLC
    Inventors: Willem Bastiaan Kleijn, Sze Chie Lim
  • Publication number: 20200176009
    Abstract: Provided are methods, systems, and apparatus for hierarchical decorrelation of multichannel audio. A hierarchical decorrelation algorithm is designed to adapt to possibly changing characteristics of an input signal, and also preserves the energy of the original signal. The algorithm is invertible in that the original signal can be retrieved if needed. Furthermore, the proposed algorithm decomposes the decorrelation process into multiple low-complexity steps. The contribution of these steps is generally in a decreasing order, and thus the complexity of the algorithm can be scaled.
    Type: Application
    Filed: February 3, 2020
    Publication date: June 4, 2020
    Inventors: Minyue Li, Willem Bastiaan Kleijn, Jan Skoglund