Patents by Inventor Bastiaan Kleijn
Bastiaan Kleijn has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11908444Abstract: An apparatus for providing active noise control, includes: one or more microphones configured to detect sound entering through an aperture of a building structure; a set of speakers configured to provide sound output for cancelling or reducing at least some of the sound; and a processing unit communicatively coupled to the set of speakers, wherein the processing unit is configured to provide control signals to operate the speakers, wherein the control signals are independent of an error-microphone output.Type: GrantFiled: October 25, 2021Date of Patent: February 20, 2024Assignee: GN HEARING A/SInventors: Willem Bastiaan Kleijn, Daan Ratering
-
Publication number: 20230368804Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for coding speech using neural networks. One of the methods includes obtaining a bitstream of parametric coder parameters characterizing spoken speech; generating, from the parametric coder parameters, a conditioning sequence; generating a reconstruction of the spoken speech that includes a respective speech sample at each of a plurality of decoder time steps, comprising, at each decoder time step: processing a current reconstruction sequence using an auto-regressive generative neural network, wherein the auto-regressive generative neural network is configured to process the current reconstruction to compute a score distribution over possible speech sample values, and wherein the processing comprises conditioning the auto-regressive generative neural network on at least a portion of the conditioning sequence; and sampling a speech sample from the possible speech sample values.Type: ApplicationFiled: May 8, 2023Publication date: November 16, 2023Inventors: Willem Bastiaan Kleijn, Jan K. Skoglund, Alejandro Luebs, Sze Chie Lim
-
Publication number: 20230352036Abstract: A method includes receiving sampled audio data corresponding to utterances and training a machine learning (ML) model, using the sampled audio data, to generate a high-fidelity audio stream from a low bitrate input bitstream. The training of the ML model includes de-emphasizing the influence of low-probability distortion events in the sampled audio data on the trained ML model, where the de-emphasizing of the distortion events is achieved by the inclusion of a term in an objective function of the ML model, which term encourages low-variance predictive distributions of a next sample in the sampled audio data, based on previous samples of the audio data.Type: ApplicationFiled: January 22, 2021Publication date: November 2, 2023Inventors: Willem Bastiaan Kleijn, Andrew Storus
-
Patent number: 11676613Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for coding speech using neural networks. One of the methods includes obtaining a bitstream of parametric coder parameters characterizing spoken speech; generating, from the parametric coder parameters, a conditioning sequence; generating a reconstruction of the spoken speech that includes a respective speech sample at each of a plurality of decoder time steps, comprising, at each decoder time step: processing a current reconstruction sequence using an auto-regressive generative neural network, wherein the auto-regressive generative neural network is configured to process the current reconstruction to compute a score distribution over possible speech sample values, and wherein the processing comprises conditioning the auto-regressive generative neural network on at least a portion of the conditioning sequence; and sampling a speech sample from the possible speech sample values.Type: GrantFiled: May 27, 2021Date of Patent: June 13, 2023Assignee: Google LLCInventors: Willem Bastiaan Kleijn, Jan K. Skoglund, Alejandro Luebs, Sze Chie Lim
-
Publication number: 20230125941Abstract: An apparatus for providing active noise control, includes: one or more microphones configured to detect sound entering through an aperture of a building structure; a set of speakers configured to provide sound output for cancelling or reducing at least some of the sound; and a processing unit communicatively coupled to the set of speakers, wherein the processing unit is configured to provide control signals to operate the speakers, wherein the control signals are independent of an error-microphone output.Type: ApplicationFiled: October 25, 2021Publication date: April 27, 2023Applicant: GN Hearing A/SInventors: Willem Bastiaan Kleijn, Daan Ratering
-
Publication number: 20220416944Abstract: An aspect of the invention provides a method of performing a distributed task over a network comprising a plurality of nodes. The method comprises: a plurality of network nodes observing (300) data; applying a first linear code function to the data observed by at least one network node of the plurality of network nodes to obtain (302) at least one function output; applying errors (304) to the at least one function output; a query node selected from the network nodes performing (308) a mixing procedure to aggregate node observations to obtain a first set of aggregated values until a stopping criteria (306) is satisfied; applying (312) a second linear code function to the set of aggregated values to obtain a second set of aggregated values returned to their observed domain; and the query node outputting (314) the second set of aggregated values.Type: ApplicationFiled: November 20, 2020Publication date: December 29, 2022Inventors: Willem Bastiaan KLEIJN, Matthew Michael O'CONNOR
-
Patent number: 11417351Abstract: According to an aspect, a method for multi-channel echo cancellation includes receiving a microphone signal and a multi-channel loudspeaker driving signal. The multi-channel loudspeaker driving signal includes a first driving signal that drives a first loudspeaker, and a second driving signal that drives a second loudspeaker. The first driving signal is substantially the same as second driving signal. The microphone signal includes a near-end signal with echo. The method includes determining a unique solution for acoustic transfer functions for a present acoustic scenario based on the microphone signal and the multi-channel loudspeaker driving signal. The acoustic transfer functions include first and second acoustic transfer function. The unique solution is determined based on time-frequency transforms of observations from the present acoustic scenario and at least one previous acoustic scenario.Type: GrantFiled: June 26, 2018Date of Patent: August 16, 2022Assignee: GOOGLE LLCInventors: Willem Bastiaan Kleijn, Turaj Zakizadeh Shabestary
-
Patent number: 11380342Abstract: Provided are methods, systems, and apparatus for hierarchical decorrelation of multichannel audio. A hierarchical decorrelation algorithm is designed to adapt to possibly changing characteristics of an input signal, and also preserves the energy of the original signal. The algorithm is invertible in that the original signal can be retrieved if needed. Furthermore, the proposed algorithm decomposes the decorrelation process into multiple low-complexity steps. The contribution of these steps is generally in a decreasing order, and thus the complexity of the algorithm can be scaled.Type: GrantFiled: February 3, 2020Date of Patent: July 5, 2022Assignee: GOOGLE LLCInventors: Minyue Li, Willem Bastiaan Kleijn, Jan Skoglund
-
Patent number: 11297424Abstract: Techniques of source localization and acquisition involve a wideband joint acoustic source localization and acquisition approach in light of sparse optimization framework based on an orthogonal matching pursuit-based grid-shift procedure. Along these lines, a specific grid structure is constructed with the same number of grid points as compared to the on-grid case, but which is “shifted” across the acoustic scene. More specifically, it is expected that each source will be located close to a grid point in at least one of the set of shifted grids. The sparse solutions corresponding to the set of shifted grids are combined to obtain the source location estimates. The estimated source positions are used as side information to obtain the original source signals.Type: GrantFiled: October 10, 2018Date of Patent: April 5, 2022Assignee: GOOGLE LLCInventors: Willem Bastiaan Kleijn, Jan Skoglund, Christos Tzagkarakis
-
Publication number: 20210366495Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for coding speech using neural networks. One of the methods includes obtaining a bitstream of parametric coder parameters characterizing spoken speech; generating, from the parametric coder parameters, a conditioning sequence; generating a reconstruction of the spoken speech that includes a respective speech sample at each of a plurality of decoder time steps, comprising, at each decoder time step: processing a current reconstruction sequence using an auto-regressive generative neural network, wherein the auto-regressive generative neural network is configured to process the current reconstruction to compute a score distribution over possible speech sample values, and wherein the processing comprises conditioning the auto-regressive generative neural network on at least a portion of the conditioning sequence; and sampling a speech sample from the possible speech sample values.Type: ApplicationFiled: May 27, 2021Publication date: November 25, 2021Inventors: Willem Bastiaan Kleijn, Jan K. Skoglund, Alejandro Luebs, Sze Chie Lim
-
Publication number: 20210287038Abstract: Implementations identify a small set of independent, salient features from an input signal. The salient features may be used for conditioning a generative network, making the generative network robust to noise. The salient features may facilitate compression and data transmission. An example method includes receiving an input signal and extracting salient features for the input signal by providing the input signal to an encoder trained to extract salient features. The salient features may be independent and have a sparse distribution. The encoder may be configured to generate almost identical features from two input signals a system designer deems equivalent. The method also includes conditioning a generative network using the salient features. In some implementations, the method may also include extracting a plurality of time sequences from the input signal and extracting the salient features for each time sequence.Type: ApplicationFiled: May 16, 2019Publication date: September 16, 2021Inventors: Willem Bastiaan Kleijn, Sze Chie Lim, Michael Chinen, Jan Skoglund
-
Patent number: 11024321Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for coding speech using neural networks. One of the methods includes obtaining a bitstream of parametric coder parameters characterizing spoken speech; generating, from the parametric coder parameters, a conditioning sequence; generating a reconstruction of the spoken speech that includes a respective speech sample at each of a plurality of decoder time steps, comprising, at each decoder time step: processing a current reconstruction sequence using an auto-regressive generative neural network, wherein the auto-regressive generative neural network is configured to process the current reconstruction to compute a score distribution over possible speech sample values, and wherein the processing comprises conditioning the auto-regressive generative neural network on at least a portion of the conditioning sequence; and sampling a speech sample from the possible speech sample values.Type: GrantFiled: November 30, 2018Date of Patent: June 1, 2021Assignee: Google LLCInventors: Willem Bastiaan Kleijn, Jan K. Skoglund, Alejandro Luebs, Sze Chie Lim
-
Publication number: 20210158226Abstract: Machine learning techniques which allow machine learning to be performed even when a cost function is not a convex function are provided. A machine learning system includes a plurality of node portions which learn mapping that uses one common primal variable by machine learning based on their respective input data while sending and receiving information to and from each other. The machine learning is performed so as to minimize, instead of a cost function of a non-convex function originally corresponding to the machine learning, a proxy convex function serving as an upper bound on the cost function. The proxy convex function is represented by a formula of a first-order gradient of the cost function with respect to the primal variable or by a formula of a first-order gradient and a formula of a second-order gradient of the cost function with respect to the primal variable.Type: ApplicationFiled: April 12, 2019Publication date: May 27, 2021Applicants: NIPPON TELEGRAPH AND TELEPHONE CORPORATION, VICTORIA UNIVERSITY OF WELLINGTONInventors: Kenta NIWA, Willem Bastiaan KLEIJN
-
Patent number: 10984818Abstract: The disclosure relates to an apparatus for determining a quality score (MOS) for an audio signal sample, the apparatus comprising: an extractor configured to extract a feature vector from the audio signal sample, wherein the feature vector comprises a plurality of feature values and wherein each feature value is associated to a different feature of the feature vector; a pre-processor configured to pre-process a feature value of the feature vector based on a cumulative distribution function associated to the feature represented by the feature value to obtain a pre-processed feature value; and a processor configured to implement a neural network and to determine the quality score (MOS) for the audio signal sample based on the pre-processed feature value and a set of neural network parameters for the neural network associated to the cumulative distribution function.Type: GrantFiled: February 7, 2019Date of Patent: April 20, 2021Assignee: Huawei Technologies Co., Ltd.Inventors: Wei Xiao, Mona Hakami, Willem Bastiaan Kleijn
-
Publication number: 20210073615Abstract: Techniques for achieving a scalable DNN and a multi-task DNN, for example, are provided. A neural network system is a neural network system including a plurality of models. Each one of the plurality of models is a DNN including a plurality of layers. Some or all of the plurality of models include at least one layer for which some or all of model variables are equivalent or common (hereinafter referred to as a “shared layer”) and also include at least one layer for which the model variables are not equivalent nor common (hereinafter referred to as an “unshared layer”).Type: ApplicationFiled: April 12, 2019Publication date: March 11, 2021Applicants: NIPPON TELEGRAPH AND TELEPHONE CORPORATION, VICTORIA UNIVERSITY OF WELLINGTONInventors: Kenta NIWA, Willem Bastiaan KLEIJN
-
Patent number: 10869125Abstract: A sound processing node is provided for an arrangement of sound processing nodes configured to receive a plurality of sound signals. The sound processing node comprises a processor configured to generate an output signal based on the plurality of sound signals weighted by a plurality of beamforming weights. The processor is configured to adaptively determine the plurality of beamforming weights on the basis of an adaptive linearly constrained minimum variance beamformer using a transformed version of a least mean squares formulation of a constrained gradient descent approach. The transformed version of the least mean squares formulation of the constrained gradient descent approach is based on a transformation of the least mean squares formulation of the constrained gradient descent approach to the dual domain.Type: GrantFiled: May 21, 2019Date of Patent: December 15, 2020Assignee: Huawei Technologies Co., Ltd.Inventors: Wenyu Jin, Thomas Sherson, Willem Bastiaan Kleijn, Richard Heusdens, Yue Lang
-
Patent number: 10861479Abstract: Techniques of performing linear acoustic echo cancellation performing a phase correction operation on the estimate of the echo signal based on a clock drift between a capture of an input microphone signal and a playout of a loudspeaker signal. Along these lines, the existence of the clock drift, i.e., a small difference in the sampling rates of the input microphone signal and the loudspeaker signal, can cause processing circuitry in a device configured to perform LAEC operations to generate a filter based on the magnitudes of the short-term Fourier transforms (STFTs) of the input microphone signal and the loudspeaker signal. Such a filter is real-valued and results in a positive estimate of the acoustic echo signal included in the input microphone signal. The phase of this estimate may then be aligned with the phase of the input microphone signal.Type: GrantFiled: October 10, 2019Date of Patent: December 8, 2020Assignee: GOOGLE LLCInventors: Turaj Zakizadeh Shabestary, Willem Bastiaan Kleijn, Jan Skoglund
-
Patent number: 10839815Abstract: A method includes: receiving a representation of a soundfield, the representation characterizing the soundfield around a point in space; decomposing the received representation into independent signals; and encoding the independent signals, wherein a quantization noise for any of the independent signals has a common spatial profile with the independent signal.Type: GrantFiled: May 6, 2019Date of Patent: November 17, 2020Assignee: Google LLCInventors: Willem Bastiaan Kleijn, Jan Skoglund, Sze Chie Lim
-
Patent number: 10770091Abstract: A method includes: receiving time instants of audio signals generated by a set of microphones at a location; determining a distortion measure between frequency components of at least some of the received audio signals; determining a similarity measure for the frequency components using the determined distortion measure; and processing the audio signals based on the determined similarity measure.Type: GrantFiled: January 23, 2017Date of Patent: September 8, 2020Assignee: GOOGLE LLCInventors: Willem Bastiaan Kleijn, Sze Chie Lim
-
Publication number: 20200176009Abstract: Provided are methods, systems, and apparatus for hierarchical decorrelation of multichannel audio. A hierarchical decorrelation algorithm is designed to adapt to possibly changing characteristics of an input signal, and also preserves the energy of the original signal. The algorithm is invertible in that the original signal can be retrieved if needed. Furthermore, the proposed algorithm decomposes the decorrelation process into multiple low-complexity steps. The contribution of these steps is generally in a decreasing order, and thus the complexity of the algorithm can be scaled.Type: ApplicationFiled: February 3, 2020Publication date: June 4, 2020Inventors: Minyue Li, Willem Bastiaan Kleijn, Jan Skoglund