Patents by Inventor Inseon Jang
Inseon Jang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250104724Abstract: A method and apparatus for encoding/decoding a neural network-based personalized speech are provided. The method includes outputting a first bit stream in which an input speech signal is encrypted, based on the input speech signal, and outputting a second bit stream in which speaker information of the input speech signal is encrypted, based on the input speech signal.Type: ApplicationFiled: September 16, 2024Publication date: March 27, 2025Applicants: Electronics and Telecommunications Research Institute, The Trustees of Indiana UniversityInventors: Inseon JANG, Soo Young PARK, Seung Kwon BEACK, Jongmo SUNG, Woo-taek LIM, Byeongho CHO, Jung Won KANG, Tae Jin LEE, Minje KIM, Haici YANG
-
Publication number: 20250104722Abstract: A method and device for encoding/decoding an audio signal based on dequantization through potential diffusion are provided. The method of decoding an audio signal includes obtaining a discrete latent vector in which a speech signal is quantized and based on the discrete latent vector, outputting a continuous latent vector in which the discrete latent vector is dequantized.Type: ApplicationFiled: September 16, 2024Publication date: March 27, 2025Applicants: Electronics and Telecommunications Research Institute, The Trustees of Indiana UniversityInventors: Inseon JANG, Woo-taek LIM, Soo Young PARK, Seung Kwon BEACK, Jongmo SUNG, Byeongho CHO, Jung Won KANG, Tae Jin LEE, Minje KIM, Haici YANG
-
Publication number: 20250104721Abstract: Disclosed are a device and method for audio signal processing. The audio signal processing device according to an embodiment includes a receiver configured to receive a bitstream corresponding to a compressed audio signal and a processor. The processor may be configured to generate a real restoration signal or a complex restoration signal by performing inverse quantization on real data of the bitstream or complex data of the bitstream, generate a result of real Frequency Domain Noise Shaping (FDNS) synthesis or a result of complex FDNS synthesis by performing FDNS synthesis on the real restoration signal or the complex restoration signal, and generate a restored audio signal by performing frequency-to-time transform on the result of the real FDNS synthesis or the result of the complex FDNS synthesis.Type: ApplicationFiled: December 15, 2022Publication date: March 27, 2025Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Woo-taek LIM, Inseon JANG, Byeongho CHO
-
Patent number: 12223426Abstract: Provided is a method and apparatus for designing and testing an audio codec using quantization based on white noise modeling. A neural network-based audio encoder design method includes generating a quantized latent vector and a reconstructed signal corresponding to an input signal by using a white noise modeling-based quantization process, computing a total loss for training a neural network-based audio codec, based on the input signal, the reconstruction signal, and the quantized latent vector, training the neural network-based audio codec by using the total loss, and validating the trained neural network-based audio codec to select the best neural network-based audio codec.Type: GrantFiled: February 8, 2023Date of Patent: February 11, 2025Assignees: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, YONSEI UNIVERSITY WONJU INDUSTRY-ACADEMIC COOPERATION FOUNDATIONInventors: Jongmo Sung, Seung Kwon Beack, Tae Jin Lee, Woo-taek Lim, Inseon Jang, Byeongho Cho, Young Cheol Park, Joon Byun, Seungmin Shin
-
Patent number: 12223970Abstract: An encoding method, a decoding method, an encoder for performing the encoding method, and a decoder for performing the decoding method are provided. The encoding method includes outputting LP coefficients bitstream and a residual signal by performing an LP analysis on an input signal, outputting a first latent signal obtained by encoding a periodic component of the residual signal, a second latent signal obtained by encoding a non-periodic component of the residual signal, and a weight vector for each of the first latent signal and the second latent signal, using a first neural network module, and outputting a first bitstream obtained by quantizing the first latent signal, a second bitstream obtained by quantizing the second latent signal, and a weight bitstream obtained by quantizing the weight vector, using a quantization module.Type: GrantFiled: January 31, 2023Date of Patent: February 11, 2025Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Jongmo Sung, Seung Kwon Beack, Tae Jin Lee, Woo-taek Lim, Inseon Jang, Byeongho Cho
-
Patent number: 12205605Abstract: An audio signal encoding and decoding method using a neural network model, and an encoder and decoder for performing the same are disclosed. A method of encoding an audio signal using a neural network model, the method may include identifying an input signal, generating a quantized latent vector by inputting the input signal into a neural network model encoding the input signal, and generating a bitstream corresponding to the quantized latent vector, wherein the neural network model may include i) a feature extraction layer generating a latent vector by extracting a feature of the input signal, ii) a plurality of downsampling blocks downsampling the latent vector, and iii) a plurality of quantization blocks performing quantization of a downsampled latent vector.Type: GrantFiled: February 11, 2022Date of Patent: January 21, 2025Assignees: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITYInventors: Inseon Jang, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Woo-Taek Lim, Hong-Goo Kang, Jihyun Lee, Chanwoo Lee, Hyungseob Lim
-
Publication number: 20250006210Abstract: A method of encoding/decoding a speech signal and a device for performing the same are provided. The method includes outputting, based on a first input speech signal of a previous timepoint and a second input speech signal of a current timepoint, a predicted signal that predicts the second input speech signal from the first input speech signal and obtaining, based on the second input speech signal and the predicted signal, a residual signal by removing a correlation between the first input speech signal and the second input speech signal from the second input speech signal.Type: ApplicationFiled: June 18, 2024Publication date: January 2, 2025Applicants: Electronics and Telecommunications Research Institute, UIF (University Industry Foundation), Yonsei UniversityInventors: Woo-taek LIM, Inseon JANG, Seung Kwon BEACK, Hong-Goo KANG, Byeong Hyeon KIM, Jihyun LEE, Hyungseob LIM
-
Publication number: 20240420712Abstract: A method of encoding/decoding an audio signal and a device for performing the same are provided. The method of encoding an audio signal includes generating, based on the audio signal, a linear prediction coding (LPC) bitstream and a frequency-domain signal of the audio signal, generating, based on the LPC bitstream and the frequency-domain signal, a first residual signal including information on a frequency envelope of the frequency-domain signal, and outputting a second residual signal by processing a first residual signal through one of a plurality of signal processing paths.Type: ApplicationFiled: June 4, 2024Publication date: December 19, 2024Applicant: Electronics and Telecommunications Research InstituteInventors: Byeongho CHO, Seung Kwon BEACK, Jung Won KANG, Soo Young PARK, Jongmo SUNG, Tae Jin LEE, Woo-taek LIM, Inseon JANG
-
Patent number: 12159640Abstract: Provided is an encoding method according to various example embodiments and an encoder performing the method. The encoding method includes outputting a linear prediction (LP) coefficients bitstream and a residual signal by performing a linear prediction analysis on an input signal, outputting a first latent signal obtained by encoding a periodic component of the residual signal, using a first neural network module, outputting a first bitstream obtained by quantizing the first latent signal, using a quantization module, outputting a second latent signal obtained by encoding an aperiodic component of the residual signal, using the first neural network module, and outputting a second bitstream obtained by quantizing the second latent signal, using the quantization module, wherein the aperiodic component of the residual signal is calculated based on a periodic component of the residual signal decoded from the quantized first latent signal output by de-quantizing the first bitstream.Type: GrantFiled: August 9, 2022Date of Patent: December 3, 2024Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Jongmo Sung, Seung Kwon Beack, Tae Jin Lee, Woo-taek Lim, Inseon Jang
-
Publication number: 20240371383Abstract: A method and apparatus for encoding/decoding audio signal are provided. The encoding method includes transforming an input audio signal in a time domain into an audio signal in a frequency domain, quantizing energy of a frequency band of the audio signal in the frequency domain, generating a normal signal by normalizing the audio signal in the frequency domain according to quantized energy, obtaining a feature vector including information on the energy of the frequency band based on the normal signal and the input audio signal, quantizing the feature vector, obtaining a scale factor used to scale the normal signal based on the quantized feature vector, quantizing an adjustment signal into which the normal signal has been scaled based on the scale factor, and outputting bitstreams based on the quantized energy, the quantized feature vector, and the quantized adjustment signal.Type: ApplicationFiled: May 2, 2024Publication date: November 7, 2024Applicants: Electronics and Telecommunications Research Institute, UIF (University Industry Foundation), Yonsei UniversityInventors: Inseon JANG, Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Woo-taek LIM, Byeongho CHO, Hong-Goo KANG, Byeong Hyeon KIM, Jihyun LEE, Hyungseob LIM
-
Publication number: 20240233738Abstract: Provided is an encoding apparatus including a memory configured to store instructions and a processor electrically connected to the memory and configured to execute the instructions, wherein the processor may be configured to perform a plurality of operations, when the instructions are executed by the processor, wherein the plurality of operations may include obtaining an input audio signal, generating an embedded audio signal by embedding signal components of a second frequency band of the input audio signal in a first frequency band of the input audio signal, generating additional information associated with the first frequency band and the second frequency band, generating an encoded audio signal by encoding the embedded audio signal, and formatting the encoded audio signal and the additional information into a bitstream.Type: ApplicationFiled: July 25, 2023Publication date: July 11, 2024Applicants: Electronics and Telecommunications Research Institute, Gwangju Institute of Science and TechnologyInventors: Inseon JANG, Seung Kwon BEACK, Tae Jin LEE, Jongmo SUNG, Woo-taek LIM, Byeongho CHO, Jongwon SHIN
-
Patent number: 11978465Abstract: A method of generating a residual signal performed by an encoder includes identifying an input signal including an audio sample, generating a first residual signal from the input signal using linear predictive coding (LPC), generating a second residual signal having a less information amount than the first residual signal by transforming the first residual signal, transforming the second residual signal into a frequency domain, and generating a third residual signal having a less information amount than the second residual signal from the transformed second residual signal using frequency-domain prediction (FDP) coding.Type: GrantFiled: October 21, 2021Date of Patent: May 7, 2024Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Woo-taek Lim, Inseon Jang
-
Publication number: 20240144943Abstract: An audio signal encoding/decoding method and an apparatus for performing the same are disclosed. The audio signal encoding method includes obtaining a full-band input signal, extracting a first feature vector corresponding to a first sub-band signal and a second feature vector corresponding to a second sub-band signal using an encoder neural network including a plurality of encoding layers, generating a first code vector corresponding to the first feature vector and a second code vector corresponding to the second feature vector by compressing the first feature vector and the second feature vector, and generating a bitstream by quantizing the first code vector and the second code vector.Type: ApplicationFiled: September 25, 2023Publication date: May 2, 2024Applicants: Electronics and Telecommunications Research Institute, The Trustees of Indiana UniversityInventors: Woo-taek LIM, Seung Kwon BEACK, Inseon JANG, Jongmo SUNG, Tae Jin LEE, Byeongho CHO, Minje KIM, Darius Petermann
-
Publication number: 20240135941Abstract: Provided is an encoding apparatus including a memory configured to store instructions and a processor electrically connected to the memory and configured to execute the instructions, wherein the processor may be configured to perform a plurality of operations, when the instructions are executed by the processor, wherein the plurality of operations may include obtaining an input audio signal, generating an embedded audio signal by embedding signal components of a second frequency band of the input audio signal in a first frequency band of the input audio signal, generating additional information associated with the first frequency band and the second frequency band, generating an encoded audio signal by encoding the embedded audio signal, and formatting the encoded audio signal and the additional information into a bitstream.Type: ApplicationFiled: July 24, 2023Publication date: April 25, 2024Applicants: Electronics and Telecommunications Research Institute, Gwangju Institute of Science and TechnologyInventors: Inseon JANG, Seung Kwon BEACK, Tae Jin LEE, Jongmo SUNG, Woo-taek LIM, Byeongho CHO, Jongwon SHIN
-
Publication number: 20240087577Abstract: Disclosed is an apparatus and method for audio encoding/decoding that is robust against coding distortion in a transition section. An audio encoding method includes outputting a frequency domain signal by time-to-frequency (T/F) transform of an input signal, outputting a frequency domain residual signal in which a frequency axis envelope is removed from the frequency domain signal by applying frequency domain noise shaping (FDNS) encoding to the frequency domain signal, outputting a time domain residual signal in which a time axis envelope is removed by performing linear prediction coefficient (LPC) analysis based on the frequency domain residual signal, and quantizing and transmitting the time domain residual signal.Type: ApplicationFiled: July 2, 2021Publication date: March 14, 2024Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Seung Kwon BEACK, Jongmo SUNG, Mi Suk LEE, Tae Jin LEE, Woo-taek LIM, Inseon JANG
-
Publication number: 20240055009Abstract: Provided are an apparatus for encoding an audio signal and a method of an operation thereof. An audio signal encoding method includes obtaining quantized linear prediction (LP) coefficients by performing a linear predictive coding (LPC) analysis and quantization on an input audio signal, generating a reference signal by applying discrete Fourier transform (DFT) to the input audio signal, obtaining LP residual coefficients from the reference signal, scaling magnitudes of the LP residual coefficients using the quantized LP coefficients and the reference signal, and quantizing phases of the LP residual coefficients and the scaled magnitudes of the LP residual coefficients.Type: ApplicationFiled: July 10, 2023Publication date: February 15, 2024Applicant: Electronics and Telecommunications Research InstituteInventors: Byeongho CHO, Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Woo-taek LIM, Inseon JANG
-
Publication number: 20240013796Abstract: A method of encoding a speech signal includes predicting a feature vector of each of a plurality of frames included in the speech signal based on a ground-truth feature vector of a previous frame of each of the plurality of frames, calculating a residual signal corresponding to each of the plurality of frames based on a ground-truth feature vector of each of the plurality of frames and a predicted feature vector of each of the plurality of frames, and generating a bitstring corresponding to each of the plurality of frames by quantizing the residual signal.Type: ApplicationFiled: September 26, 2023Publication date: January 11, 2024Applicants: Electronics and Telecommunications Research Institute, The Trustees of Indiana UniversityInventors: Woo-taek LIM, Seung Kwon BEACK, Inseon JANG, Jongmo SUNG, Tae Jin LEE, Byeongho CHO, Minje KIM, Haici YANG
-
Patent number: 11862183Abstract: An audio signal encoding and decoding method using a neural network model, a method of training the neural network model, and an encoder and decoder performing the methods are disclosed. The encoding method includes computing the first feature information of an input signal using a recurrent encoding model, computing an output signal from the first feature information using a recurrent decoding model, calculating a residual signal by subtracting the output signal from the input signal, computing the second feature information of the residual signal using a nonrecurrent encoding model, and converting the first feature information and the second feature information to a bitstream.Type: GrantFiled: July 6, 2021Date of Patent: January 2, 2024Assignee: Electronics and Telecommunications Research InstituteInventors: Jongmo Sung, Seung Kwon Beack, Mi Suk Lee, Tae Jin Lee, Woo-taek Lim, Inseon Jang
-
Patent number: 11823688Abstract: Disclosed are a method of encoding and decoding an audio signal and an encoder and a decoder performing the method. The method of encoding an audio signal includes identifying an input signal, and generating a bitstring of each encoding layer by applying, to the input signal, an encoding model including a plurality of successive encoding layers that encodes the input signal, in which a current encoding layer among the encoding layers is trained to generate a bitstring of the current encoding layer by encoding an encoded signal which is a signal encoded in a previous encoding layer and quantizing an encoded signal which is a signal encoded in the current encoding layer.Type: GrantFiled: July 30, 2021Date of Patent: November 21, 2023Assignees: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, The Trustees of Indiana UniversityInventors: Woo-taek Lim, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Inseon Jang, Minje Kim
-
Patent number: 11804230Abstract: An audio encoding/decoding apparatus and method using vector quantized residual error features are disclosed. An audio signal encoding method includes outputting a bitstream of a main codec by encoding an original signal, decoding the bitstream of the main codec, determining a residual error feature vector from a feature vector of a decoded signal and a feature vector of the original signal, and outputting a bitstream of additional information by encoding the residual error feature vector.Type: GrantFiled: April 1, 2022Date of Patent: October 31, 2023Assignees: Electronics and Telecommunications Research Institute, Gwangju Institute of Science and TechnologyInventors: Inseon Jang, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Woo-taek Lim, Jongwon Shin, Youngju Cheon, Sangwook Han, Soojoong Hwang