Patents by Inventor Jongmo Sung
Jongmo Sung has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11823688Abstract: Disclosed are a method of encoding and decoding an audio signal and an encoder and a decoder performing the method. The method of encoding an audio signal includes identifying an input signal, and generating a bitstring of each encoding layer by applying, to the input signal, an encoding model including a plurality of successive encoding layers that encodes the input signal, in which a current encoding layer among the encoding layers is trained to generate a bitstring of the current encoding layer by encoding an encoded signal which is a signal encoded in a previous encoding layer and quantizing an encoded signal which is a signal encoded in the current encoding layer.Type: GrantFiled: July 30, 2021Date of Patent: November 21, 2023Assignees: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, The Trustees of Indiana UniversityInventors: Woo-taek Lim, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Inseon Jang, Minje Kim
-
Patent number: 11804230Abstract: An audio encoding/decoding apparatus and method using vector quantized residual error features are disclosed. An audio signal encoding method includes outputting a bitstream of a main codec by encoding an original signal, decoding the bitstream of the main codec, determining a residual error feature vector from a feature vector of a decoded signal and a feature vector of the original signal, and outputting a bitstream of additional information by encoding the residual error feature vector.Type: GrantFiled: April 1, 2022Date of Patent: October 31, 2023Assignees: Electronics and Telecommunications Research Institute, Gwangju Institute of Science and TechnologyInventors: Inseon Jang, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Woo-taek Lim, Jongwon Shin, Youngju Cheon, Sangwook Han, Soojoong Hwang
-
Publication number: 20230335145Abstract: A signal compression method and apparatus and a signal restoration method and apparatus are provided. The signal compression method includes outputting an input signal, obtained by processing an audio signal, which is input, based on a human auditory perception characteristic, using an auditory perception model, extracting a feature vector from the input signal using a feature extraction module, and outputting a code obtained by compressing the feature vector using a trained signal compression model.Type: ApplicationFiled: March 7, 2023Publication date: October 19, 2023Applicants: Electronics and Telecommunications Research Institute, Kyungpook National University Industry-Academic Cooperation FoundationInventors: Woo-taek LIM, Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Inseon JANG, Min Han KIM, Seung Hyeon SHIN, Dae Ho LEE, Seok Jin LEE
-
Patent number: 11790926Abstract: A method and apparatus for processing an audio signal are disclosed. According to an example embodiment, a method of processing an audio signal may include acquiring a final audio signal for an initial audio signal using a plurality of neural network models generating output audio signals by encoding and decoding input audio signals, calculating a difference between the initial audio signal and the final audio signal in a time domain, converting the initial audio signal and the final audio signal into Mel-spectra, calculating a difference between the Mel-spectra of the initial audio signal and the final audio signal in a frequency domain, training the plurality of neural network models based on results calculated in the time domain and the frequency domain, and generating a new final audio signal distinguished from the final audio signal from the initial audio signal using the trained neural network models.Type: GrantFiled: January 22, 2021Date of Patent: October 17, 2023Assignees: Electronics and Telecommunications Research Institute, The Trustees of Indiana UniversityInventors: Mi Suk Lee, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Jin Soo Choi, Minje Kim, Kai Zhen
-
Patent number: 11783844Abstract: Disclosed are methods of encoding and decoding an audio signal using side information, and an encoder and a decoder for performing the methods. The method of encoding an audio signal using side information includes identifying an input signal, the input signal being an original audio signal, extracting side information from the input signal using a learning model trained to extract side information from a feature vector of the input signal, encoding the input signal, and generating a bitstream by combining the encoded input signal and the side information.Type: GrantFiled: November 16, 2021Date of Patent: October 10, 2023Assignees: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, GWANGJU INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Woo-taek Lim, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Inseon Jang, Jong Won Shin, Soojoong Hwang, Youngju Cheon, Sangwook Han
-
Publication number: 20230317089Abstract: An encoding method, a decoding method, an encoder for performing the encoding method, and a decoder for performing the decoding method are provided. The encoding method includes outputting LP coefficients bitstream and a residual signal by performing an LP analysis on an input signal, outputting a first latent signal obtained by encoding a periodic component of the residual signal, a second latent signal obtained by encoding a non-periodic component of the residual signal, and a weight vector for each of the first latent signal and the second latent signal, using a first neural network module, and outputting a first bitstream obtained by quantizing the first latent signal, a second bitstream obtained by quantizing the second latent signal, and a weight bitstream obtained by quantizing the weight vector, using a quantization module.Type: ApplicationFiled: January 31, 2023Publication date: October 5, 2023Applicant: Electronics and Telecommunications Research InstituteInventors: Jongmo SUNG, Seung Kwon BEACK, Tae Jin LEE, Woo-taek LIM, Inseon JANG, Byeongho CHO
-
Publication number: 20230298599Abstract: An encoding method and an encoding device using a complex signal and a decoding method and a decoding device using a complex signal are provided. The encoding method includes converting a first channel signal and a second channel signal constituting an audio signal corresponding to a stereo signal from a real domain to a complex domain, determining one of a sum operation, a difference operation, and a bypass operation to be performed on the second channel signal converted to the complex domain, determining a complex spatial cue according to the determined operation, converting a residual signal for the second channel signal to a real domain using the complex spatial cue, converting the first channel signal to a real domain, encoding the first channel signal converted to the real domain, and encoding the residual signal for the second channel signal converted to the real domain.Type: ApplicationFiled: June 12, 2023Publication date: September 21, 2023Applicant: Electronics and Telecommunications Research InstituteInventors: Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Woo-taek LIM, Inseon JANG, Byeongho CHO
-
Publication number: 20230274141Abstract: Provided is a method and apparatus for designing and testing an audio codec using quantization based on white noise modeling. A neural network-based audio encoder design method includes generating a quantized latent vector and a reconstructed signal corresponding to an input signal by using a white noise modeling-based quantization process, computing a total loss for training a neural network-based audio codec, based on the input signal, the reconstruction signal, and the quantized latent vector, training the neural network-based audio codec by using the total loss, and validating the trained neural network-based audio codec to select the best neural network-based audio codec.Type: ApplicationFiled: February 8, 2023Publication date: August 31, 2023Inventors: Jongmo SUNG, Seung Kwon BEACK, Tae Jin LEE, Woo-taek LIM, Inseon JANG, Byeongho CHO, Young Cheol PARK, Joon BYUN, Seungmin SHIN
-
Publication number: 20230245666Abstract: Provided are an encoding method, an encoding device, a decoding method, and a decoding device using a scalar quantization and a vector quantization. The encoding method includes converting an input signal of a time domain into a frequency domain, generating a first residual signal from an input signal of a frequency domain by using a scale factor, performing a scalar quantization of the first residual signal, generating a second residual signal from the scalar-quantized first residual signal, performing a lossless encoding of the scalar-quantized first residual signal, performing a vector quantization of the second residual signal, and transmitting a bitstream including the lossless-encoded first residual signal and the vector-quantized second residual signal.Type: ApplicationFiled: January 27, 2023Publication date: August 3, 2023Applicant: Electronics and Telecommunications Research InstituteInventors: Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Woo-taek LIM, Inseon JANG, Byeongho CHO
-
Publication number: 20230230604Abstract: A method of encoding an audio signal and an encoder and a method of decoding an audio signal and a decoder are provided. The method of encoding an audio signal includes outputting a decoded signal by using a bitstream that encodes an audio signal, separating the decoded signal into a low-band signal and a high-band signal by using a sound source separator, upsampling the low-band signal, upsampling the high-band signal, and restoring the audio signal by synthesizing the upsampled low-band signal with the upsampled high-band signal, wherein the bitstream is generated by encoding a superimposed signal in which a signal in a high frequency band of the audio signal is superimposed on a low frequency band of the audio signal.Type: ApplicationFiled: January 19, 2023Publication date: July 20, 2023Applicants: Electronics and Telecommunications Research Institute, Gwangju Institute of Science and TechnologyInventors: Inseon JANG, Tae Jin LEE, Seung Kwon BEACK, Jongmo SUNG, Woo-taek LIM, Byeongho CHO, Jongwon SHIN, Soojoong HWANG, Eunkyun LEE, Youngwon CHOI, Sangwook HAN
-
Patent number: 11694703Abstract: An audio signal encoding and decoding method using a learning model, a training method of the learning model, and an encoder and decoder that perform the method, are disclosed. The audio signal decoding method may include extracting a first residual signal and a first linear prediction coefficient by decoding a bitstream received from an encoder, generating a first audio signal from the first residual signal using the first linear prediction coefficient, generating a second linear prediction coefficients and a second residual signal from the first audio signal, obtaining a third linear prediction coefficient by inputting the second linear prediction coefficient into a trained learning model, and generating a second audio signal from the second residual signal using the third linear prediction coefficient.Type: GrantFiled: February 15, 2022Date of Patent: July 4, 2023Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Woo-taek Lim, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Inseon Jang
-
Patent number: 11664037Abstract: Methods of encoding and decoding a speech signal using a neural network model that recognizes sound sources, and encoding and decoding apparatuses for performing the methods are provided. A method of encoding a speech signal includes identifying an input signal for a plurality of sound sources; generating a latent signal by encoding the input signal; obtaining a plurality of sound source signals by separating the latent signal for each of the plurality of sound sources; determining a number of bits used for quantization of each of the plurality of sound source signals according to a type of each of the plurality of sound sources; quantizing each of the plurality of sound source signals based on the determined number of bits; and generating a bitstream by combining the plurality of quantized sound source signals.Type: GrantFiled: May 20, 2021Date of Patent: May 30, 2023Assignees: Electronics and Telecommunications Research Institute, The Trustees of Indiana UniversityInventors: Woo-taek Lim, Seung Kwon Beack, Jongmo Sung, Mi Suk Lee, Tae Jin Lee, Inseon Jang, Minje Kim, Haici Yang
-
Patent number: 11651778Abstract: Disclosed are methods of encoding and decoding an audio signal, and an encoder and a decoder for performing the methods. The method of encoding an audio signal includes identifying an input signal corresponding to a low frequency band of the audio signal, windowing the input signal, generating a first latent vector by inputting the windowed input signal to a first encoding model, transforming the windowed input signal into a frequency domain, generating a second latent vector by inputting the transformed input signal to a second encoding model, generating a final latent vector by combining the first latent vector and the second latent vector, and generating a bitstream corresponding to the final latent vector.Type: GrantFiled: November 8, 2021Date of Patent: May 16, 2023Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Woo-taek Lim, Seung Kwon Beack, Jongmo Sung, Tae Jin Lee, Inseon Jang, Jong-Won Seok, Yunsu Kim
-
Publication number: 20230048402Abstract: Provided is an encoding method according to various example embodiments and an encoder performing the method. The encoding method includes outputting a linear prediction(LP) coefficients bitstream and a residual signal by performing a linear prediction analysis on an input signal, outputting a first latent signal obtained by encoding a periodic component of the residual signal, using a first neural network module, outputting a first bitstream obtained by quantizing the first latent signal, using a quantization module, outputting a second latent signal obtained by encoding an aperiodic component of the residual signal, using the first neural network module, and outputting a second bitstream obtained by quantizing the second latent signal, using the quantization module, wherein the aperiodic component of the residual signal is calculated based on a periodic component of the residual signal decoded from the quantized first latent signal output by de-quantizing the first bitstream.Type: ApplicationFiled: August 9, 2022Publication date: February 16, 2023Inventors: Jongmo SUNG, Seung Kwon BEACK, Tae Jin LEE, Woo-taek KIM, Inseon JANG
-
Patent number: 11580999Abstract: An audio signal encoding method performed by an encoder includes identifying an audio signal of a time domain in units of a block, generating a combined block by combining i) a current original block of the audio signal and ii) a previous original block chronologically adjacent to the current original block, extracting a first residual signal of a frequency domain from the combined block using linear predictive coding of a time domain, overlapping chronologically adjacent first residual signals among first residual signals converted into a time domain, and quantizing a second residual signal of a time domain extracted from the overlapped first residual signal by converting the second residual signal of the time domain into a frequency domain using linear predictive coding of a frequency domain.Type: GrantFiled: May 26, 2021Date of Patent: February 14, 2023Assignee: Electronics and Telecommunications Research InstituteInventors: Seung Kwon Beack, Jongmo Sung, Mi Suk Lee, Tae Jin Lee, Woo-taek Lim, Inseon Jang
-
Patent number: 11581000Abstract: Disclosed is an apparatus and method for encoding/decoding an audio signal using information of a previous frame. An audio signal encoding method includes: generating a current latent vector by reducing dimension of a current frame of an audio signal; generating a concatenation vector by concatenating a previous latent vector generated by reducing dimension of a previous frame of the audio signal with the current latent vector; and encoding and quantizing the concatenation vector.Type: GrantFiled: November 27, 2020Date of Patent: February 14, 2023Assignee: Electronics and Telecommunications Research InstituteInventors: Woo-Taek Lim, Seung Kwon Beack, Jongmo Sung, Mi Suk Lee, Tae Jin Lee
-
Publication number: 20230039546Abstract: An audio encoding/decoding apparatus and method using vector quantized residual error features are disclosed. An audio signal encoding method includes outputting a bitstream of a main codec by encoding an original signal, decoding the bitstream of the main codec, determining a residual error feature vector from a feature vector of a decoded signal and a feature vector of the original signal, and outputting a bitstream of additional information by encoding the residual error feature vector.Type: ApplicationFiled: April 1, 2022Publication date: February 9, 2023Inventors: Inseon JANG, Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Woo-taek LIM, Jongwon SHIN, Youngju CHEON, Sangwook HAN, Soojoong HWANG
-
Publication number: 20230038394Abstract: Disclosed are a method of encoding and decoding an audio signal and an encoder and a decoder performing the method. The method of encoding an audio signal includes identifying an input signal, and generating a bitstring of each encoding layer by applying, to the input signal, an encoding model including a plurality of successive encoding layers that encodes the input signal, in which a current encoding layer among the encoding layers is trained to generate a bitstring of the current encoding layer by encoding an encoded signal which is a signal encoded in a previous encoding layer and quantizing an encoded signal which is a signal encoded in the current encoding layer.Type: ApplicationFiled: July 30, 2021Publication date: February 9, 2023Inventors: Woo-taek LIM, Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Inseon JANG, Minje KIM
-
Patent number: 11562757Abstract: An audio signal encoding method performed by an encoder includes identifying a time-domain audio signal in a unit of blocks, quantizing a linear prediction coefficient extracted from a combined block in which a current original block of the audio signal and a previous original block chronologically adjacent to the current original block using frequency-domain linear predictive coding (LPC), generating a temporal envelope by dequantizing the quantized linear prediction coefficient, extracting a residual signal from the combined block based on the temporal envelope, quantizing the residual signal by one of time-domain quantization and frequency-domain quantization, and transforming the quantized residual signal and the quantized linear prediction coefficient into a bitstream.Type: GrantFiled: July 15, 2021Date of Patent: January 24, 2023Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Seung Kwon Beack, Jongmo Sung, Mi Suk Lee, Tae Jin Lee, Woo-taek Lim, Inseon Jang, Jin Soo Choi
-
Publication number: 20220375483Abstract: Disclosed are methods of encoding and decoding an audio signal, and an encoder and a decoder for performing the methods. The method of encoding an audio signal includes identifying an input signal corresponding to a low frequency band of the audio signal, windowing the input signal, generating a first latent vector by inputting the windowed input signal to a first encoding model, transforming the windowed input signal into a frequency domain, generating a second latent vector by inputting the transformed input signal to a second encoding model, generating a final latent vector by combining the first latent vector and the second latent vector, and generating a bitstream corresponding to the final latent vector.Type: ApplicationFiled: November 8, 2021Publication date: November 24, 2022Inventors: Woo-taek LIM, Seung Kwon BEACK, Jongmo SUNG, Tae Jin LEE, Inseon JANG, Jong-won SEOK, YUNSU KIM