Patents by Inventor Mun-churl Kim
Mun-churl Kim has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11968472Abstract: Disclosed are an image processing method and device using a line-wise operation. The image processing device, according to one embodiment, comprises: a receiver for receiving an image; at least one first line buffer for outputting the image into a line-wise image line; a first convolution operator for generating a feature map by performing a convolution operation on the basis of the output from the first line buffer; and a feature map processor for storing the output from the first convolution operator in units of at least one line, and processing so as to output the feature map stored in units of at least one line into a two-dimensional form, wherein at least one convolution operation operates in the form of a pipeline.Type: GrantFiled: December 12, 2018Date of Patent: April 23, 2024Assignee: Korea Advanced Institute of Science and TechnologyInventors: Mun Churl Kim, Yong Woo Kim, Jae Seok Choi
-
Patent number: 11962937Abstract: Disclosed are an image processing method and device using a line-wise operation. The image processing device, according to one embodiment, comprises: a receiver for receiving an image; a first convolution operator for generating a feature map by performing a convolution operation on the basis of the image; and a compressor for compressing the feature map into units of at least one line; and a decompressor for reconstructing the feature map compressed into units of lines.Type: GrantFiled: December 26, 2022Date of Patent: April 16, 2024Assignee: Korea Advanced Institute of Science and TechnologyInventors: Mun Churl Kim, Yong Woo Kim, Jae Seok Choi
-
Patent number: 11956569Abstract: Disclosed are an image processing method and device using a line-wise operation. The image processing device, according to one embodiment, comprises: a receiver for receiving an image; at least one first line buffer for outputting the image into a line-wise image line; a first convolution operator for generating a feature map by performing a convolution operation on the basis of the output from the first line buffer; and a feature map processor for storing the output from the first convolution operator in units of at least one line, and processing so as to output the feature map stored in units of at least one line into a two-dimensional form, wherein at least one convolution operation operates in the form of a pipeline.Type: GrantFiled: December 26, 2022Date of Patent: April 9, 2024Assignee: Korea Advanced Institute of Science and TechnologyInventors: Mun Churl Kim, Yong Woo Kim, Jae Seok Choi
-
Patent number: 11790500Abstract: In this invention, we propose a convolutional neural network (CNN) based architecture designed for the ITM to HDR consumer displays, called ITM-CNN, and its training strategy for enhancing the performance based on image decomposition using the guided filter. We demonstrate the benefits of decomposing the image by experimenting with various architectures and also compare the performance for different training strategies. To the best of our knowledge, this invention first presents the ITM problem using CNNs for HDR consumer displays, where the network is trained to restore lost details and local contrast. Our ITM-CNN can readily up-convert LDR images for direct viewing on an HDR consumer medium, and is a very powerful means to solve the lack of HDR video contents with legacy LDR videos.Type: GrantFiled: September 23, 2021Date of Patent: October 17, 2023Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Mun Churl Kim, Soo Ye Kim, Dae Eun Kim
-
Publication number: 20230308673Abstract: Disclosed decoding method of the intra prediction mode comprises the steps of: determining whether an intra prediction mode of a present prediction unit is the same as a first candidate intra prediction mode or as a second candidate intra prediction mode on the basis of 1-bit information; and determining, among said first candidate intra prediction mode and said second candidate intra prediction mode, which candidate intra prediction mode is the same as the intra prediction mode of said present prediction unit on the basis of additional 1-bit information, if the intra prediction mode of the present prediction unit is the same as at least either the first candidate intra prediction mode or the second candidate intra prediction mode, and decoding the intra prediction mode of the present prediction unit.Type: ApplicationFiled: June 1, 2023Publication date: September 28, 2023Applicants: Electronics and Telecommunications Research Institute, KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Jong Ho KIM, Hui Yong KIM, Se Yoon JEONG, Sung Chang LIM, Ha Hyun LEE, Jin Ho LEE, Suk Hee CHO, Jin Soo CHOI, Jin Woong KIM, Chie Teuk AHN, Mun Churl KIM, Bum Shik LEE
-
Publication number: 20230276023Abstract: Disclosed are an image processing method and device using a line-wise operation. The image processing device, according to one embodiment, comprises: a receiver for receiving an image; at least one first line buffer for outputting the image into a line-wise image line; a first convolution operator for generating a feature map by performing a convolution operation on the basis of the output from the first line buffer; and a feature map processor for storing the output from the first convolution operator in units of at least one line, and processing so as to output the feature map stored in units of at least one line into a two-dimensional form, wherein at least one convolution operation operates in the form of a pipeline.Type: ApplicationFiled: December 26, 2022Publication date: August 31, 2023Applicant: Korea Advanced Institute of Science and TechnologyInventors: Mun Churl KIM, Yong Woo KIM, Jae Seok CHOI
-
Publication number: 20230247229Abstract: Disclosed are a method of encoding a division block in video encoding and a method of decoding a division block in video decoding. An input picture is divided into encoding unit blocks. The encoding unit blocks are divided into sub-blocks. The sub-blocks are encoded by selectively using at least one of intra prediction encoding and inter prediction encoding. A decoding process is performed through a reverse process of the encoding method. When pixel values of an encoding unit block are encoded in video encoding, the flexibility in selecting an encoding mode is increased and the efficiency of encoding is increased.Type: ApplicationFiled: April 11, 2023Publication date: August 3, 2023Applicants: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY, KOREAN BROADCASTING SYSTEMInventors: Mun Churl KIM, Bum Shik LEE, Jae Il KIM, Chang Seob PARK, Sang Jin HAHM, In Joon CHO, Keun Sik LEE, Byung Sun KIM
-
Patent number: 11706430Abstract: Disclosed decoding method of the intra prediction mode comprises the steps of: determining whether an intra prediction mode of a present prediction unit is the same as a first candidate intra prediction mode or as a second candidate intra prediction mode on the basis of 1-bit information; and determining, among said first candidate intra prediction mode and said second candidate intra prediction mode, which candidate intra prediction mode is the same as the intra prediction mode of said present prediction unit on the basis of additional 1-bit information, if the intra prediction mode of the present prediction unit is the same as at least either the first candidate intra prediction mode or the second candidate intra prediction mode, and decoding the intra prediction mode of the present prediction unit.Type: GrantFiled: December 2, 2021Date of Patent: July 18, 2023Assignees: Electronics and Telecommunications Research Institute, KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Jong Ho Kim, Hui Yong Kim, Se Yoon Jeong, Sung Chang Lim, Ha Hyun Lee, Jin Ho Lee, Suk Hee Cho, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn, Mun Churl Kim, Bum Shik Lee
-
Publication number: 20230216986Abstract: Disclosed are an image processing method and device using a line-wise operation. The image processing device, according to one embodiment, comprises: a receiver for receiving an image; a first convolution operator for generating a feature map by performing a convolution operation on the basis of the image; and a compressor for compressing the feature map into units of at least one line; and a decompressor for reconstructing the feature map compressed into units of lines.Type: ApplicationFiled: December 26, 2022Publication date: July 6, 2023Applicant: Korea Advanced Institute of Science and TechnologyInventors: Mun Churl KIM, Yong Woo KIM, Jae Seok CHOI
-
Patent number: 11659210Abstract: Disclosed are a method of encoding a division block in video encoding and a method of decoding a division block in video decoding. An input picture is divided into encoding unit blocks. The encoding unit blocks are divided into sub-blocks. The sub-blocks are encoded by selectively using at least one of intra prediction encoding and inter prediction encoding. A decoding process is performed through a reverse process of the encoding method. When pixel values of an encoding unit block are encoded in video encoding, the flexibility in selecting an encoding mode is increased and the efficiency of encoding is increased.Type: GrantFiled: June 29, 2021Date of Patent: May 23, 2023Assignees: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY, KOREAN BROADCASTING SYSTEMInventors: Mun Churl Kim, Bum Shik Lee, Jae II Kim, Chang Seob Park, Sang Jin Hahm, In Joon Cho, Keun Sik Lee, Byung Sun Kim
-
Publication number: 20230134212Abstract: Disclosed according to one exemplary embodiment includes not limited to: a filtering unit configured to generate filtering information by filtering a residual image corresponding to a difference between an original image and a prediction image; an inverse filtering unit configured to generate inverse filtering information by inversely filtering the filtering information; an estimator configured to generate the prediction image based on the original image and reconstruction information; a CNN-based in-loop filter configured to receive the inverse filtering information and the prediction image and to output the reconstruction information; and an encoder configured to perform encoding based on the filtering information and information of the prediction image, and wherein the CNN-based in-loop filter is trained for each of the plurality of artefact sections according to an artefact value or for each of the plurality of quantization parameter sections according to a quantization parameter.Type: ApplicationFiled: December 26, 2022Publication date: May 4, 2023Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventor: Mun Churl KIM
-
Patent number: 11627316Abstract: Disclosed according to one exemplary embodiment includes not limited to: a filtering unit configured to generate filtering information by filtering a residual image corresponding to a difference between an original image and a prediction image; an inverse filtering unit configured to generate inverse filtering information by inversely filtering the filtering information; an estimator configured to generate the prediction image based on the original image and reconstruction information; a CNN-based in-loop filter configured to receive the inverse filtering information and the prediction image and to output the reconstruction information; and an encoder configured to perform encoding based on the filtering information and information of the prediction image, and wherein the CNN-based in-loop filter is trained for each of the plurality of artefact sections according to an artefact value or for each of the plurality of quantization parameter sections according to a quantization parameter.Type: GrantFiled: July 15, 2021Date of Patent: April 11, 2023Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventor: Mun Churl Kim
-
Patent number: 11610283Abstract: Provided are a method and an apparatus for performing scalable video decoding, wherein the method and the apparatus down-sample input video, determine the down-sampled input video as base layer video, generate prediction video for enhancement layer video by applying an up-scaling filter to the base layer video, and code the base layer video and the prediction video, wherein the up-scaling filter is a convolution filter of a deep neural network.Type: GrantFiled: March 27, 2020Date of Patent: March 21, 2023Assignee: AGENCY FOR DEFENSE DEVELOPMENTInventors: Ju Hyun Jung, Dong Hyun Kim, No Hyeok Park, Jeung Won Choi, Dae Eun Kim, Se Hwan Ki, Mun Churl Kim, Ki Nam Jun, Seung Ho Baek, Jong Hwan Ko
-
Publication number: 20220366538Abstract: Disclosed are a video processing method and a device therefor. The video processing method may include receiving a video comprising a plurality of temporal portions, receiving a first model parameter corresponding to a first neural network to process the video entirely, receiving residues between the first model parameter and a plurality of second model parameters corresponding to a plurality of second neural networks to process the plurality of temporal portions, and performing at least one of super-resolution, reverse or inverse tone mapping, tone mapping, frame interpolation, motion deblurring, denoising, and compression artifact removal on the video based on the residues.Type: ApplicationFiled: July 3, 2020Publication date: November 17, 2022Applicant: Korea Advanced Institute of Science and TechnologyInventors: Mun Churl KIM, Se Hwan KI
-
Patent number: 11412175Abstract: An image processing method and apparatus using a line unit operation is disclosed. The image processing apparatus includes a receiver configured to receive an image, at least one first line buffer configured to output the received image to be an image line of a line unit, a first convolution operator configured to generate a feature map by performing a convolution operation based on the output image line, and a feature map processor configured to store the generated feature map as at least one line unit and process the feature map stored as the line unit to be output in a two-dimensional (2D) or higher dimensional form.Type: GrantFiled: December 12, 2018Date of Patent: August 9, 2022Assignee: Korea Advanced Institute of Science and TechnologyInventors: Mun Churl Kim, Yong Woo Kim, Jae Seok Choi
-
Publication number: 20220094958Abstract: Disclosed decoding method of the intra prediction mode comprises the steps of: determining whether an intra prediction mode of a present prediction unit is the same as a first candidate intra prediction mode or as a second candidate intra prediction mode on the basis of 1-bit information; and determining, among said first candidate intra prediction mode and said second candidate intra prediction mode, which candidate intra prediction mode is the same as the intra prediction mode of said present prediction unit on the basis of additional 1-bit information, if the intra prediction mode of the present prediction unit is the same as at least either the first candidate intra prediction mode or the second candidate intra prediction mode, and decoding the intra prediction mode of the present prediction unit.Type: ApplicationFiled: December 2, 2021Publication date: March 24, 2022Applicants: Electronics and Telecommunications Research Institute, KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Jong Ho KIM, Hui Yong KIM, Se Yoon JEONG, Sung Chang LIM, Ha Hyun LEE, Jin Ho LEE, Suk Hee CHO, Jin Soo CHOI, Jin Woong KIM, Chie Teuk AHN, Mun Churl KIM, Bum Shik LEE
-
Publication number: 20220012855Abstract: In this invention, we propose a convolutional neural network (CNN) based architecture designed for the ITM to HDR consumer displays, called ITM-CNN, and its training strategy for enhancing the performance based on image decomposition using the guided filter. We demonstrate the benefits of decomposing the image by experimenting with various architectures and also compare the performance for different training strategies. To the best of our knowledge, this invention first presents the ITM problem using CNNs for HDR consumer displays, where the network is trained to restore lost details and local contrast. Our ITM-CNN can readily up-convert LDR images for direct viewing on an HDR consumer medium, and is a very powerful means to solve the lack of HDR video contents with legacy LDR videos.Type: ApplicationFiled: September 23, 2021Publication date: January 13, 2022Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Mun Churl KIM, Soo Ye KIM, Dae Eun KIM
-
Patent number: 11223839Abstract: Disclosed decoding method of the intra prediction mode comprises the steps of: determining whether an intra prediction mode of a present prediction unit is the same as a first candidate intra prediction mode or as a second candidate intra prediction mode on the basis of 1-bit information; and determining, among said first candidate intra prediction mode and said second candidate intra prediction mode, which candidate intra prediction mode is the same as the intra prediction mode of said present prediction unit on the basis of additional 1-bit information, if the intra prediction mode of the present prediction unit is the same as at least either the first candidate intra prediction mode or the second candidate intra prediction mode, and decoding the intra prediction mode of the present prediction unit.Type: GrantFiled: April 24, 2020Date of Patent: January 11, 2022Assignees: Electronics and Telecommunications Research Institute, KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Jong Ho Kim, Hui Yong Kim, Se Yoon Jeong, Sung Chang Lim, Ha Hyun Lee, Jin Ho Lee, Suk Hee Cho, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn, Mun Churl Kim, Bum Shik Lee
-
Publication number: 20210366081Abstract: An image processing method and apparatus using a line unit operation is disclosed. The image processing apparatus includes a receiver configured to receive an image, at least one first line buffer configured to output the received image to be an image line of a line unit, a first convolution operator configured to generate a feature map by performing a convolution operation based on the output image line, and a feature map processor configured to store the generated feature map as at least one line unit and process the feature map stored as the line unit to be output in a two-dimensional (2D) form.Type: ApplicationFiled: December 12, 2018Publication date: November 25, 2021Applicant: Korea Advanced Institute of Science and TechnologyInventors: Mun Churl KIM, Yong Woo KIM, Jae Seok CHOI
-
Publication number: 20210344916Abstract: Disclosed according to one exemplary embodiment includes not limited to: a filtering unit configured to generate filtering information by filtering a residual image corresponding to a difference between an original image and a prediction image; an inverse filtering unit configured to generate inverse filtering information by inversely filtering the filtering information; an estimator configured to generate the prediction image based on the original image and reconstruction information; a CNN-based in-loop filter configured to receive the inverse filtering information and the prediction image and to output the reconstruction information; and an encoder configured to perform encoding based on the filtering information and information of the prediction image, and wherein the CNN-based in-loop filter is trained for each of the plurality of artefact sections according to an artefact value or for each of the plurality of quantization parameter sections according to a quantization parameter.Type: ApplicationFiled: July 15, 2021Publication date: November 4, 2021Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventor: Mun Churl KIM