Patents by Inventor Hwa-sup Lim
Hwa-sup Lim has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10251556Abstract: Provided is an in vivo bioimaging method including irradiating near-infrared (NIR) light onto a living body, converting the NIR light passed through the living body, into visible light using upconversion nanoparticles (UCNPs), and generating a bioimage of the living body by receiving the visible light using a complementary metal-oxide-semiconductor (CMOS) image sensor.Type: GrantFiled: July 31, 2017Date of Patent: April 9, 2019Assignees: Korea Institute of Science an Technology, Center of Human-Centered Interaction for CoexistenceInventors: Hwa Sup Lim, Seok Joon Kwon, Sang Chul Ahn, Bum Jae You
-
Patent number: 10210653Abstract: A method and apparatus to generate a volume-panorama image are provided. A method of generating a volume-panorama image includes receiving conversion relationships between volume images, one of the received conversion relationships being between a first volume image of the volume images and a second volume image of the volume images, the second volume image including an area that is common to an area of the first volume image, generating an optimized conversion relationship from the one of the received conversion relationships based on the received conversion relationships, and generating the volume-panorama image based on the generated optimized conversion relationship.Type: GrantFiled: May 9, 2016Date of Patent: February 19, 2019Assignee: Samsung Electronics Co., Ltd.Inventors: Ouk Choi, Hwa-sup Lim, Jung-ho Kim, Do-kyoon Kim
-
Publication number: 20180055367Abstract: Provided is an in vivo bioimaging method including irradiating near-infrared (NIR) light onto a living body, converting the NIR light passed through the living body, into visible light using upconversion nanoparticles (UCNPs), and generating a bioimage of the living body by receiving the visible light using a complementary metal-oxide-semiconductor (CMOS) image sensor.Type: ApplicationFiled: July 31, 2017Publication date: March 1, 2018Applicants: KOREA INSTITUTE OF SCIENCE AND TECHNOLOGY, CENTER OF HUMAN-CENTERED INTERACTION FOR COEXISTENCEInventors: Hwa Sup LIM, Seok Joon KWON, Sang Chul AHN, Bum Jae YOU
-
Patent number: 9471963Abstract: A depth noise filtering method and apparatus is provided. The depth noise filtering method may perform spatial filtering or temporal filtering according to depth information. In order to perform spatial filtering, the depth noise filtering method may determine a characteristic of a spatial filter based on depth information. Also, in order to perform temporal filtering, the depth noise filtering method may determine a number of reference frames based on depth information. The depth noise filtering method may adaptively remove depth noise according to depth information and thereby enhance a noise filtering performance.Type: GrantFiled: May 7, 2014Date of Patent: October 18, 2016Assignee: Samsung Electronics Co., Ltd.Inventors: Byong Min Kang, Hwa Sup Lim
-
Publication number: 20160267706Abstract: A method and apparatus to generate a volume-panorama image are provided. A method of generating a volume-panorama image includes receiving conversion relationships between volume images, one of the received conversion relationships being between a first volume image of the volume images and a second volume image of the volume images, the second volume image including an area that is common to an area of the first volume image, generating an optimized conversion relationship from the one of the received conversion relationships based on the received conversion relationships, and generating the volume-panorama image based on the generated optimized conversion relationship.Type: ApplicationFiled: May 9, 2016Publication date: September 15, 2016Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Ouk CHOI, Hwa-sup LIM, Jung-ho KIM, Do-kyoon KIM
-
Patent number: 9412157Abstract: Provided are an apparatus and a method for high speed filtering of an image for high precision that may include a coordinate determining unit to determine coordinates (P,Q) on a screen with respect to a first pixel to be filtered, a pixel determining unit to determine a second pixel with coordinates including either P or Q, a block setting unit to set a first block comprising the first pixel, and a second block comprising the second pixel, and a processing unit to filter the first pixel by comparing the first block and the second block.Type: GrantFiled: June 13, 2011Date of Patent: August 9, 2016Assignee: SAMSUNG ELECTRONICS, CO., LTD.Inventors: Yong Sun Kim, Hwa Sup Lim, Kee Chang Lee
-
Patent number: 9378583Abstract: An apparatus and method for bidirectionally inpainting an occlusion area appearing during generation of a virtual viewpoint image, using a foreground area and a background area based on a predicted volume are provided. The method includes receiving an input of a depth image and a color image, the depth image having depth information for a first viewpoint, and the color image having color information for the first viewpoint, generating a virtual viewpoint image at a second viewpoint based on the depth image and the color image, separating the virtual viewpoint image into a foreground area and a background area, based on the depth information and direction information regarding a direction from the first viewpoint to the second viewpoint, predicting a three-dimensional (3D) volume of the foreground area, and inpainting an occlusion area bidirectionally using the foreground area and the background area, based on the predicted 3D volume, the occlusion area being included in the virtual viewpoint image.Type: GrantFiled: April 14, 2011Date of Patent: June 28, 2016Assignee: Samsung Electronics Co., Ltd.Inventors: Seung Kyu Lee, Hwa Sup Lim, Kee Chang Lee, Do Kyoon Kim
-
Patent number: 9369696Abstract: A first calculator of an image processing apparatus may trace a view transform vector between color images of different frames. A second calculator may trace a view transform vector between depth images of different frames. In this example, a third calculator may calculate a view transform vector between the color camera and the depth camera using the view transform vector between the color images and the view transform vector between the depth images.Type: GrantFiled: February 18, 2011Date of Patent: June 14, 2016Assignee: SAMSUNG ELECTRONICS CO., LTDInventors: Seung Kyu Lee, Hwa Sup Lim, Kee Chang Lee, Ouk Choi
-
Patent number: 9350925Abstract: An image processing apparatus may include a sensor unit which generates both a color image and a depth image. A color-depth time difference correcting unit may correct a mismatching that occurs due to a time difference between a point in time when the color image is generated and a point in time when the depth image is generated. An image generator may generate a stereoscopic image or a multi-view image using the color image and the depth image after the mismatching is corrected.Type: GrantFiled: October 24, 2012Date of Patent: May 24, 2016Assignee: Samsung Electronics Co., Ltd.Inventors: Hwa Sup Lim, Byong Min Kang, Yong Sun Kim, Kee Chang Lee, Ouk Choi
-
Patent number: 9258548Abstract: Provided is a depth image generating apparatus. The depth image generating apparatus may include a filtering unit, a modulation unit, and a sensing unit. The filtering unit may band pass filter an infrared light of a first wavelength band among infrared lights received from an object. The modulation unit may modulate the infrared light of the first wavelength band to an infrared light of a second wavelength band. The sensing unit may generate an electrical signal by sensing the modulated infrared light of the second wavelength band.Type: GrantFiled: May 27, 2011Date of Patent: February 9, 2016Assignee: Samsung Electronics Co., Ltd.Inventors: Sung Cheol Kim, Hwa Sup Lim, Kassou Ahmad Ramez
-
Patent number: 9210398Abstract: A method and apparatus for temporally interpolating a three-dimensional (3D) depth image are provided to generate an intermediate depth image in a desired time. The apparatus may interpolate depth images generated by a depth camera, using a temporal interpolation procedure, may generate an intermediate depth image in a new time using the interpolated depth images, and may combine the generated intermediate depth image with color images, to generate a high-precision 3D image.Type: GrantFiled: April 18, 2011Date of Patent: December 8, 2015Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Seung Kyu Lee, Hwa Sup Lim, Do Kyoon Kim, Kee Chang Lee
-
Patent number: 9135521Abstract: An image processing apparatus and method are provided. A control unit may divide input image array data into a plurality of sub-blocks, and a first arithmetic logic unit (ALU) may generate an integral image of at least one of the plurality of sub-blocks. The control unit may determine each of the plurality of sub-blocks to be included in any one of a first sub-block group and a second sub-block group, store the integral image of each sub-block included in the first sub-block group on the first memory, and store the integral image of each sub-block included in the second sub-block group on the second memory.Type: GrantFiled: April 29, 2009Date of Patent: September 15, 2015Assignees: Samsung Electronics Co., Ltd., Korea Advanced Institute of Science and TechnologyInventors: Hwa Sup Lim, Kee Chang Lee, Byong-Min Kang, In Cheol Park, Jeong Ho Han, Hye Yeon Shim
-
Patent number: 9105082Abstract: A high speed filtering apparatus and a method for high precision restoration of a depth image are provided. The high speed filtering apparatus for high precision restoration of the depth image may include a block setting unit to set a first block including a target pixel, and to set a second block with respect to a central pixel distributed around the target pixel based on a size of the first block, a weight determining unit to determine a pixel weight with respect to each pixel in the second block, and to determine a block weight with respect to the second block by applying the pixel weight, and a processor to filter the target pixel based on the block weight, thereby accurately filtering the target pixel.Type: GrantFiled: August 8, 2011Date of Patent: August 11, 2015Assignee: Samsung Electronics Co., Ltd.Inventors: Yong Sun Kim, Hwa Sup Lim, Kee Chang Lee
-
Patent number: 9047681Abstract: Provided are an apparatus and method for converting a low-resolution depth image to a depth image having a resolution identical to a resolution of a high-resolution color image. The depth image conversion apparatus may generate a discrete depth image by quantizing a depth value of an up-sampled depth image, estimate a high-resolution discrete depth image by optimizing an objective functions of the discrete depth image based on the high-resolution color image and an up-sampled depth border, and convert the up-sampled depth image to a high-resolution depth image by filtering the up-sampled depth image when a difference between discrete depth values of neighboring pixels in the high-resolution discrete depth image is less than a predetermined threshold value.Type: GrantFiled: May 8, 2012Date of Patent: June 2, 2015Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Ouk Choi, Hwa Sup Lim, Kee Chang Lee
-
Patent number: 9013482Abstract: Disclosed is a mesh generating apparatus, method and computer-readable medium, and an image processing apparatus, method and computer-readable medium. A single 3D mesh and a single 3D object model may be generated using a single color image and a single depth image. A plurality of viewpoint images seen from a plurality of viewpoints may be generated from a single 3D object model.Type: GrantFiled: November 16, 2010Date of Patent: April 21, 2015Assignee: Samsung Electronics Co., Ltd.Inventors: Hwa Sup Lim, Yong Sun Kim, Seung Kyu Lee, Kee Chang Lee, Ouk Choi
-
Patent number: 8885920Abstract: An image processing apparatus is provided. A silhouette extractor may extract a silhouette image of a target object from an input depth image. A first calculator may determine a location of at least one limb of the target object and a location of at least one joint connecting the at least one limb by applying a rectangle fitting algorithm with respect to the silhouette image.Type: GrantFiled: September 22, 2010Date of Patent: November 11, 2014Assignee: Samsung Electronics Co., Ltd.Inventors: Hwa Sup Lim, Byong Min Kang
-
Publication number: 20140241644Abstract: A depth noise filtering method and apparatus is provided. The depth noise filtering method may perform spatial filtering or temporal filtering according to depth information. In order to perform spatial filtering, the depth noise filtering method may determine a characteristic of a spatial filter based on depth information. Also, in order to perform temporal filtering, the depth noise filtering method may determine a number of reference frames based on depth information. The depth noise filtering method may adaptively remove depth noise according to depth information and thereby enhance a noise filtering performance.Type: ApplicationFiled: May 7, 2014Publication date: August 28, 2014Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Byong Min KANG, Hwa Sup LIM
-
Patent number: 8810602Abstract: Provided is an image processing apparatus, medium, and method. The image processing apparatus may include a first calculator and a second calculator. The first calculator may calculate a first weight of a first frame depth value of a first pixel of a depth image and a second weight of a second frame depth value of the first pixel, based on an obtainment time difference between the first frame depth value of the first pixel and the second frame depth value of the first pixel among a plurality of frame depth values of the first pixel. The second calculator may determine a corrected first frame depth value of the first pixel using a linear sum that is calculated by applying the first weight to the first frame depth value of the first pixel, and by applying the second weight to the second frame depth value of the first pixel.Type: GrantFiled: April 7, 2010Date of Patent: August 19, 2014Assignee: Samsung Electronics Co., Ltd.Inventors: Hwa Sup Lim, Byong Min Kang, Seong Jin Kim
-
Patent number: 8803950Abstract: Disclosed is a 3D face capturing apparatus, method and computer-readable medium. As an example, the 3D face capturing method includes obtaining a face color image, obtaining a face depth image, aligning, by a computer, the face color image and the face depth image, obtaining, by the computer, a 3D face model by 2D modeling of the face color image and covering a modeled 2D face area on an image output by an image alignment module, removing by the computer, depth noise of the 3D face model, and obtaining, by the computer, an accurate 3D face model by aligning the 3D face model and a 3D face template, and removing residual noise based on a registration between the 3D face model and the 3D face template.Type: GrantFiled: August 24, 2010Date of Patent: August 12, 2014Assignee: Samsung Electronics Co., Ltd.Inventors: Haibing Ren, Xiangsheng Huang, Hwa Sup Lim
-
Patent number: 8781161Abstract: Provided is an image processing apparatus. The image processing apparatus may extract a three-dimensional (3D) silhouette image in an input color image and/or an input depth image. Motion capturing may be performed using the 3D silhouette image and 3D body modeling may be performed.Type: GrantFiled: May 28, 2010Date of Patent: July 15, 2014Assignee: Samsung Electronics Co., Ltd.Inventors: Yong Sun Kim, Hwa Sup Lim, Byong Min Kang, Ouk Choi