Patents by Inventor Hwa-sup Lim

Hwa-sup Lim has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10251556
    Abstract: Provided is an in vivo bioimaging method including irradiating near-infrared (NIR) light onto a living body, converting the NIR light passed through the living body, into visible light using upconversion nanoparticles (UCNPs), and generating a bioimage of the living body by receiving the visible light using a complementary metal-oxide-semiconductor (CMOS) image sensor.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: April 9, 2019
    Assignees: Korea Institute of Science an Technology, Center of Human-Centered Interaction for Coexistence
    Inventors: Hwa Sup Lim, Seok Joon Kwon, Sang Chul Ahn, Bum Jae You
  • Patent number: 10210653
    Abstract: A method and apparatus to generate a volume-panorama image are provided. A method of generating a volume-panorama image includes receiving conversion relationships between volume images, one of the received conversion relationships being between a first volume image of the volume images and a second volume image of the volume images, the second volume image including an area that is common to an area of the first volume image, generating an optimized conversion relationship from the one of the received conversion relationships based on the received conversion relationships, and generating the volume-panorama image based on the generated optimized conversion relationship.
    Type: Grant
    Filed: May 9, 2016
    Date of Patent: February 19, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ouk Choi, Hwa-sup Lim, Jung-ho Kim, Do-kyoon Kim
  • Publication number: 20180055367
    Abstract: Provided is an in vivo bioimaging method including irradiating near-infrared (NIR) light onto a living body, converting the NIR light passed through the living body, into visible light using upconversion nanoparticles (UCNPs), and generating a bioimage of the living body by receiving the visible light using a complementary metal-oxide-semiconductor (CMOS) image sensor.
    Type: Application
    Filed: July 31, 2017
    Publication date: March 1, 2018
    Applicants: KOREA INSTITUTE OF SCIENCE AND TECHNOLOGY, CENTER OF HUMAN-CENTERED INTERACTION FOR COEXISTENCE
    Inventors: Hwa Sup LIM, Seok Joon KWON, Sang Chul AHN, Bum Jae YOU
  • Patent number: 9471963
    Abstract: A depth noise filtering method and apparatus is provided. The depth noise filtering method may perform spatial filtering or temporal filtering according to depth information. In order to perform spatial filtering, the depth noise filtering method may determine a characteristic of a spatial filter based on depth information. Also, in order to perform temporal filtering, the depth noise filtering method may determine a number of reference frames based on depth information. The depth noise filtering method may adaptively remove depth noise according to depth information and thereby enhance a noise filtering performance.
    Type: Grant
    Filed: May 7, 2014
    Date of Patent: October 18, 2016
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Byong Min Kang, Hwa Sup Lim
  • Publication number: 20160267706
    Abstract: A method and apparatus to generate a volume-panorama image are provided. A method of generating a volume-panorama image includes receiving conversion relationships between volume images, one of the received conversion relationships being between a first volume image of the volume images and a second volume image of the volume images, the second volume image including an area that is common to an area of the first volume image, generating an optimized conversion relationship from the one of the received conversion relationships based on the received conversion relationships, and generating the volume-panorama image based on the generated optimized conversion relationship.
    Type: Application
    Filed: May 9, 2016
    Publication date: September 15, 2016
    Applicant: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Ouk CHOI, Hwa-sup LIM, Jung-ho KIM, Do-kyoon KIM
  • Patent number: 9412157
    Abstract: Provided are an apparatus and a method for high speed filtering of an image for high precision that may include a coordinate determining unit to determine coordinates (P,Q) on a screen with respect to a first pixel to be filtered, a pixel determining unit to determine a second pixel with coordinates including either P or Q, a block setting unit to set a first block comprising the first pixel, and a second block comprising the second pixel, and a processing unit to filter the first pixel by comparing the first block and the second block.
    Type: Grant
    Filed: June 13, 2011
    Date of Patent: August 9, 2016
    Assignee: SAMSUNG ELECTRONICS, CO., LTD.
    Inventors: Yong Sun Kim, Hwa Sup Lim, Kee Chang Lee
  • Patent number: 9378583
    Abstract: An apparatus and method for bidirectionally inpainting an occlusion area appearing during generation of a virtual viewpoint image, using a foreground area and a background area based on a predicted volume are provided. The method includes receiving an input of a depth image and a color image, the depth image having depth information for a first viewpoint, and the color image having color information for the first viewpoint, generating a virtual viewpoint image at a second viewpoint based on the depth image and the color image, separating the virtual viewpoint image into a foreground area and a background area, based on the depth information and direction information regarding a direction from the first viewpoint to the second viewpoint, predicting a three-dimensional (3D) volume of the foreground area, and inpainting an occlusion area bidirectionally using the foreground area and the background area, based on the predicted 3D volume, the occlusion area being included in the virtual viewpoint image.
    Type: Grant
    Filed: April 14, 2011
    Date of Patent: June 28, 2016
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seung Kyu Lee, Hwa Sup Lim, Kee Chang Lee, Do Kyoon Kim
  • Patent number: 9369696
    Abstract: A first calculator of an image processing apparatus may trace a view transform vector between color images of different frames. A second calculator may trace a view transform vector between depth images of different frames. In this example, a third calculator may calculate a view transform vector between the color camera and the depth camera using the view transform vector between the color images and the view transform vector between the depth images.
    Type: Grant
    Filed: February 18, 2011
    Date of Patent: June 14, 2016
    Assignee: SAMSUNG ELECTRONICS CO., LTD
    Inventors: Seung Kyu Lee, Hwa Sup Lim, Kee Chang Lee, Ouk Choi
  • Patent number: 9350925
    Abstract: An image processing apparatus may include a sensor unit which generates both a color image and a depth image. A color-depth time difference correcting unit may correct a mismatching that occurs due to a time difference between a point in time when the color image is generated and a point in time when the depth image is generated. An image generator may generate a stereoscopic image or a multi-view image using the color image and the depth image after the mismatching is corrected.
    Type: Grant
    Filed: October 24, 2012
    Date of Patent: May 24, 2016
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hwa Sup Lim, Byong Min Kang, Yong Sun Kim, Kee Chang Lee, Ouk Choi
  • Patent number: 9258548
    Abstract: Provided is a depth image generating apparatus. The depth image generating apparatus may include a filtering unit, a modulation unit, and a sensing unit. The filtering unit may band pass filter an infrared light of a first wavelength band among infrared lights received from an object. The modulation unit may modulate the infrared light of the first wavelength band to an infrared light of a second wavelength band. The sensing unit may generate an electrical signal by sensing the modulated infrared light of the second wavelength band.
    Type: Grant
    Filed: May 27, 2011
    Date of Patent: February 9, 2016
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Sung Cheol Kim, Hwa Sup Lim, Kassou Ahmad Ramez
  • Patent number: 9210398
    Abstract: A method and apparatus for temporally interpolating a three-dimensional (3D) depth image are provided to generate an intermediate depth image in a desired time. The apparatus may interpolate depth images generated by a depth camera, using a temporal interpolation procedure, may generate an intermediate depth image in a new time using the interpolated depth images, and may combine the generated intermediate depth image with color images, to generate a high-precision 3D image.
    Type: Grant
    Filed: April 18, 2011
    Date of Patent: December 8, 2015
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Seung Kyu Lee, Hwa Sup Lim, Do Kyoon Kim, Kee Chang Lee
  • Patent number: 9135521
    Abstract: An image processing apparatus and method are provided. A control unit may divide input image array data into a plurality of sub-blocks, and a first arithmetic logic unit (ALU) may generate an integral image of at least one of the plurality of sub-blocks. The control unit may determine each of the plurality of sub-blocks to be included in any one of a first sub-block group and a second sub-block group, store the integral image of each sub-block included in the first sub-block group on the first memory, and store the integral image of each sub-block included in the second sub-block group on the second memory.
    Type: Grant
    Filed: April 29, 2009
    Date of Patent: September 15, 2015
    Assignees: Samsung Electronics Co., Ltd., Korea Advanced Institute of Science and Technology
    Inventors: Hwa Sup Lim, Kee Chang Lee, Byong-Min Kang, In Cheol Park, Jeong Ho Han, Hye Yeon Shim
  • Patent number: 9105082
    Abstract: A high speed filtering apparatus and a method for high precision restoration of a depth image are provided. The high speed filtering apparatus for high precision restoration of the depth image may include a block setting unit to set a first block including a target pixel, and to set a second block with respect to a central pixel distributed around the target pixel based on a size of the first block, a weight determining unit to determine a pixel weight with respect to each pixel in the second block, and to determine a block weight with respect to the second block by applying the pixel weight, and a processor to filter the target pixel based on the block weight, thereby accurately filtering the target pixel.
    Type: Grant
    Filed: August 8, 2011
    Date of Patent: August 11, 2015
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yong Sun Kim, Hwa Sup Lim, Kee Chang Lee
  • Patent number: 9047681
    Abstract: Provided are an apparatus and method for converting a low-resolution depth image to a depth image having a resolution identical to a resolution of a high-resolution color image. The depth image conversion apparatus may generate a discrete depth image by quantizing a depth value of an up-sampled depth image, estimate a high-resolution discrete depth image by optimizing an objective functions of the discrete depth image based on the high-resolution color image and an up-sampled depth border, and convert the up-sampled depth image to a high-resolution depth image by filtering the up-sampled depth image when a difference between discrete depth values of neighboring pixels in the high-resolution discrete depth image is less than a predetermined threshold value.
    Type: Grant
    Filed: May 8, 2012
    Date of Patent: June 2, 2015
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Ouk Choi, Hwa Sup Lim, Kee Chang Lee
  • Patent number: 9013482
    Abstract: Disclosed is a mesh generating apparatus, method and computer-readable medium, and an image processing apparatus, method and computer-readable medium. A single 3D mesh and a single 3D object model may be generated using a single color image and a single depth image. A plurality of viewpoint images seen from a plurality of viewpoints may be generated from a single 3D object model.
    Type: Grant
    Filed: November 16, 2010
    Date of Patent: April 21, 2015
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hwa Sup Lim, Yong Sun Kim, Seung Kyu Lee, Kee Chang Lee, Ouk Choi
  • Patent number: 8885920
    Abstract: An image processing apparatus is provided. A silhouette extractor may extract a silhouette image of a target object from an input depth image. A first calculator may determine a location of at least one limb of the target object and a location of at least one joint connecting the at least one limb by applying a rectangle fitting algorithm with respect to the silhouette image.
    Type: Grant
    Filed: September 22, 2010
    Date of Patent: November 11, 2014
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hwa Sup Lim, Byong Min Kang
  • Publication number: 20140241644
    Abstract: A depth noise filtering method and apparatus is provided. The depth noise filtering method may perform spatial filtering or temporal filtering according to depth information. In order to perform spatial filtering, the depth noise filtering method may determine a characteristic of a spatial filter based on depth information. Also, in order to perform temporal filtering, the depth noise filtering method may determine a number of reference frames based on depth information. The depth noise filtering method may adaptively remove depth noise according to depth information and thereby enhance a noise filtering performance.
    Type: Application
    Filed: May 7, 2014
    Publication date: August 28, 2014
    Applicant: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Byong Min KANG, Hwa Sup LIM
  • Patent number: 8810602
    Abstract: Provided is an image processing apparatus, medium, and method. The image processing apparatus may include a first calculator and a second calculator. The first calculator may calculate a first weight of a first frame depth value of a first pixel of a depth image and a second weight of a second frame depth value of the first pixel, based on an obtainment time difference between the first frame depth value of the first pixel and the second frame depth value of the first pixel among a plurality of frame depth values of the first pixel. The second calculator may determine a corrected first frame depth value of the first pixel using a linear sum that is calculated by applying the first weight to the first frame depth value of the first pixel, and by applying the second weight to the second frame depth value of the first pixel.
    Type: Grant
    Filed: April 7, 2010
    Date of Patent: August 19, 2014
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hwa Sup Lim, Byong Min Kang, Seong Jin Kim
  • Patent number: 8803950
    Abstract: Disclosed is a 3D face capturing apparatus, method and computer-readable medium. As an example, the 3D face capturing method includes obtaining a face color image, obtaining a face depth image, aligning, by a computer, the face color image and the face depth image, obtaining, by the computer, a 3D face model by 2D modeling of the face color image and covering a modeled 2D face area on an image output by an image alignment module, removing by the computer, depth noise of the 3D face model, and obtaining, by the computer, an accurate 3D face model by aligning the 3D face model and a 3D face template, and removing residual noise based on a registration between the 3D face model and the 3D face template.
    Type: Grant
    Filed: August 24, 2010
    Date of Patent: August 12, 2014
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Haibing Ren, Xiangsheng Huang, Hwa Sup Lim
  • Patent number: 8781161
    Abstract: Provided is an image processing apparatus. The image processing apparatus may extract a three-dimensional (3D) silhouette image in an input color image and/or an input depth image. Motion capturing may be performed using the 3D silhouette image and 3D body modeling may be performed.
    Type: Grant
    Filed: May 28, 2010
    Date of Patent: July 15, 2014
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yong Sun Kim, Hwa Sup Lim, Byong Min Kang, Ouk Choi