Patents by Inventor Gil-Haeng Lee

Gil-Haeng Lee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10984609
    Abstract: Disclosed herein are an apparatus and method for generating a 3D avatar. The method, performed by the apparatus, includes performing a 3D scan of the body of a user using an image sensor and generating a 3D scan model using the result of the 3D scan of the body of the user, matching the 3D scan model and a previously stored template avatar, and generating a 3D avatar based on the result of matching the 3D scan model and the template avatar.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: April 20, 2021
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Byung-Ok Han, Ho-Won Kim, Ki-Nam Kim, Jae-Hwan Kim, Ji-Hyung Lee, Yu-Gu Jung, Chang-Joon Park, Gil-Haeng Lee
  • Patent number: 10726612
    Abstract: Provided is a method of reconstructing a three-dimensional (3D) model of an object. The method includes sequentially performing, by a camera module, first and second object scanning processes of scanning the same object, reconstructing, by a processor module, a 3D object model, based on a first object image obtained through the first object scanning process, performing pose learning on an object to generate learning data, based on data obtained through a process of reconstructing the 3D object model based on the first object image, and reconstructing, by the processor module, a final 3D object model, based on a second object image obtained through the second object scanning process and the learning data.
    Type: Grant
    Filed: August 17, 2018
    Date of Patent: July 28, 2020
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Byung Ok Han, Jae Hwan Kim, Ho Won Kim, Ji Hyung Lee, Yu Gu Jung, Chang Joon Park, Gil Haeng Lee
  • Publication number: 20200160613
    Abstract: Disclosed herein are an apparatus and method for generating a 3D avatar. The method, performed by the apparatus, includes performing a 3D scan of the body of a user using an image sensor and generating a 3D scan model using the result of the 3D scan of the body of the user, matching the 3D scan model and a previously stored template avatar, and generating a 3D avatar based on the result of matching the 3D scan model and the template avatar.
    Type: Application
    Filed: September 6, 2019
    Publication date: May 21, 2020
    Applicant: Electronics and Telecommunications Research Institute
    Inventors: Byung-Ok HAN, Ho-Won KIM, Ki-Nam KIM, Jae-Hwan KIM, Ji-Hyung LEE, Yu-Gu JUNG, Chang-Joon PARK, Gil-Haeng LEE
  • Patent number: 10643372
    Abstract: The present disclosure provides a method and apparatus for reconstructing 3D information of an object. The method of reconstructing 3D information of an object may include: reconstructing 3D information of a background space, using at least one of images of the background space for three-dimensionally reconstructing the object; separating the object from the background space on the basis of at least one of images of the object in the background space, and of obtaining a depth image of the object separated from the background space; and generating 3D information of the object based on images taken by at least one of cameras in consideration of position relationships between the depth image of the object and the cameras.
    Type: Grant
    Filed: December 8, 2017
    Date of Patent: May 5, 2020
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Byung Ok Han, Jae Hwan Kim, Ho Won Kim, Yu Gu Jung, Chang Joon Park, Gil Haeng Lee
  • Publication number: 20190392632
    Abstract: Provided is a method of reconstructing a three-dimensional (3D) model of an object. The method includes sequentially performing, by a camera module, first and second object scanning processes of scanning the same object, reconstructing, by a processor module, a 3D object model, based on a first object image obtained through the first object scanning process, performing pose learning on an object to generate learning data, based on data obtained through a process of reconstructing the 3D object model based on the first object image, and reconstructing, by the processor module, a final 3D object model, based on a second object image obtained through the second object scanning process and the learning data.
    Type: Application
    Filed: August 17, 2018
    Publication date: December 26, 2019
    Applicant: Electronics and Telecommunications Research Institute
    Inventors: Byung Ok HAN, Jae Hwan KIM, Ho Won KIM, Ji Hyung LEE, Yu Gu JUNG, Chang Joon PARK, Gil Haeng LEE
  • Patent number: 10430459
    Abstract: A server for providing a city street search service includes a street information database configured to store city street images, a feature selection unit configured to select at least one feature according to a predetermined criterion when a city street image for searching and two or more features for the image are received from a user terminal, a candidate extraction unit configured to extract a candidate list of a city street image, a feature matching unit configured to match the city street image for registration included in the extracted candidate list and the at least one selected feature, and a search result provision unit configured to provide the user terminal with a result of the matching as result information regarding the city street image for searching.
    Type: Grant
    Filed: October 24, 2016
    Date of Patent: October 1, 2019
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Seung Jae Lee, Keun Dong Lee, Hyung Kwan Son, Weon Geun Oh, Da Un Jung, Young Ho Suh, Wook Ho Son, Won Young Yoo, Gil Haeng Lee
  • Patent number: 10417829
    Abstract: The present invention relates to a method and apparatus for providing a realistic 2D/3D AR experience service based on a video. Particularly, the present invention provides a method of providing a realistic AR service with high quality based on AR by using a 2D video image and 3D information in association thereto at the same time, filming a cybernaut and AR content by using two sensors having viewpoints different from each other, and arranging 2D/3D content being an object to be matched within the AR content and which has a 3D position different to a position of the cybernaut in association with a dynamic 3D position of the cybernaut and with a dynamic viewpoint of a service sensor.
    Type: Grant
    Filed: February 5, 2018
    Date of Patent: September 17, 2019
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Ho Won Kim, Byung Ok Han, Yu Gu Jung, Jae Hwan Kim, Ji Hyung Lee, Chang Joon Park, Gil Haeng Lee
  • Patent number: 10388062
    Abstract: Disclosed herein are a virtual content-mixing method for augmented reality and an apparatus for the same. The virtual content-mixing method includes generating lighting physical-modeling data based on actual lighting information for outputting virtual content, generating camera physical-modeling data by acquiring a plurality of parameters corresponding to a camera, and mixing the virtual content with an image that is input through an RGB camera, based on the lighting physical-modeling data and the camera physical-modeling data.
    Type: Grant
    Filed: December 5, 2017
    Date of Patent: August 20, 2019
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Yu-Gu Jung, Jae-Hwan Kim, Ho-Won Kim, Byung-Ok Han, Chang-Joon Park, Gil-Haeng Lee
  • Publication number: 20190164346
    Abstract: The present invention relates to a method and apparatus for providing a realistic 2D/3D AR experience service based on a video. Particularly, the present invention provides a method of providing a realistic AR service with high quality based on AR by using a 2D video image and 3D information in association thereto at the same time, filming a cybernaut and AR content by using two sensors having viewpoints different from each other, and arranging 2D/3D content being an object to be matched within the AR content and which has a 3D position different to a position of the cybernaut in association with a dynamic 3D position of the cybernaut and with a dynamic viewpoint of a service sensor.
    Type: Application
    Filed: February 5, 2018
    Publication date: May 30, 2019
    Inventors: Ho Won Kim, Byung Ok Han, Yu Gu Jung, Jae Hwan Kim, Ji Hyung Lee, Chang Joon Park, Gil Haeng Lee
  • Publication number: 20190156552
    Abstract: The present disclosure provides a method and apparatus for reconstructing 3D information of an object. The method of reconstructing 3D information of an object may include: reconstructing 3D information of a background space, using at least one of images of the background space for three-dimensionally reconstructing the object; separating the object from the background space on the basis of at least one of images of the object in the background space, and of obtaining a depth image of the object separated from the background space; and generating 3D information of the object based on images taken by at least one of cameras in consideration of position relationships between the depth image of the object and the cameras.
    Type: Application
    Filed: December 8, 2017
    Publication date: May 23, 2019
    Inventors: Byung Ok HAN, Jae Hwan KIM, Ho Won KIM, Yu Gu JUNG, Chang Joon PARK, Gil Haeng LEE
  • Publication number: 20190012828
    Abstract: Disclosed herein are a virtual content-mixing method for augmented reality and an apparatus for the same. The virtual content-mixing method includes generating lighting physical-modeling data based on actual lighting information for outputting virtual content, generating camera physical-modeling data by acquiring a plurality of parameters corresponding to a camera, and mixing the virtual content with an image that is input through an RGB camera, based on the lighting physical-modeling data and the camera physical-modeling data.
    Type: Application
    Filed: December 5, 2017
    Publication date: January 10, 2019
    Inventors: Yu-Gu Jung, Jae-Hwan Kim, Ho-Won Kim, Byung-Ok Han, Chang-Joon Park, Gil-Haeng Lee
  • Publication number: 20170199900
    Abstract: A server for providing a city street search service includes a street information database configured to store city street images, a feature selection unit configured to select at least one feature according to a predetermined criterion when a city street image for searching and two or more features for the image are received from a user terminal, a candidate extraction unit configured to extract a candidate list of a city street image, a feature matching unit configured to match the city street image for registration included in the extracted candidate list and the at least one selected feature, and a search result provision unit configured to provide the user terminal with a result of the matching as result information regarding the city street image for searching.
    Type: Application
    Filed: October 24, 2016
    Publication date: July 13, 2017
    Inventors: Seung Jae LEE, Keun Dong LEE, Hyung Kwan SON, Weon Geun OH, Da Un JUNG, Young Ho SUH, Wook Ho SON, Won Young YOO, Gil Haeng LEE
  • Publication number: 20170039768
    Abstract: An apparatus for displaying image content based on pop-up book includes: a database for storing multiple pieces of reference depth-based mesh information, acquired for each page of pop-up book where stereoscopic shapes stand when the pop-up book is opened, and image content corresponding to each page; a depth information acquisition unit for acquiring an image including depth information by capturing the current page where the stereoscopic shapes protrude as a result of opening the pop-up book at arbitrary point, and generating depth-based mesh information about the current page; and a display unit for recognizing the current page by matching the multiple reference depth-based mesh information with the depth-based mesh information about the current page, generated by the depth information acquisition unit, extracting image content corresponding to the recognized current page from the database, and projecting it onto the current page.
    Type: Application
    Filed: March 9, 2016
    Publication date: February 9, 2017
    Inventors: Hang-Kee KIM, Ki-Hong KIM, Hong-Kee KIM, Gil-Haeng LEE
  • Publication number: 20160364911
    Abstract: An apparatus and method for providing virtual reality-based digital optical content for digital optical devices. The apparatus for providing virtual reality-based digital optical content for digital optical devices includes a content management unit for providing at least one piece of digital optical content corresponding to a digital optical device, a content execution unit for executing an optical image corresponding to the at least one piece of digital optical content on a display screen, an adjustment data acquisition unit for acquiring optical image adjustment data that is input by a user of the digital optical device to adjust the optical image, and a virtual camera configuration provision unit for providing virtual camera configuration data corresponding to the at least one piece of digital optical content so as to adjust the optical image in correspondence with the optical image adjustment data.
    Type: Application
    Filed: January 21, 2016
    Publication date: December 15, 2016
    Inventors: Dong-Sik JO, Dae-Hwan KIM, Yong-Wan KIM, Ki-Hong KIM, Gil-Haeng LEE
  • Patent number: 9489740
    Abstract: Provided are an apparatus and method for tracking a camera that reconstructs a real environment in three dimensions by using reconstruction segments and a volumetric surface. The camera tracking apparatus using reconstruction segments and a volumetric surface includes a reconstruction segment division unit configured to divide three-dimensional space reconstruction segments extracted from an image acquired by a camera, a transformation matrix generation unit configured to generate a transformation matrix for at least one reconstruction segment among the reconstruction segments obtained by the reconstruction segment division unit, and a reconstruction segment connection unit configured to rotate or move the at least one reconstruction segment according to the transformation matrix generated by the reconstruction segment division unit and connect the rotated and moved reconstruction segment with another reconstruction segment.
    Type: Grant
    Filed: June 25, 2014
    Date of Patent: November 8, 2016
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Young Hee Kim, Jin Ho Kim, Ki Hong Kim, Gil Haeng Lee
  • Publication number: 20160232708
    Abstract: Provided are an intuitive interaction apparatus and method. The intuitive interaction apparatus includes a detector configured to detect three-dimensional (3D) information of an object of interest (OOI), including a body part of a first object and an object close to the body part, from a 3D image frame of the first object in an eye-gaze range of the first object and a restorer configured to combine pieces of the 3D information of the OOI detected by the detector and three-dimensionally model the OOI to generate a 3D model which is to be displayed in virtual reality.
    Type: Application
    Filed: February 3, 2016
    Publication date: August 11, 2016
    Inventors: Dae Hwan KIM, Yong Wan KIM, Dong Sik JO, Ki Hong KIM, Gil Haeng LEE
  • Patent number: 9230500
    Abstract: An expanded three-dimensional (3D) stereoscopic image display system is provided. The expanded 3D stereoscopic image display system according to an embodiment of the present invention provides a display platform that presents integrated services by fusing homogeneous and heterogeneous display devices in a single space, and an operation technique of the display platform.
    Type: Grant
    Filed: August 2, 2012
    Date of Patent: January 5, 2016
    Assignee: ELECTRONICS & TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Ung-Yeon Yang, Hye-Mi Kim, Jin-Ho Kim, Ki-Hong Kim, Gil-Haeng Lee
  • Publication number: 20150139532
    Abstract: Provided are an apparatus and method for tracking a camera that reconstructs a real environment in three dimensions by using reconstruction segments and a volumetric surface. The camera tracking apparatus using reconstruction segments and a volumetric surface includes a reconstruction segment division unit configured to divide three-dimensional space reconstruction segments extracted from an image acquired by a camera, a transformation matrix generation unit configured to generate a transformation matrix for at least one reconstruction segment among the reconstruction segments obtained by the reconstruction segment division unit, and a reconstruction segment connection unit configured to rotate or move the at least one reconstruction segment according to the transformation matrix generated by the reconstruction segment division unit and connect the rotated and moved reconstruction segment with another reconstruction segment.
    Type: Application
    Filed: June 25, 2014
    Publication date: May 21, 2015
    Inventors: Young Hee KIM, Jin Ho KIM, Ki Hong KIM, Gil Haeng LEE
  • Publication number: 20150067537
    Abstract: Provided are an SNS-based content creating system and method. The SNS-based content creating system includes a terminal configured to share a content creation information or a content correction information with the other terminal through the SNS and a visualization object managing server configured to manage the database, wherein the terminal comprises a user input unit configured to receive text information, a text processor configured to recommend a visualization candidate material for the text information by using a database, a visualization processor configured to create or correct content, based on selection information about the recommended visualization candidate material and a network processor configured to transmit the content to other terminal.
    Type: Application
    Filed: May 2, 2014
    Publication date: March 5, 2015
    Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Ki Suk LEE, Hyun Bin KIM, Seong Won RYU, Su Ran PARK, Ki Hong KIM, Gil Haeng LEE
  • Publication number: 20140285484
    Abstract: Provided are a system and method of simultaneously providing stereoscopic images to multiple users. The system includes at least one glasses unit, a stereoscopic image generating device configured to calculate spatial information of the at least one glasses unit, and generate the stereoscopic image corresponding to the spatial information of the at least one glasses unit, and a stereoscopic image providing device configured to project the stereoscopic image corresponding to the spatial information of the at least one glasses unit to provide the projected stereoscopic image to the at least one glasses unit. Thus, through lightweight glasses constituted of only simple optical elements without a separate electronic device such as a micro panel, stereoscopic information such as through an existing HMD may be provided to multiple users.
    Type: Application
    Filed: March 18, 2014
    Publication date: September 25, 2014
    Applicant: Electronics & Telecommunications Research Institute
    Inventors: Yong Wan KIM, Dong Sik Jo, Ung Yeon Yang, Ki Hong Kim, Gil Haeng Lee