Patents by Inventor Jingu Heo
Jingu Heo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12236615Abstract: An image processing method includes acquiring an image frame; tracking a face region of a user based on first prior information obtained from at least one previous frame of the image frame; based on a determination that tracking of the face region based on the first prior information has failed, setting a scan region in the image frame based on second prior information obtained from the at least one previous frame; and detecting the face region in the image frame based on the scan region.Type: GrantFiled: October 20, 2023Date of Patent: February 25, 2025Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Dongwoo Kang, Jingu Heo, Byong Min Kang, Dong Kyung Nam
-
Publication number: 20240303777Abstract: An apparatus and method for processing an image are disclosed. The method includes: segmenting both a first image and a second image and generating segmentation mask pairs, each segmentation mask pair having a segmentation mask of the first image and a segmentation mask of the second image; generating local homography matrices of the first image with respect to the second image, based on the segmentation mask pairs, the first image, and the second image; and generating a synthetic image obtained by aligning the first image with the second image, wherein the aligning is performed based on the local homography matrices, the segmentation mask pairs, the first image, and the second image.Type: ApplicationFiled: February 29, 2024Publication date: September 12, 2024Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Yasi WANG, Chao ZHANG, Hong LIU, Jingu HEO, Dong Kyung NAM, Qiang WANG, Lu XU
-
Patent number: 12086958Abstract: A method and device with synthetic image generation is included. A method includes acquiring a first image captured by a first camera and second images captured by a second camera having a narrower field of view (FOV) when the second images are captured thereby than that of the first camera when the first image is captured thereby. The method also includes detecting respective blur statuses of each of the second images, selecting a region of the first image on the basis of the region corresponding to a second image, of the second images, selected based on a determination that the blur status of the second image satisfies a blur condition, and generating a synthetic image by synthesizing together the selected region of the first image and the second images not including the selected second image.Type: GrantFiled: October 31, 2022Date of Patent: September 10, 2024Assignee: Samsung Electronics Co., Ltd.Inventors: Kyuhwan Choi, Jingu Heo
-
Patent number: 12073569Abstract: Provided is a method and apparatus for eye tracking. An eye tracking method includes detecting an eye area corresponding to an eye of a user in a first frame of an image; determining an attribute of the eye area; selecting an eye tracker from a plurality of different eye trackers, the eye tracker corresponding to the determined attribute of the eye area; and tracking the eye of the user in a second frame of the image based on the selected eye tracker, the second frame being subsequent to the first frame.Type: GrantFiled: June 12, 2023Date of Patent: August 27, 2024Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu Heo, Dongwoo Kang, Byong Min Kang
-
Publication number: 20240273739Abstract: A method and an electronic device with image registration are provided. The method includes generating a first optical flow between a first partial image and a second partial image, which are captured by respective first and second cameras using an optical flow estimation model; generating disparity information between the first partial image and a third partial image, captured by a third camera, based on depth information of the first partial image generated using the first optical flow; and estimating a second optical flow between the first partial image and the third partial image based on the generated disparity information for generating a registration image.Type: ApplicationFiled: September 20, 2023Publication date: August 15, 2024Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jinje PARK, Jingu HEO, Sung Kwang CHO, Dong Kyung NAM
-
Patent number: 12056844Abstract: A method with image processing includes: receiving an input image including Bayer images captured by a plurality of lenses included in a lens assembly; generating channel separation images by separating each of the Bayer images by a plurality of channels; determining corresponding points such that pixels in the channel separation images are displayed at the same position on a projection plane, for each of the plurality of lenses; performing binning on the channel separation images, based on a brightness difference and a distance difference between a target corresponding point and a center of a pixel including the target corresponding point, corresponding to each of the corresponding points in channel separation images that correspond to a same channel and that are combined into one image, for each of the plurality of lenses; restoring the input image for each of the plurality of lenses based on binned images generated by performing the binning; and outputting the restored input image.Type: GrantFiled: May 19, 2022Date of Patent: August 6, 2024Assignee: Samsung Electronics Co., Ltd.Inventors: Byong Min Kang, Dong Kyung Nam, Yang Ho Cho, Jingu Heo
-
Publication number: 20240193728Abstract: Provided is an image processing method of an image processing model, the image processing method including obtaining an input image group, the input image group including a plurality of low-resolution images corresponding to a plurality of different viewpoints, respectively, obtaining a feature of low-resolution images by extracting a feature for each low-resolution image of the plurality of low-resolution images included in the input image group, obtaining a fusion residual feature by fusing the feature of low-resolution images, and obtaining a super-resolution image corresponding to the input image group based on the fusion residual feature.Type: ApplicationFiled: December 7, 2023Publication date: June 13, 2024Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Chao ZHANG, Qiang WANG, Jingu HEO, Dong Kyung NAM, Yasi WANG
-
Publication number: 20240187746Abstract: An image processing method includes: based on an imaging device generating an input array image of a multi-view through an array lens, determining a first setting parameter indicating whether to use the multi-view or a single view selected from the multi-view; determining a second setting parameter indicating whether a priority is assigned to sensitivity enhancement based on pixel binning or to resolution enhancement based on pixel interpolation; determining an image processing mode based on the first setting parameter and the second setting parameter; and generating an output image by performing image processing on the input array image based on a processing procedure that is based on the determined image processing mode.Type: ApplicationFiled: October 3, 2023Publication date: June 6, 2024Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu HEO, Byong Min KANG, Juyong PARK, Dong Kyung NAM, Yang Ho CHO
-
Patent number: 11989911Abstract: An eye reconstruction-based eye tracking method and apparatus are provided. The eye tracking method includes generating a reconstructed image by performing eye reconstruction with respect to an input image, determining a difference value between the input image and the reconstructed image, selecting one of the input image, the reconstructed image, and a replacement image as a target image based on the determined difference value, and performing eye tracking based on the target image.Type: GrantFiled: May 9, 2022Date of Patent: May 21, 2024Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu Heo, Dongwoo Kang, Dong Kyung Nam
-
Publication number: 20240161314Abstract: A method of estimating an optical flow includes processing, using an image processing pass, a first image and a second image separately, and estimating the optical flow based on a second image attention feature map of the first image and a second image attention feature map of the second image. The processing using the image processing pass includes extracting a feature map by encoding an image, outputting a first image fusion attention feature map by fusing row relationship information of the image with the image feature map, outputting a first image attention feature map of the image based on the first image fusion attention feature map and the image feature map, outputting a second image fusion attention feature map by fusing column relationship information of the image with the first image attention feature map, and generating a second image attention feature map of the image based on the second image fusion attention feature map and the first image attention feature map.Type: ApplicationFiled: November 14, 2023Publication date: May 16, 2024Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Zhaohui Lv, Pei You, Penghui Sun, Feng Zhu, Ran Yang, Huisi Wu, Wende Xie, Jingyin Lin, Zebin Zhao, Dong Kyung Nam, Jingu Heo
-
Patent number: 11972634Abstract: An image processing method includes receiving an image frame, detecting a face region of a user in the image frame, aligning a plurality of preset feature points in a plurality of feature portions included in the face region, performing a first check on a result of the aligning based on a first region corresponding to a combination of the feature portions, performing a second check on the result of the aligning based on a second region corresponding to an individual feature portion of the feature portions, redetecting a face region based on a determination of a failure in passing at least one of the first check or the second check, and outputting information on the face region based on a determination of a success in passing the first check and the second check.Type: GrantFiled: December 22, 2022Date of Patent: April 30, 2024Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Dongwoo Kang, Jingu Heo, Byong Min Kang
-
Publication number: 20240111203Abstract: An imaging device includes an imaging lens array including a plurality of imaging lenses each with a same focal length, the plurality of imaging lenses being configured to capture a scene; a sensing array comprising a plurality of sensors configured to receive light passing through the plurality of imaging lenses; a processor configured to determine a scene depth plane corresponding to the scene based on a comparison, for each of a plurality of candidate depths, between reference pixel values based on first sensors of the plurality of sensors corresponding to a reference imaging lens of the plurality of imaging lenses and target pixel values that are based on second sensors of the plurality of sensors corresponding to a target imaging lens of the plurality of image lenses; and a lens driver configured to position the imaging lens array to be disposed at a point corresponding to the scene depth plane.Type: ApplicationFiled: March 14, 2023Publication date: April 4, 2024Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Yang Ho CHO, Juyong PARK, Jingu HEO, Dong Kyung NAM
-
Publication number: 20240112440Abstract: A method and apparatus for array image processing are provided. The method includes receiving sub images corresponding to different views of an input array image generated through an array lens, generating temporary restored images based on the sub images using a gradient between neighboring pixels of each of the sub images, determining matching information based on a view difference between pixels of the sub images using a neural network model, based on a pixel distance between matching pairs of the pixels of the sub images using the matching information, extracting refinement targets from the matching pairs, refining the matching information by replacing at least some of target pixels included in the refinement targets based on a local search of a region based on pixel locations of the refinement targets, and generating an output image of a single view by merging the temporary restored images based on the refined matching information.Type: ApplicationFiled: August 22, 2023Publication date: April 4, 2024Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu HEO, Byong Min KANG, Dong Kyung NAM, Yang Ho CHO
-
Publication number: 20240046487Abstract: An image processing method includes acquiring an image frame; tracking a face region of a user based on first prior information obtained from at least one previous frame of the image frame; based on a determination that tracking of the face region based on the first prior information has failed, setting a scan region in the image frame based on second prior information obtained from the at least one previous frame; and detecting the face region in the image frame based on the scan region.Type: ApplicationFiled: October 20, 2023Publication date: February 8, 2024Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Dongwoo KANG, Jingu Heo, Byong Min Kang, Dong Kyung Nam
-
Patent number: 11830234Abstract: An image processing method and an image processing apparatus are provided. The image processing method includes acquiring information of a first region of interest (ROI) in a first frame, estimating information of a second ROI in a second frame that is received after the first frame, based on the acquired information of the first ROI, and sequentially storing, in a memory, subframes that are a portion of the second frame, each of the subframes being a line of the second frame. The image processing method further includes determining whether a portion of the stored subframes includes the second ROI, based on the estimated information of the second ROI, and based on the portion of the stored subframes being determined to include the second ROI, processing the portion of the stored subframes.Type: GrantFiled: November 15, 2022Date of Patent: November 28, 2023Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu Heo, Byong Min Kang
-
Publication number: 20230326042Abstract: Provided is a method and apparatus for eye tracking. An eye tracking method includes detecting an eye area corresponding to an eye of a user in a first frame of an image; determining an attribute of the eye area; selecting an eye tracker from a plurality of different eye trackers, the eye tracker corresponding to the determined attribute of the eye area; and tracking the eye of the user in a second frame of the image based on the selected eye tracker, the second frame being subsequent to the first frame.Type: ApplicationFiled: June 12, 2023Publication date: October 12, 2023Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu HEO, Dongwoo KANG, Byong Min KANG
-
Publication number: 20230308599Abstract: A processor-implemented method includes: determining whether a plurality of tile sets of different zoom levels comprises a tile image, based on either one or both of a position of the tile image in a virtual image and a size of the tile image, wherein tile image corresponds to a visible region covered by a preview interface in the virtual image; updating the tile image based on whether the plurality of tile sets comprises the tile image; and generating a preview image corresponding to the tile image by stitching the updated tile image.Type: ApplicationFiled: March 23, 2023Publication date: September 28, 2023Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu HEO, Yunhao ZHANG, Yue MA
-
Patent number: 11715217Abstract: Provided is a method and apparatus for eye tracking. An eye tracking method includes detecting an eye area corresponding to an eye of a user in a first frame of an image; determining an attribute of the eye area; selecting an eye tracker from a plurality of different eye trackers, the eye tracker corresponding to the determined attribute of the eye area; and tracking the eye of the user in a second frame of the image based on the selected eye tracker, the second frame being subsequent to the first frame.Type: GrantFiled: November 1, 2021Date of Patent: August 1, 2023Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu Heo, Dongwoo Kang, Byong Min Kang
-
Publication number: 20230206410Abstract: A method and device with synthetic image generation is included. A method includes acquiring a first image captured by a first camera and second images captured by a second camera having a narrower field of view (FOV) when the second images are captured thereby than that of the first camera when the first image is captured thereby. The method also includes detecting respective blur statuses of each of the second images, selecting a region of the first image on the basis of the region corresponding to a second image, of the second images, selected based on a determination that the blur status of the second image satisfies a blur condition, and generating a synthetic image by synthesizing together the selected region of the first image and the second images not including the selected second image.Type: ApplicationFiled: October 31, 2022Publication date: June 29, 2023Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: KYUHWAN CHOI, JINGU HEO
-
Patent number: 11676421Abstract: An object tracking method and apparatus are provided. The object tracking method includes detecting a target object in a first-type input image that is based on light in a first wavelength band, tracking the target object in the first-type input image based on detection information of the target object, measuring a reliability of the first-type input image by comparing the first-type image to an image in a database, comparing the reliability of the first-type input image to a threshold, and tracking the target object in a second-type input image that is based on light in a second wavelength band.Type: GrantFiled: April 12, 2021Date of Patent: June 13, 2023Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Jingu Heo, Dong Kyung Nam