Patents by Inventor Kaimo Lin

Kaimo Lin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11961206
    Abstract: A method includes obtaining a Bayer input image. The method also includes generating, using at least one processing device of an electronic device, multiple YUV image frames based on the Bayer input image using non-linear scaling, where the YUV image frames are associated with different exposure settings. The method further includes generating, using the at least one processing device of the electronic device, a fused image based on the YUV image frames. In addition, the method includes applying, using the at least one processing device of the electronic device, global tone-mapping to the fused image in order to generate a tone-mapped fused image, where the global tone-mapping is based on a first cubic spline curve.
    Type: Grant
    Filed: February 15, 2022
    Date of Patent: April 16, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kaimo Lin, Hamid R. Sheikh
  • Publication number: 20240029200
    Abstract: Systems and methods for generating a panorama image. Captured images are coarsely aligned, and then finely aligned based on a combination of constraint values. The panorama image is generated from the finely aligned images.
    Type: Application
    Filed: October 4, 2023
    Publication date: January 25, 2024
    Inventors: Kevin Wong, Qiqin Dai, Kaimo Lin, Brian Totty, Jianfeng Yin, Yacine Alami, Michael Bernardo, Paul Gauthier, Philip Guindi, Qing Guo, Luis Puig Morales, Brian Pugh, Konstantinos Nektarios Lianos, Angus Dorbie
  • Patent number: 11830163
    Abstract: Systems and methods for generating a panorama image. Captured images are coarsely aligned, and then finely aligned based on a combination of constraint values. The panorama image is generated from the finely aligned images.
    Type: Grant
    Filed: July 1, 2020
    Date of Patent: November 28, 2023
    Assignee: Geomagical Labs, Inc.
    Inventors: Kevin Wong, Qiqin Dai, Kaimo Lin, Brian Totty, Jianfeng Yin, Yacine Alami, Michael Bernardo, Paul Gauthier, Philip Guindi, Qing Guo, Luis Puig Morales, Brian Pugh, Konstantinos Nektarios Lianos, Angus Dorbie
  • Patent number: 11823353
    Abstract: A method includes processing, using at least one processor of an electronic device, multiple reference images of a scene using a first convolutional neural network (CNN) to generate a confidence map and a disparity map. The method also includes generating, using the at least one processor, an initial Bokeh image based on the disparity map and the reference images using a depth-of-field (DoF) renderer. The method further includes refining, using the at least one processor, the initial Bokeh image using a second CNN to generate a refined Bokeh image, where the second CNN uses the confidence map, the disparity map, and the reference images to generate the refined Bokeh image.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: November 21, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Chenchi Luo, Yingmao Li, Kaimo Lin, Youngjun Yoo
  • Patent number: 11816855
    Abstract: A method includes obtaining at least three input image frames of a scene captured using at least three imaging sensors. The input image frames include a reference image frame and multiple non-reference image frames. The method also includes generating multiple disparity maps using the input image frames. Each disparity map is associated with the reference image frame and a different non-reference image frame. The method further includes generating multiple confidence maps using the input image frames. Each confidence map identifies weights associated with one of the disparity maps. In addition, the method includes generating a depth map of the scene using the disparity maps and the confidence maps. The imaging sensors are arranged to define multiple baseline directions, where each baseline direction extends between the imaging sensor used to capture the reference image frame and the imaging sensor used to capture a different non-reference image frame.
    Type: Grant
    Filed: September 21, 2020
    Date of Patent: November 14, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Chenchi Luo, Yingmao Li, Kaimo Lin, Youngjun Yoo
  • Publication number: 20230097869
    Abstract: An apparatus for processing image data may include: a memory storing instructions; and a processor configured to execute the instructions to: extract a target image patch including a target object, from a captured image; obtain a plurality of landmark features from the target image patch; align the plurality of landmark features of the target image patch with a plurality of reference landmark features in a template image patch including the same target object; and when the plurality of landmark features are aligned with the plurality of reference landmark features, transfer texture details of the target object in the template image patch to the target object in the target image patch.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicant: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Kaimo LIN, Hamid SHEIKH
  • Publication number: 20230073970
    Abstract: A method includes obtaining a Bayer input image. The method also includes generating, using at least one processing device of an electronic device, multiple YUV image frames based on the Bayer input image using non-linear scaling, where the YUV image frames are associated with different exposure settings. The method further includes generating, using the at least one processing device of the electronic device, a fused image based on the YUV image frames. In addition, the method includes applying, using the at least one processing device of the electronic device, global tone-mapping to the fused image in order to generate a tone-mapped fused image, where the global tone-mapping is based on a first cubic spline curve.
    Type: Application
    Filed: February 15, 2022
    Publication date: March 9, 2023
    Inventors: Kaimo Lin, Hamid R. Sheikh
  • Publication number: 20230052082
    Abstract: An apparatus includes at least one processing device configured to obtain an input image and determine a cumulative distribution function (CDF) histogram from a luminance or luma (Y) channel of the input image. The at least one processing device is also configured to determine an entry CDF histogram in a CDF histogram lookup table (LUT) closest to the determined CDF histogram. The at least one processing device is further configured to apply a Y channel global tone mapping (GTM) curve to the input image based on one or more parameters assigned to the entry CDF histogram from the CDF histogram LUT.
    Type: Application
    Filed: January 27, 2022
    Publication date: February 16, 2023
    Inventors: Ibrahim Pekkucuksen, Kaimo Lin, Hamid R. Sheikh
  • Patent number: 11449968
    Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple video frames of a video stream and multiple depth frames corresponding to the multiple video frames. The method also includes generating, using the at least one processor, multiple blur kernel maps based on the multiple depth frames. The method further includes reducing, using the at least one processor, depth errors in each of the multiple blur kernel maps. The method also includes performing, using the at least one processor, temporal smoothing on the multiple blur kernel maps to suppress temporal artifacts between different ones of the multiple blur kernel maps. In addition, the method includes generating, using the at least one processor, blur effects in the video stream using the multiple blur kernel maps.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: September 20, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kaimo Lin, Chenchi Luo, Yingmao Li, Youngjun Yoo
  • Publication number: 20220207655
    Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple video frames of a video stream and multiple depth frames corresponding to the multiple video frames. The method also includes generating, using the at least one processor, multiple blur kernel maps based on the multiple depth frames. The method further includes reducing, using the at least one processor, depth errors in each of the multiple blur kernel maps. The method also includes performing, using the at least one processor, temporal smoothing on the multiple blur kernel maps to suppress temporal artifacts between different ones of the multiple blur kernel maps. In addition, the method includes generating, using the at least one processor, blur effects in the video stream using the multiple blur kernel maps.
    Type: Application
    Filed: December 31, 2020
    Publication date: June 30, 2022
    Inventors: Kaimo Lin, Chenchi Luo, Yingmao Li, Youngjun Yoo
  • Publication number: 20220036513
    Abstract: A method includes processing, using at least one processor of an electronic device, multiple reference images of a scene using a first convolutional neural network (CNN) to generate a confidence map and a disparity map. The method also includes generating, using the at least one processor, an initial Bokeh image based on the disparity map and the reference images using a depth-of-field (DoF) renderer. The method further includes refining, using the at least one processor, the initial Bokeh image using a second CNN to generate a refined Bokeh image, where the second CNN uses the confidence map, the disparity map, and the reference images to generate the refined Bokeh image.
    Type: Application
    Filed: November 30, 2020
    Publication date: February 3, 2022
    Inventors: Chenchi Luo, Yingmao Li, Kaimo Lin, Youngjun Yoo
  • Patent number: 11132772
    Abstract: A method includes obtaining a first image of a scene using a first image sensor of an electronic device and a second image of the scene using a second image sensor of the electronic device. The method also includes generating a first feature map from the first image and a second feature map from the second image. The method further includes generating a third feature map based on the first feature map, the second feature map, and an asymmetric search window. The method additionally includes generating a depth map by restoring spatial resolution to the third feature map.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: September 28, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Chenchi Luo, Yingmao Li, Youngjun Yoo, George Q. Chen, Kaimo Lin, David D. Liu, Gyeongmin Choe
  • Patent number: 11127140
    Abstract: The present disclosure describes a system and method for background identification for videos with large foreground objects. The method includes dividing a video clip into a multiple short video clips, each of which overlaps with neighboring short video clips of the multiple short video clips, detecting, in each short video clip, multiple background motion candidates, linking the background motion candidates between the neighboring short video clips to form multiple linked groups of background motion candidates, and identifying a linked group of background motion candidates that is most dominant among the multiple linked groups of background motion candidates.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: September 21, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Kaimo Lin
  • Publication number: 20210248769
    Abstract: A method includes obtaining at least three input image frames of a scene captured using at least three imaging sensors. The input image frames include a reference image frame and multiple non-reference image frames. The method also includes generating multiple disparity maps using the input image frames. Each disparity map is associated with the reference image frame and a different non-reference image frame. The method further includes generating multiple confidence maps using the input image frames. Each confidence map identifies weights associated with one of the disparity maps. In addition, the method includes generating a depth map of the scene using the disparity maps and the confidence maps. The imaging sensors are arranged to define multiple baseline directions, where each baseline direction extends between the imaging sensor used to capture the reference image frame and the imaging sensor used to capture a different non-reference image frame.
    Type: Application
    Filed: September 21, 2020
    Publication date: August 12, 2021
    Inventors: Chenchi Luo, Yingmao Li, Kaimo Lin, Youngjun Yoo
  • Patent number: 10986287
    Abstract: A method of capturing a photo using a mobile device is described. The method comprises detecting a signature motion of the mobile device; capturing video using a camera of the mobile device upon detecting the signature motion; and automatically identifying a start frame and an end frame of the captured images using neural networks. A mobile device for capturing a photo is also described.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: April 20, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: David Liu, Michael Polley, Youngjun F. Yoo, Hamid Rahim Sheikh, Kaimo Lin, George Chen, Chenchi Luo
  • Publication number: 20210004933
    Abstract: Systems and methods for generating a panorama image. Captured images are coarsely aligned, and then finely aligned based on a combination of constraint values. The panorama image is generated from the finely aligned images.
    Type: Application
    Filed: July 1, 2020
    Publication date: January 7, 2021
    Inventors: Kevin Wong, Qiqin Dai, Kaimo Lin, Brian Totty, Jianfeng Yin, Yacine Alami, Michael Bernardo, Paul Gauthier, Philip Guindi, Qing Guo, Luis Puig Morales, Brian Pugh, Konstantinos Nektarios Lianos, Angus Dorbie
  • Publication number: 20200394759
    Abstract: A method includes obtaining a first image of a scene using a first image sensor of an electronic device and a second image of the scene using a second image sensor of the electronic device. The method also includes generating a first feature map from the first image and a second feature map from the second image. The method further includes generating a third feature map based on the first feature map, the second feature map, and an asymmetric search window. The method additionally includes generating a depth map by restoring spatial resolution to the third feature map.
    Type: Application
    Filed: December 12, 2019
    Publication date: December 17, 2020
    Inventors: Chenchi Luo, Yingmao Li, Youngjun Yoo, George Q. Chen, Kaimo Lin, David D. Liu, Gyeongmin Choe
  • Publication number: 20200349717
    Abstract: The present disclosure describes a system and method for background identification for videos with large foreground objects. The method includes dividing a video clip into a multiple short video clips, each of which overlaps with neighboring short video clips of the multiple short video clips, detecting, in each short video clip, multiple background motion candidates, linking the background motion candidates between the neighboring short video clips to form multiple linked groups of background motion candidates, and identifying a linked group of background motion candidates that is most dominant among the multiple linked groups of background motion candidates.
    Type: Application
    Filed: April 30, 2019
    Publication date: November 5, 2020
    Inventor: Kaimo Lin
  • Publication number: 20200267331
    Abstract: A method of capturing a photo using a mobile device is described. The method comprises detecting a signature motion of the mobile device; capturing video using a camera of the mobile device upon detecting the signature motion; and automatically identifying a start frame and an end frame of the captured images using neural networks. A mobile device for capturing a photo is also described.
    Type: Application
    Filed: March 29, 2019
    Publication date: August 20, 2020
    Applicant: Samsung Electronics, Co. Ltd.
    Inventors: David Liu, Michael Polley, Youngjun F. Yoo, Hamid Rahim Sheikh, Kaimo Lin, George Chen, Chenchi Luo