Patents by Inventor Ibrahim Pekkucuksen

Ibrahim Pekkucuksen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240089606
    Abstract: A method includes obtaining, using at least one processing device of an electronic device, multiple image frames having different exposure levels. The method also includes determining whether a moving saturated region is present in at least some of the image frames. The method further includes selecting one of the image frames as a reference frame, where the selected image frame depends on whether the moving saturated region is present in at least some of the image frames. The selected image frame may have a first exposure level when the moving saturated region is present in at least some of the image frames, and the selected image frame may have a second exposure level longer than the first exposure level when the moving saturated region is not present in the image frames.
    Type: Application
    Filed: September 26, 2023
    Publication date: March 14, 2024
    Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh
  • Patent number: 11889197
    Abstract: A method includes obtaining multiple image frames captured during a multi-frame capture operation. The method also includes determining that two or more of the multiple image frames are available for selection as a reference frame, where the two or more image frames are associated with at least two different exposure levels. The method further includes determining whether a moving saturated region is present in the two or more image frames. The method also includes, in response to determining that the moving saturated region is present, selecting an image frame from among the two or more image frames having a first exposure level. In addition, the method includes, in response to determining that the moving saturated region is not present, selecting an image frame from among the two or more image frames having a second exposure level, where the second exposure level is longer than the first exposure level.
    Type: Grant
    Filed: November 17, 2022
    Date of Patent: January 30, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh
  • Publication number: 20230052082
    Abstract: An apparatus includes at least one processing device configured to obtain an input image and determine a cumulative distribution function (CDF) histogram from a luminance or luma (Y) channel of the input image. The at least one processing device is also configured to determine an entry CDF histogram in a CDF histogram lookup table (LUT) closest to the determined CDF histogram. The at least one processing device is further configured to apply a Y channel global tone mapping (GTM) curve to the input image based on one or more parameters assigned to the entry CDF histogram from the CDF histogram LUT.
    Type: Application
    Filed: January 27, 2022
    Publication date: February 16, 2023
    Inventors: Ibrahim Pekkucuksen, Kaimo Lin, Hamid R. Sheikh
  • Patent number: 11388348
    Abstract: A method includes obtaining, using at least one processor of an electronic device, a high dynamic range (HDR) input Bayer image. The method also includes generating, using the at least one processor of the electronic device, a plurality of synthesized images at different exposure levels based on the input Bayer image. The method further includes fusing, using the at least one processor of the electronic device, the synthesized images to generate a fused image. The method also includes generating, using the at least one processor of the electronic device, a gain map based on the fused image. In addition, the method includes applying, using the at least one processor of the electronic device, a gain based on the gain map to the input Bayer image.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: July 12, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Long N. Le, Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen
  • Publication number: 20220021802
    Abstract: A method includes obtaining, using at least one processor of an electronic device, a high dynamic range (HDR) input Bayer image. The method also includes generating, using the at least one processor of the electronic device, a plurality of synthesized images at different exposure levels based on the input Bayer image. The method further includes fusing, using the at least one processor of the electronic device, the synthesized images to generate a fused image. The method also includes generating, using the at least one processor of the electronic device, a gain map based on the fused image. In addition, the method includes applying, using the at least one processor of the electronic device, a gain based on the gain map to the input Bayer image.
    Type: Application
    Filed: December 31, 2020
    Publication date: January 20, 2022
    Inventors: Long N. Le, Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen
  • Patent number: 11128809
    Abstract: An electronic device, method, and computer readable medium for compositing high dynamic range frames are provided. The electronic device includes a camera, and a processor coupled to the camera. The processor registers the plurality of multi-exposure frames with a hybrid of matched features to align non-reference frames with a reference frame; generates blending maps of the plurality of multi-exposure frames to reduce moving ghost artifacts and identify local areas that are well-exposed in the plurality of multi-exposure frames; and blends the plurality of multi-exposure frames weighted by the blending maps using a two-step weight-constrained exposure fusion technique into a high dynamic range (HDR) frame.
    Type: Grant
    Filed: February 15, 2019
    Date of Patent: September 21, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ruiwen Zhen, John Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
  • Patent number: 11107205
    Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device. The method also includes using a convolutional neural network to generate blending maps associated with the image frames. The blending maps contain or are based on both a measure of motion in the image frames and a measure of how well exposed different portions of the image frames are. The method further includes generating a final image of the scene using at least some of the image frames and at least some of the blending maps. The final image of the scene may be generated by blending the at least some of the image frames using the at least some of the blending maps, and the final image of the scene may include image details that are lost in at least one of the image frames due to over-exposure or under-exposure.
    Type: Grant
    Filed: February 18, 2019
    Date of Patent: August 31, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yuting Hu, Ruiwen Zhen, John W. Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
  • Patent number: 11095829
    Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: August 17, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen, Zhen Tong, Long N. Le
  • Patent number: 11062436
    Abstract: A method for multi-frame blending includes obtaining at least two image frames of a scene. One of the image frames is associated with a shorter exposure time and a higher sensitivity and representing a reference image frame. At least one other of the image frames is associated with a longer exposure time and a lower sensitivity and representing at least one non-reference image frame. The method also includes blending the reference and non-reference image frames into a blended image such that (i) one or more motion regions of the blended image are based more on the reference image frame and (ii) one or more stationary regions of the blended image are based more on the at least one non-reference image frame.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: July 13, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh, John W. Glotzbach
  • Patent number: 11064133
    Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: July 13, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen, Zhen Tong, Long N. Le
  • Patent number: 10949959
    Abstract: A method of processing image data in a composite image is described. The method comprises analyzing a multi-level blending of images of the composite image; identifying sharp transition boundary areas of the composite image; applying less attenuation for higher levels of multi-level blending of the composite image in the sharp transition boundary areas; and applying more attenuation for lower levels of multi-level blending of the composite image in the sharp transition boundary areas.
    Type: Grant
    Filed: February 18, 2019
    Date of Patent: March 16, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: John W Glotzbach, Ruiwen Zhen, Ibrahim Pekkucuksen, Hamid Rahim Sheikh
  • Publication number: 20200396370
    Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.
    Type: Application
    Filed: August 19, 2019
    Publication date: December 17, 2020
    Inventors: Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen, Zhen Tong, Long N. Le
  • Publication number: 20200357102
    Abstract: A method for multi-frame blending includes obtaining at least two image frames of a scene. One of the image frames is associated with a shorter exposure time and a higher sensitivity and representing a reference image frame. At least one other of the image frames is associated with a longer exposure time and a lower sensitivity and representing at least one non-reference image frame. The method also includes blending the reference and non-reference image frames into a blended image such that (i) one or more motion regions of the blended image are based more on the reference image frame and (ii) one or more stationary regions of the blended image are based more on the at least one non-reference image frame.
    Type: Application
    Filed: September 16, 2019
    Publication date: November 12, 2020
    Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh, John W. Glotzbach
  • Publication number: 20200267300
    Abstract: An electronic device, method, and computer readable medium for compositing high dynamic range frames are provided. The electronic device includes a camera, and a processor coupled to the camera. The processor registers the plurality of multi-exposure frames with a hybrid of matched features to align non-reference frames with a reference frame; generates blending maps of the plurality of multi-exposure frames to reduce moving ghost artifacts and identify local areas that are well-exposed in the plurality of multi-exposure frames; and blends the plurality of multi-exposure frames weighted by the blending maps using a two-step weight-constrained exposure fusion technique into a high dynamic range (HDR) frame.
    Type: Application
    Filed: February 15, 2019
    Publication date: August 20, 2020
    Inventors: Ruiwen Zhen, John Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
  • Publication number: 20200265567
    Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device. The method also includes using a convolutional neural network to generate blending maps associated with the image frames. The blending maps contain or are based on both a measure of motion in the image frames and a measure of how well exposed different portions of the image frames are. The method further includes generating a final image of the scene using at least some of the image frames and at least some of the blending maps. The final image of the scene may be generated by blending the at least some of the image frames using the at least some of the blending maps, and the final image of the scene may include image details that are lost in at least one of the image frames due to over-exposure or under-exposure.
    Type: Application
    Filed: February 18, 2019
    Publication date: August 20, 2020
    Inventors: Yuting Hu, Ruiwen Zhen, John W. Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
  • Publication number: 20200265566
    Abstract: A method of processing image data in a composite image is described. The method comprises analyzing a multi-level blending of images of the composite image; identifying sharp transition boundary areas of the composite image; applying less attenuation for higher levels of multi-level blending of the composite image in the sharp transition boundary areas; and applying more attenuation for lower levels of multi-level blending of the composite image in the sharp transition boundary areas.
    Type: Application
    Filed: February 18, 2019
    Publication date: August 20, 2020
    Applicant: Samsung Electronics Co., Ltd.
    Inventors: John W Glotzbach, Ruiwen Zhen, Ibrahim Pekkucuksen, Hamid Rahim Sheikh
  • Publication number: 20200020085
    Abstract: A method of combining content from multiple frames with overlapping field of views is described. The method comprises identifying corresponding blocks between a first frame and a second frame of an image; and determining whether to replace at least a portion of the first frame with a corresponding portion of the second frame based on whether there is a match between the first frame and the second frame.
    Type: Application
    Filed: July 16, 2018
    Publication date: January 16, 2020
    Applicant: Samsung Electronics Co., Ltd.
    Inventors: Ibrahim Pekkucuksen, Hamid Rahim Sheikh, John E. Glotzbach, Ruiwen Zhen
  • Patent number: 10097765
    Abstract: The method includes in order to generate a composite image: identifying, in the frame of a video stream captured by a camera, a motion characteristic associated with moving objects in a scene while the camera captured a sliding window of the video stream. The method includes for a plurality of frames in the sliding window: controlling, by the processing circuitry, a weight of blending of the frame based on the identified motion characteristic to enable the composite image to be generated according to the controlled weights of blending of the plurality of frames in the sliding window.
    Type: Grant
    Filed: April 20, 2016
    Date of Patent: October 9, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hamid Rahim Sheikh, Ibrahim Pekkucuksen, John Glotzbach
  • Publication number: 20170310901
    Abstract: The method includes in order to generate a composite image: identifying, in the frame of a video stream captured by a camera, a motion characteristic associated with moving objects in a scene while the camera captured a sliding window of the video stream. The method includes for a plurality of frames in the sliding window: controlling, by the processing circuitry, a weight of blending of the frame based on the identified motion characteristic to enable the composite image to be generated according to the controlled weights of blending of the plurality of frames in the sliding window.
    Type: Application
    Filed: April 20, 2016
    Publication date: October 26, 2017
    Inventors: Hamid Rahim Sheikh, Ibrahim Pekkucuksen, John Glotzbach
  • Patent number: 9533618
    Abstract: A method, apparatus and a system multi-camera image processing method. The method includes performing geometric alignment to produce a geometric output, performing photometric alignment to produce a photometric output and blending output, using data from the geometric alignment and the photometric alignment for performing synthesis function for at least one of blending and stitching images from the multi-cameras, and displaying an image from the synthesis function.
    Type: Grant
    Filed: March 9, 2015
    Date of Patent: January 3, 2017
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Buyue Zhang, Ibrahim Pekkucuksen, Vikram Appia, Aziz Umit Batur