Patents by Inventor Ibrahim Pekkucuksen
Ibrahim Pekkucuksen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240089606Abstract: A method includes obtaining, using at least one processing device of an electronic device, multiple image frames having different exposure levels. The method also includes determining whether a moving saturated region is present in at least some of the image frames. The method further includes selecting one of the image frames as a reference frame, where the selected image frame depends on whether the moving saturated region is present in at least some of the image frames. The selected image frame may have a first exposure level when the moving saturated region is present in at least some of the image frames, and the selected image frame may have a second exposure level longer than the first exposure level when the moving saturated region is not present in the image frames.Type: ApplicationFiled: September 26, 2023Publication date: March 14, 2024Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh
-
Patent number: 11889197Abstract: A method includes obtaining multiple image frames captured during a multi-frame capture operation. The method also includes determining that two or more of the multiple image frames are available for selection as a reference frame, where the two or more image frames are associated with at least two different exposure levels. The method further includes determining whether a moving saturated region is present in the two or more image frames. The method also includes, in response to determining that the moving saturated region is present, selecting an image frame from among the two or more image frames having a first exposure level. In addition, the method includes, in response to determining that the moving saturated region is not present, selecting an image frame from among the two or more image frames having a second exposure level, where the second exposure level is longer than the first exposure level.Type: GrantFiled: November 17, 2022Date of Patent: January 30, 2024Assignee: Samsung Electronics Co., Ltd.Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh
-
Publication number: 20230052082Abstract: An apparatus includes at least one processing device configured to obtain an input image and determine a cumulative distribution function (CDF) histogram from a luminance or luma (Y) channel of the input image. The at least one processing device is also configured to determine an entry CDF histogram in a CDF histogram lookup table (LUT) closest to the determined CDF histogram. The at least one processing device is further configured to apply a Y channel global tone mapping (GTM) curve to the input image based on one or more parameters assigned to the entry CDF histogram from the CDF histogram LUT.Type: ApplicationFiled: January 27, 2022Publication date: February 16, 2023Inventors: Ibrahim Pekkucuksen, Kaimo Lin, Hamid R. Sheikh
-
Patent number: 11388348Abstract: A method includes obtaining, using at least one processor of an electronic device, a high dynamic range (HDR) input Bayer image. The method also includes generating, using the at least one processor of the electronic device, a plurality of synthesized images at different exposure levels based on the input Bayer image. The method further includes fusing, using the at least one processor of the electronic device, the synthesized images to generate a fused image. The method also includes generating, using the at least one processor of the electronic device, a gain map based on the fused image. In addition, the method includes applying, using the at least one processor of the electronic device, a gain based on the gain map to the input Bayer image.Type: GrantFiled: December 31, 2020Date of Patent: July 12, 2022Assignee: Samsung Electronics Co., Ltd.Inventors: Long N. Le, Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen
-
Publication number: 20220021802Abstract: A method includes obtaining, using at least one processor of an electronic device, a high dynamic range (HDR) input Bayer image. The method also includes generating, using the at least one processor of the electronic device, a plurality of synthesized images at different exposure levels based on the input Bayer image. The method further includes fusing, using the at least one processor of the electronic device, the synthesized images to generate a fused image. The method also includes generating, using the at least one processor of the electronic device, a gain map based on the fused image. In addition, the method includes applying, using the at least one processor of the electronic device, a gain based on the gain map to the input Bayer image.Type: ApplicationFiled: December 31, 2020Publication date: January 20, 2022Inventors: Long N. Le, Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen
-
Patent number: 11128809Abstract: An electronic device, method, and computer readable medium for compositing high dynamic range frames are provided. The electronic device includes a camera, and a processor coupled to the camera. The processor registers the plurality of multi-exposure frames with a hybrid of matched features to align non-reference frames with a reference frame; generates blending maps of the plurality of multi-exposure frames to reduce moving ghost artifacts and identify local areas that are well-exposed in the plurality of multi-exposure frames; and blends the plurality of multi-exposure frames weighted by the blending maps using a two-step weight-constrained exposure fusion technique into a high dynamic range (HDR) frame.Type: GrantFiled: February 15, 2019Date of Patent: September 21, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Ruiwen Zhen, John Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
-
Patent number: 11107205Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device. The method also includes using a convolutional neural network to generate blending maps associated with the image frames. The blending maps contain or are based on both a measure of motion in the image frames and a measure of how well exposed different portions of the image frames are. The method further includes generating a final image of the scene using at least some of the image frames and at least some of the blending maps. The final image of the scene may be generated by blending the at least some of the image frames using the at least some of the blending maps, and the final image of the scene may include image details that are lost in at least one of the image frames due to over-exposure or under-exposure.Type: GrantFiled: February 18, 2019Date of Patent: August 31, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Yuting Hu, Ruiwen Zhen, John W. Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
-
Patent number: 11095829Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.Type: GrantFiled: August 19, 2019Date of Patent: August 17, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen, Zhen Tong, Long N. Le
-
Techniques for combining image frames captured using different exposure settings into blended images
Patent number: 11062436Abstract: A method for multi-frame blending includes obtaining at least two image frames of a scene. One of the image frames is associated with a shorter exposure time and a higher sensitivity and representing a reference image frame. At least one other of the image frames is associated with a longer exposure time and a lower sensitivity and representing at least one non-reference image frame. The method also includes blending the reference and non-reference image frames into a blended image such that (i) one or more motion regions of the blended image are based more on the reference image frame and (ii) one or more stationary regions of the blended image are based more on the at least one non-reference image frame.Type: GrantFiled: September 16, 2019Date of Patent: July 13, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh, John W. Glotzbach -
Patent number: 11064133Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.Type: GrantFiled: August 19, 2019Date of Patent: July 13, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen, Zhen Tong, Long N. Le
-
Patent number: 10949959Abstract: A method of processing image data in a composite image is described. The method comprises analyzing a multi-level blending of images of the composite image; identifying sharp transition boundary areas of the composite image; applying less attenuation for higher levels of multi-level blending of the composite image in the sharp transition boundary areas; and applying more attenuation for lower levels of multi-level blending of the composite image in the sharp transition boundary areas.Type: GrantFiled: February 18, 2019Date of Patent: March 16, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: John W Glotzbach, Ruiwen Zhen, Ibrahim Pekkucuksen, Hamid Rahim Sheikh
-
Publication number: 20200396370Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.Type: ApplicationFiled: August 19, 2019Publication date: December 17, 2020Inventors: Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh, Ibrahim Pekkucuksen, Zhen Tong, Long N. Le
-
TECHNIQUES FOR COMBINING IMAGE FRAMES CAPTURED USING DIFFERENT EXPOSURE SETTINGS INTO BLENDED IMAGES
Publication number: 20200357102Abstract: A method for multi-frame blending includes obtaining at least two image frames of a scene. One of the image frames is associated with a shorter exposure time and a higher sensitivity and representing a reference image frame. At least one other of the image frames is associated with a longer exposure time and a lower sensitivity and representing at least one non-reference image frame. The method also includes blending the reference and non-reference image frames into a blended image such that (i) one or more motion regions of the blended image are based more on the reference image frame and (ii) one or more stationary regions of the blended image are based more on the at least one non-reference image frame.Type: ApplicationFiled: September 16, 2019Publication date: November 12, 2020Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh, John W. Glotzbach -
Publication number: 20200267300Abstract: An electronic device, method, and computer readable medium for compositing high dynamic range frames are provided. The electronic device includes a camera, and a processor coupled to the camera. The processor registers the plurality of multi-exposure frames with a hybrid of matched features to align non-reference frames with a reference frame; generates blending maps of the plurality of multi-exposure frames to reduce moving ghost artifacts and identify local areas that are well-exposed in the plurality of multi-exposure frames; and blends the plurality of multi-exposure frames weighted by the blending maps using a two-step weight-constrained exposure fusion technique into a high dynamic range (HDR) frame.Type: ApplicationFiled: February 15, 2019Publication date: August 20, 2020Inventors: Ruiwen Zhen, John Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
-
Publication number: 20200265567Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device. The method also includes using a convolutional neural network to generate blending maps associated with the image frames. The blending maps contain or are based on both a measure of motion in the image frames and a measure of how well exposed different portions of the image frames are. The method further includes generating a final image of the scene using at least some of the image frames and at least some of the blending maps. The final image of the scene may be generated by blending the at least some of the image frames using the at least some of the blending maps, and the final image of the scene may include image details that are lost in at least one of the image frames due to over-exposure or under-exposure.Type: ApplicationFiled: February 18, 2019Publication date: August 20, 2020Inventors: Yuting Hu, Ruiwen Zhen, John W. Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
-
Publication number: 20200265566Abstract: A method of processing image data in a composite image is described. The method comprises analyzing a multi-level blending of images of the composite image; identifying sharp transition boundary areas of the composite image; applying less attenuation for higher levels of multi-level blending of the composite image in the sharp transition boundary areas; and applying more attenuation for lower levels of multi-level blending of the composite image in the sharp transition boundary areas.Type: ApplicationFiled: February 18, 2019Publication date: August 20, 2020Applicant: Samsung Electronics Co., Ltd.Inventors: John W Glotzbach, Ruiwen Zhen, Ibrahim Pekkucuksen, Hamid Rahim Sheikh
-
Publication number: 20200020085Abstract: A method of combining content from multiple frames with overlapping field of views is described. The method comprises identifying corresponding blocks between a first frame and a second frame of an image; and determining whether to replace at least a portion of the first frame with a corresponding portion of the second frame based on whether there is a match between the first frame and the second frame.Type: ApplicationFiled: July 16, 2018Publication date: January 16, 2020Applicant: Samsung Electronics Co., Ltd.Inventors: Ibrahim Pekkucuksen, Hamid Rahim Sheikh, John E. Glotzbach, Ruiwen Zhen
-
Patent number: 10097765Abstract: The method includes in order to generate a composite image: identifying, in the frame of a video stream captured by a camera, a motion characteristic associated with moving objects in a scene while the camera captured a sliding window of the video stream. The method includes for a plurality of frames in the sliding window: controlling, by the processing circuitry, a weight of blending of the frame based on the identified motion characteristic to enable the composite image to be generated according to the controlled weights of blending of the plurality of frames in the sliding window.Type: GrantFiled: April 20, 2016Date of Patent: October 9, 2018Assignee: Samsung Electronics Co., Ltd.Inventors: Hamid Rahim Sheikh, Ibrahim Pekkucuksen, John Glotzbach
-
Publication number: 20170310901Abstract: The method includes in order to generate a composite image: identifying, in the frame of a video stream captured by a camera, a motion characteristic associated with moving objects in a scene while the camera captured a sliding window of the video stream. The method includes for a plurality of frames in the sliding window: controlling, by the processing circuitry, a weight of blending of the frame based on the identified motion characteristic to enable the composite image to be generated according to the controlled weights of blending of the plurality of frames in the sliding window.Type: ApplicationFiled: April 20, 2016Publication date: October 26, 2017Inventors: Hamid Rahim Sheikh, Ibrahim Pekkucuksen, John Glotzbach
-
Patent number: 9533618Abstract: A method, apparatus and a system multi-camera image processing method. The method includes performing geometric alignment to produce a geometric output, performing photometric alignment to produce a photometric output and blending output, using data from the geometric alignment and the photometric alignment for performing synthesis function for at least one of blending and stitching images from the multi-cameras, and displaying an image from the synthesis function.Type: GrantFiled: March 9, 2015Date of Patent: January 3, 2017Assignee: TEXAS INSTRUMENTS INCORPORATEDInventors: Buyue Zhang, Ibrahim Pekkucuksen, Vikram Appia, Aziz Umit Batur