Patents by Inventor Hamid R. Sheikh

Hamid R. Sheikh has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12380535
    Abstract: A method includes extracting multiple shallow features from a low-resolution image using a shallow feature extractor that includes a quaternion convolutional network. The method also includes extracting multiple deep features from the multiple shallow features using a deep feature extractor that includes multiple quaternion residual distillation blocks (QRDBs), where each QRDB includes a quaternion self-attention module. The method further includes reconstructing the multiple deep features into a high-resolution image. Each QRDB may further include a quaternion gated deconvolutional feed forward network (QGDFN) configured to suppress one or more of the multiple deep features.
    Type: Grant
    Filed: July 27, 2023
    Date of Patent: August 5, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Devendra Kumar Jangid, Abhiram Gnanasambandam, John W. Glotzbach, John Seokjun Lee, Hamid R Sheikh
  • Publication number: 20250245796
    Abstract: A method includes generating, using at least one processing device, a ground truth optical flow map for displacement of pixels within a reference image based on a motion model. The motion model determines 3D coordinates of pixels within the reference image based on estimated depths of the pixels within the reference image. The method also includes performing, using the at least one processing device, 3D to 2D reprojection of the pixels within the reference image based on the motion model to generate a reprojected image view corresponding to a shifted camera perspective. The method further includes generating, using the at least one processing device, an occlusion mask for the reference image. The occlusion mask corresponds to occluded pixels within the reprojected image view. In addition, the method includes performing, using the at least one processing device, occlusion region inpainting of the occluded pixels to generate an inpainted reprojected image view.
    Type: Application
    Filed: January 29, 2024
    Publication date: July 31, 2025
    Inventors: Joshua D. Rego, Zeeshan Nadir, Pavan Madhusudanarao, Hamid R. Sheikh
  • Patent number: 12367550
    Abstract: A method includes dividing an image into overlapping image patches each having a specified size. The method also includes analyzing content of each image patch using a mathematical transform technique to classify each image patch into at least one class. The method further includes filtering each image patch for noise suppression by suppressing one or more transform coefficients of the image patch. An amount of suppression for each of the one or more transform coefficients is selected according to the at least one class of the image patch. In addition, the method includes reconstructing the filtered image patches into an output image.
    Type: Grant
    Filed: September 7, 2022
    Date of Patent: July 22, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Zeeshan Nadir, Hamid R. Sheikh, John W. Glotzbach
  • Publication number: 20250225719
    Abstract: A first image frame and a second image frame are captured using first and second under-display cameras positioned under an LED display. The second image frame is globally aligned to the first image frame to generate a globally-aligned second image frame. An optical flow map based on the first image frame and the globally-aligned second image frame is generated, and an occlusion map based on the first image frame and the globally-aligned second image frame is generated. The globally-aligned second image frame is warped based on the optical flow map and the occlusion map to generate a warped image frame. The first image frame and the warped image frame are blended to generate an output image.
    Type: Application
    Filed: October 17, 2024
    Publication date: July 10, 2025
    Inventors: Chengyu Wang, Jing Li, Jinhan Hu, Pavan Madhusudanarao, Hamid R. Sheikh, John Seokjun Lee
  • Publication number: 20250217924
    Abstract: A method includes obtaining, using at least one processing device of an electronic device, multiple image frames capturing a scene. The method also includes selecting, using the at least one processing device, a reference frame among the image frames. The method further includes aligning, using the at least one processing device, each of one or more non-reference frames among the image frames with the reference frame by (i) performing tile-based registration of the non-reference frame to the reference frame, (ii) performing feature-based registration of the non-reference frame to the reference frame, (iii) aggregating first motion vectors generated during the tile-based registration and second motion vectors generated during the feature-based registration, and (iv) warping the non-reference frame based on the aggregated motion vectors to generate an aligned non-reference frame. The reference frame and the one or more aligned non-reference frames may be blended to generate a final image of the scene.
    Type: Application
    Filed: September 10, 2024
    Publication date: July 3, 2025
    Inventors: Ibrahim E. Pekkucuksen, Nguyen Thang Long Le, Hamid R. Sheikh
  • Patent number: 12347110
    Abstract: A method includes obtaining a raw image in a first image domain. The method also includes determining a color distribution and an amount of variation in the raw image. The method further includes using an iterative process to generate a dead leaf image from a blank image in the first image domain. The iterative process includes adding multiple circles and multiple sticks to the blank image until the dead leaf image is filled. The iterative process also includes blurring portions of the dead leaf image during at least one iteration of the iterative process. Textures of the multiple circles are blended based on the color distribution and the amount of variation in the raw image.
    Type: Grant
    Filed: November 30, 2022
    Date of Patent: July 1, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Mingzhao Yu, Zeeshan Nadir, Hamid R. Sheikh, John W. Glotzbach
  • Publication number: 20250200728
    Abstract: A method includes obtaining, using at least one processing device of an electronic device, multiple input image frames generated during a multi-frame capture operation, where each input image frame exhibits an amount of blur. The method also includes determining, using the at least one processing device, a blurriness score for each of the input image frames. The method further includes generating, using the at least one processing device, sharp denoised frames using the input image frames. In addition, the method includes generating, using the at least one processing device, a final sharp image based on the sharp denoised frames and the blurriness scores of the input image frames.
    Type: Application
    Filed: December 14, 2023
    Publication date: June 19, 2025
    Inventors: Yash Sanghvi, Abhiram Gnanasambandam, John Seokjun Lee, Hamid R. Sheikh
  • Publication number: 20250191393
    Abstract: A method includes obtaining, using at least one processing device of an electronic device, a sequence of images of a scene. The method also includes performing, using the at least one processing device, instance segmentation of the sequence of images to generate a sequence of segmented images. Performing the instance segmentation includes (i) segmenting each of the images into semantic classes and (ii) separately identifying two or more objects in the scene associated with a common semantic class, where different semantic classes are associated with different types of image contents. The method further includes processing, using the at least one processing device, the sequence of segmented images to generate a final image of the scene. The sequence of segmented images is processed using one or more image processing operations determined using a natural language processing (NLP) engine.
    Type: Application
    Filed: December 7, 2023
    Publication date: June 12, 2025
    Inventors: Gunawath Dilshan Godaliyadda, Zeeshan Nadir, Soumendu Majee, John W. Glotzbach, John Seokjun Lee, Hamid R. Sheikh, Michael O. Polley
  • Publication number: 20250191152
    Abstract: A method includes obtaining a high dynamic range (HDR) image and generating low dynamic range (LDR) images based on the HDR image, where at least some of the LDR images are associated with different exposure levels. The method also includes generating tone-type weight maps based on the LDR images, where at least one of the LDR images is associated with two or more of the tone-type weight maps. The method further includes generating blending weights for the LDR images based on the tone-type weight maps, where the blending weights for at least one of the LDR images are based on at least two tone-type weight maps associated with at least two of the LDR images.
    Type: Application
    Filed: December 12, 2023
    Publication date: June 12, 2025
    Inventors: Nguyen Thang Long Le, Hamid R. Sheikh
  • Publication number: 20250117894
    Abstract: A method includes obtaining multiple input image frames and generating bad pixel maps associated with different ones of the input image frames. Each bad pixel map is generated using first and second adaptive thresholds that are based on statistical properties of image data contained in a specified operation window within the associated input image frame. The method also includes generating at least one refined bad pixel map using the bad pixel maps associated with two or more of the input image frames. The method further includes using one or more coordinates of one or more bad pixels identified in the at least one refined bad pixel map to update one or more pixel values of at least one of the input image frames.
    Type: Application
    Filed: October 4, 2023
    Publication date: April 10, 2025
    Inventors: Madhuri Suthar, Nguyen Thang Long Le, Tyler Luu, Hamid R. Sheikh
  • Patent number: 12272032
    Abstract: A method includes obtaining an input image that contains blur. The method also includes providing the input image to a trained machine learning model, where the trained machine learning model includes (i) a shallow feature extractor configured to extract one or more feature maps from the input image and (ii) a deep feature extractor configured to extract deep features from the one or more feature maps. The method further includes using the trained machine learning model to generate a sharpened output image. The trained machine learning model is trained using ground truth training images and input training images, where the input training images include versions of the ground truth training images with blur created using demosaic and noise filtering operations.
    Type: Grant
    Filed: August 18, 2022
    Date of Patent: April 8, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Devendra K. Jangid, John Seokjun Lee, Hamid R. Sheikh
  • Publication number: 20250113097
    Abstract: A method includes obtaining, using at least one under display camera, one or more first image frames associated with a first diffraction pattern and one or more second image frames associated with a second diffraction pattern. The first diffraction pattern and the second diffraction pattern are related through a transformation. The method also includes generating a first deblurred image using the one or more first image frames and a second deblurred image using the one or more second image frames. The method further includes combining the first and second deblurred images while exploiting complementary types of image artifacts created by the first and second diffraction patterns to generate an image of a scene.
    Type: Application
    Filed: September 28, 2023
    Publication date: April 3, 2025
    Inventors: Jinhan Hu, Jing Li, Chengyu Wang, Pavan C. Madhusudanarao, Hamid R. Sheikh, John Seokjun Lee
  • Patent number: 12254601
    Abstract: A method includes obtaining a blended red-green-blue (RGB) image frame of a scene. The method also includes performing, using at least one processing device of an electronic device, an interband denoising operation to remove at least one of noise and one or more artifacts from the blended RGB image frame in order to produce a denoised RGB image frame. Performing the interband denoising operation includes performing filtering of red, green, and blue color channels of the blended RGB image frame to remove at least one of the noise and the one or more artifacts from the blended RGB image frame. The filtering of the red and blue color channels of the blended RGB image frame is based on image data of at least one of the green color channel and a white color channel of the blended RGB image frame.
    Type: Grant
    Filed: January 27, 2022
    Date of Patent: March 18, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Long N. Le, Yibo Xu, John W. Glotzbach, Zhen Tong, Hamid R. Sheikh
  • Patent number: 12238424
    Abstract: A method includes obtaining, using at least one processing device of an electronic device, multiple image frames having different exposure levels. The method also includes determining whether a moving saturated region is present in at least some of the image frames. The method further includes selecting one of the image frames as a reference frame, where the selected image frame depends on whether the moving saturated region is present in at least some of the image frames. The selected image frame may have a first exposure level when the moving saturated region is present in at least some of the image frames, and the selected image frame may have a second exposure level longer than the first exposure level when the moving saturated region is not present in the image frames.
    Type: Grant
    Filed: September 26, 2023
    Date of Patent: February 25, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ibrahim Pekkucuksen, Hamid R. Sheikh
  • Patent number: 12230053
    Abstract: An apparatus includes a memory configured to store images and a processor. The processor is configured to receive an input image. The processor is further configured to partition a human mask in the input image using a segmentation algorithm. The processor is also configured to generate a skin map based on identifying skin in the input image using the human mask. In addition, the processor is configured to process an output image with brightening applied using the skin map.
    Type: Grant
    Filed: February 2, 2022
    Date of Patent: February 18, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Zeeshan Nadir, John W. Glotzbach, Hamid R. Sheikh
  • Patent number: 12231780
    Abstract: A method includes obtaining multiple image frames. The method also includes selecting, using at least one processing device of an electronic device, an asymmetrical image pair from the multiple image frames. The asymmetrical image pair includes a first image frame and a second image frame, where the first image frame has a shorter exposure than the second image frame. The method further includes identifying, using the at least one processing device, one or more features based on the asymmetrical image pair. The method also includes determining, using the at least one processing device, whether the first image frame contains flicker based on the one or more features. In addition, the method includes enabling or disabling, using the at least one processing device, the first image frame as a reference candidate based on the determination whether the first image frame contains flicker.
    Type: Grant
    Filed: November 29, 2022
    Date of Patent: February 18, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Nguyen Thang Long Le, Zeeshan Nadir, John W. Glotzbach, Hamid R. Sheikh
  • Publication number: 20250045867
    Abstract: A method includes obtaining a ground truth image and generating multiple image frames using the ground truth image, a modeled optical blur, and a modeled global motion. The method also includes generating multiple mosaic image frames using the image frames and a color filter array and generating multiple raw input image frames using the mosaic image frames and a noise model associated with at least one imaging sensor. The method further includes providing the raw input image frames to a multi-frame processing pipeline in order to generate synthetic training data. In addition, the method includes training a machine learning-based image processing engine using the ground truth image and the synthetic training data.
    Type: Application
    Filed: August 1, 2023
    Publication date: February 6, 2025
    Inventors: Abhiram Gnanasambandam, John W. Glotzbach, John Seokjun Lee, Hamid R. Sheikh
  • Publication number: 20250037237
    Abstract: A method includes extracting multiple shallow features from a low-resolution image using a shallow feature extractor that includes a quaternion convolutional network. The method also includes extracting multiple deep features from the multiple shallow features using a deep feature extractor that includes multiple quaternion residual distillation blocks (QRDBs), where each QRDB includes a quaternion self-attention module. The method further includes reconstructing the multiple deep features into a high-resolution image. Each QRDB may further include a quaternion gated deconvolutional feed forward network (QGDFN) configured to suppress one or more of the multiple deep features.
    Type: Application
    Filed: July 27, 2023
    Publication date: January 30, 2025
    Inventors: Devendra Kumar Jangid, Abhiram Gnanasambandam, John W. Glotzbach, John Seokjun Lee, Hamid R. Sheikh
  • Publication number: 20250037250
    Abstract: A method includes obtaining, using at least one processing device of an electronic device, an input image containing blur. The method also includes generating, using the at least one processing device, an edge enhancement mask and a gain mask based on the input image. The method further includes generating, using the at least one processing device, a halo-suppressed edge mask based on the edge enhancement mask and the gain mask. In addition, the method includes generating, using the at least one processing device, a sharpened image based on the input image and the halo-suppressed edge mask.
    Type: Application
    Filed: October 19, 2023
    Publication date: January 30, 2025
    Inventors: Gunawath Dilshan Godaliyadda, Tyler Luu, John W. Glotzbach, Hamid R. Sheikh
  • Patent number: 12206993
    Abstract: A method includes obtaining, using at least one image sensor of an electronic device, a first image frame and multiple second image frames of a scene. Each of the second image frames has an exposure time different from an exposure time of the first image frame. The method also includes generating, using at least one processor, blur kernels indicating a motion direction of the first image frame using an optical flow network. The method further includes refining, using the at least one processor, the blur kernels using a convolutional neural network. In addition, the method includes generating, using the at least one processor, a target image frame of the scene using the refined blur kernels and occlusion masks for the second image frames.
    Type: Grant
    Filed: October 4, 2022
    Date of Patent: January 21, 2025
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Anqi Yang, John W. Glotzbach, Hamid R. Sheikh