Patents by Inventor Mostafa El-Khamy

Mostafa El-Khamy has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11979175
    Abstract: A method and apparatus for variable rate compression with a conditional autoencoder is herein provided. According to one embodiment, a method for compression includes receiving a first image and a first scheme as inputs for an autoencoder network; determining a first Lagrange multiplier based on the first scheme; and using the first image and the first Lagrange multiplier as inputs, computing a second image from the autoencoder network. The autoencoder network is trained using a plurality of Lagrange multipliers and a second image as training inputs.
    Type: Grant
    Filed: September 9, 2022
    Date of Patent: May 7, 2024
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Yoo Jin Choi, Mostafa El-Khamy, Jungwon Lee
  • Publication number: 20240127589
    Abstract: A system and a method are disclosed for processing and combining feature maps using a hardware friendly multi-kernel convolution block (HFMCB). The method including splitting an input feature map into a plurality of feature maps, each of the plurality of feature maps having a reduced number of channels; processing each of the plurality of feature maps with a different series of kernels; and combining the processed plurality of feature maps.
    Type: Application
    Filed: May 19, 2023
    Publication date: April 18, 2024
    Inventors: Qingfeng LIU, Mostafa EL-KHAMY, Sukhwan LIM
  • Publication number: 20240122519
    Abstract: A system and a method are disclosed for AFib detection using ECG signals generated from monitored PPG signals. A method includes receiving PPG signals of a user measured by a PPG sensor; translating the measured PPG signals into ECG signals using a dynamic model; analyzing the translated ECG signals using an AFib detection model, which is trained on measured ECG signals for AFib detection; and providing the analyzed AFib detection results to the user.
    Type: Application
    Filed: August 30, 2023
    Publication date: April 18, 2024
    Inventors: Mostafa EL-KHAMY, Khoung VO, Yoojin CHOI
  • Patent number: 11948280
    Abstract: A method and system for multi-frame contextual attention are provided. The method includes obtaining a reference frame to be processed, identifying context frames with respect to the reference frame, and producing a refined reference frame by processing the obtained reference frame based on the context frames.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: April 2, 2024
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Mostafa El-Khamy, Ryan Szeto, Jungwon Lee
  • Publication number: 20240070455
    Abstract: A system and a method are disclosed for neural architecture search. In some embodiments, the method includes: processing a training data set with a neural network during a first epoch of training of the neural network; computing a training loss using a smooth maximum unit regularization value; and adjusting a plurality of multiplicative connection weights and a plurality of parametric connection weights of the neural network in a direction that reduces the training loss.
    Type: Application
    Filed: December 29, 2022
    Publication date: February 29, 2024
    Inventors: Mostafa EL-KHAMY, Yanlin ZHOU
  • Patent number: 11900234
    Abstract: Apparatuses and methods of manufacturing same, systems, and methods for generating a convolutional neural network (CNN) are described. In one aspect, a minimal CNN having, e.g., three or more layers is trained. Cascade training may be performed on the trained CNN to insert one or more intermediate layers until a training error is less than a threshold. When cascade training is complete, cascade network trimming of the CNN output from the cascade training may be performed to improve computational efficiency. To further reduce network parameters, convolutional filters may be replaced with dilated convolutional filters with the same receptive field, followed by additional training/fine-tuning.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: February 13, 2024
    Inventors: Haoyu Ren, Mostafa El-Khamy, Jungwon Lee
  • Patent number: 11861859
    Abstract: Method and systems are provided for robust disparity estimation based on cost-volume attention. A method includes extracting first feature maps from left images captured by a first camera; extracting second feature maps from right images captured by a second camera; calculating a matching cost based on a comparison of the first and second feature maps to generate a cost volume; generating an attention-aware cost volume from the generated cost volume; and aggregating the attention-aware cost volume to generate an output disparity.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: January 2, 2024
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Mostafa El-Khamy, Jungwon Lee, Haoyu Ren
  • Patent number: 11847826
    Abstract: A method for computing a dominant class of a scene includes: receiving an input image of a scene; generating a segmentation map of the input image, the segmentation map being labeled with a plurality of corresponding classes of a plurality of classes; computing a plurality of area ratios based on the segmentation map, each of the area ratios corresponding to a different class of the plurality of classes of the segmentation map; and outputting a detected dominant class of the scene based on a plurality of ranked labels based on the area ratios.
    Type: Grant
    Filed: December 16, 2022
    Date of Patent: December 19, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Qingfeng Liu, Mostafa El-Khamy, Rama Mythili Vadali, Tae-ui Kim, Andrea Kang, Dongwoon Bai, Jungwon Lee, Maiyuran Wijay, Jaewon Yoo
  • Publication number: 20230360396
    Abstract: A method for computing a dominant class of a scene includes: receiving an input image of a scene; generating a segmentation map of the input image, the segmentation map being labeled with a plurality of corresponding classes of a plurality of classes; computing a plurality of area ratios based on the segmentation map, each of the area ratios corresponding to a different class of the plurality of classes of the segmentation map; and outputting a detected dominant class of the scene based on a plurality of ranked labels based on the area ratios.
    Type: Application
    Filed: July 19, 2023
    Publication date: November 9, 2023
    Inventors: Qingfeng Liu, Mostafa El-Khamy, Rama Mythili Vadali, Tae-ui Kim, Andrea Kang, Dongwoon Bai, Jungwon Lee, Maiyuran Wijay, Jaewon Yoo
  • Publication number: 20230334318
    Abstract: A method and system for training a neural network are provided. The method includes receiving an input image, selecting at least one data augmentation method from a pool of data augmentation methods, generating an augmented image by applying the selected at least one data augmentation method to the input image, and generating a mixed image from the input image and the augmented image.
    Type: Application
    Filed: June 26, 2023
    Publication date: October 19, 2023
    Inventors: Qingfeng LIU, Mostafa EL-KHAMY, Jungwon LEE, Behnam Babagholami MOHAMADABADI
  • Patent number: 11790489
    Abstract: A method and apparatus are provided. The method includes generating a dataset for real-world super resolution (SR), training a first generative adversarial network (GAN), training a second GAN, and fusing an output of the first GAN and an output of the second GAN.
    Type: Grant
    Filed: December 24, 2020
    Date of Patent: October 17, 2023
    Inventors: Haoyu Ren, Amin Kheradmand, Mostafa El-Khamy, Shuangquan Wang, Dongwoon Bai, Jungwon Lee
  • Patent number: 11784760
    Abstract: Apparatuses (including user equipment (UE) and modern chips for UEs), systems, and methods for UE downlink Hybrid Automatic Repeat reQuest (HARQ) buffer memory management are described. In one method, the entire UE DL HARQ buffer memory space is pre-partitioned according to the number and capacities of the UE's active carrier components. In another method, the UE DL HARQ buffer is split between on-chip and off-chip memory so that each partition and sub-partition is allocated between the on-chip and off-chip memories in accordance with an optimum ratio.
    Type: Grant
    Filed: December 1, 2020
    Date of Patent: October 10, 2023
    Inventors: Mostafa El-Khamy, Arvind Yedla, Sang-Hyuck Ha, Hyunsang Cho, Inyup Kang
  • Publication number: 20230260247
    Abstract: A computer vision system including: one or more processors; and memory including instructions that, when executed by the one or more processors, cause the one or more processors to: determine a semantic multi-scale context feature and an instance multi-scale context feature of an input scene; generate a joint attention map based on the semantic multi-scale context feature and the instance multi-scale context feature; refine the semantic multi-scale context feature and instance multi-scale context feature based on the joint attention map; and generate a panoptic segmentation image based on the refined semantic multi-scale context feature and the refined instance multi-scale context feature.
    Type: Application
    Filed: July 19, 2022
    Publication date: August 17, 2023
    Inventors: Qingfeng Liu, Mostafa El-Khamy
  • Patent number: 11720798
    Abstract: A system for disparity estimation includes one or more feature extractor modules configured to extract one or more feature maps from one or more input images; and one or more semantic information modules connected at one or more outputs of the one or more feature extractor modules, wherein the one or more semantic information modules are configured to generate one or more foreground semantic information to be provided to the one or more feature extractor modules for disparity estimation at a next training epoch.
    Type: Grant
    Filed: May 27, 2021
    Date of Patent: August 8, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Xianzhi Du, Mostafa El-Khamy, Jungwon Lee
  • Publication number: 20230244951
    Abstract: Disclosed is a method and apparatus for dynamic models to identify similar tasks when no task identifier is provided during the training phase in continual learning (CL). The method includes maintaining a memory comprising one or more previously learned tasks, determining, in response to receiving a new task, one of more similarities between at least one previously learned task and the new task, generating, based on the one or more similarities determined and a previously used task-specific encoder corresponding to the at least one previously learned task, a test error value for classifying the new task, and applying the previously used task-specific encoder to the new task based on the generated test error value.
    Type: Application
    Filed: January 20, 2023
    Publication date: August 3, 2023
    Inventors: Yoo Jin CHOI, Mostafa EL-KHAMY, Sijia WANG, Ricardo Henao GIRALDO, Junya CHEN
  • Publication number: 20230237355
    Abstract: A method and system are herein disclosed. The method includes developing a joint latent variable model having a first variable, a second variable, and a joint latent variable representing common information between the first and second variables; generating a variational posterior of the joint latent variable model; training the variational posterior; performing inference of the first variable from the second variable based on the variational posterior, wherein performing the inference comprises conditionally generating the first variable from the second variable; and extracting common information between the first variable and the second variable, wherein extracting the common information comprises adding a regularization term to a loss function.
    Type: Application
    Filed: March 24, 2023
    Publication date: July 27, 2023
    Inventors: Jongha Ryu, Yoo Jin Choi, Mostafa El-Khamy, Jungwon Lee
  • Patent number: 11699070
    Abstract: A method and apparatus for providing a rotational invariant neural network is herein disclosed. According to one embodiment, a method includes receiving a first input of an image in a first orientation and training a kernel to be symmetric such that an output corresponding to the first input is the same as an output corresponding to a second input of the image in a second orientation.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: July 11, 2023
    Inventors: Mostafa El-Khamy, Jungwon Lee, Yoo Jin Choi, Haoyu Ren
  • Publication number: 20230214713
    Abstract: A server and method thereof are provided for use in a federated network. A method includes receiving local updates from client devices; updating a global model based on the received local updates; quantizing the updated global model; reconstructing feature maps based on the received local updates; refining the quantized, updated global model based on the reconstructed feature maps; and transmitting the refined, quantized, updated global model to the client devices.
    Type: Application
    Filed: May 25, 2022
    Publication date: July 6, 2023
    Inventors: Yoo Jin CHOI, Mostafa EL-KHAMY, Sijia WANG
  • Patent number: 11694305
    Abstract: In a method for super resolution imaging, the method includes: receiving, by a processor, a low resolution image; generating, by the processor, an intermediate high resolution image having an improved resolution compared to the low resolution image; generating, by the processor, a final high resolution image based on the intermediate high resolution image and the low resolution image; and transmitting, by the processor, the final high resolution image to a display device for display thereby.
    Type: Grant
    Filed: April 6, 2021
    Date of Patent: July 4, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Mostafa El-Khamy, Jungwon Lee, Haoyu Ren
  • Patent number: 11687780
    Abstract: A method and system for training a neural network are provided. The method includes receiving an input image, selecting at least one data augmentation method from a pool of data augmentation methods, generating an augmented image by applying the selected at least one data augmentation method to the input image, and generating a mixed image from the input image and the augmented image.
    Type: Grant
    Filed: April 27, 2021
    Date of Patent: June 27, 2023
    Inventors: Qingfeng Liu, Mostafa El-Khamy, Jungwon Lee, Behnam Babagholami Mohamadabadi