Patents by Inventor Laszlo JENI

Laszlo JENI has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240161376
    Abstract: In an example, a method may include obtaining, from a data source, first data including multiple frames each including a human face. The method may include automatically detecting, in each of the multiple frames, one or more facial landmarks and one or more action units (AUs) associated with the human face. The method may also include automatically generating one or more semantic masks based at least on the one or more facial landmarks, the one or more semantic masks individually corresponding to the human face. The method may further include obtaining a facial hyperspace using at least the first data, the one or more AUs, and the semantic masks. The method may also include generating a synthetic image of the human face using a first frame of the multiple frames and one or more AU intensities individually associated with the one or more AUs.
    Type: Application
    Filed: March 29, 2023
    Publication date: May 16, 2024
    Applicants: Fujitsu Limited, CARNEGIE MELLON UNIVERSITY
    Inventors: Heng YU, Koichiro NIINUMA, Laszlo JENI
  • Publication number: 20230029505
    Abstract: A method may include obtaining a facial image of a subject and identifying a number of new images to be synthesized with target AU combinations and categories of intensity. The method may also include synthesizing the number of new images using the facial image of the subject as the base image with the number of target AU combinations and categories of intensity with a number of new images that have different AU combinations than the facial image of the subject. The method may additionally include adding the number of new images to a dataset and training a machine learning system using the dataset to identify a facial expression of the subject.
    Type: Application
    Filed: August 2, 2021
    Publication date: February 2, 2023
    Applicant: FUJITSU LIMITED
    Inventors: Koichiro NIINUMA, Jeffrey F. COHN, Laszlo A. JENI
  • Patent number: 11557149
    Abstract: A method may include obtaining a dataset including a target Action Unit (AU) combination and labeled images of the target AU combination with at least a first category of intensity for each AU of the target AU combination and a second category of intensity for each AU of the target AU combination. The method may also include determining that the first category of intensity for a first AU has a higher number of labeled images than the second category of intensity for the first AU, and based on the determination, identifying a number of new images to be synthesized in the second category of intensity for the first AU. The method may additionally include synthesizing the number of new images with the second category of intensity for the first AU, and adding the new images to the dataset.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: January 17, 2023
    Assignees: FUJITSU LIMITED, CARNEGIE MELLON UNIVERSITY
    Inventors: Koichiro Niinuma, Laszlo A. Jeni, Itir Onal Ertugrul, Jeffrey F. Cohn
  • Publication number: 20220165029
    Abstract: Computer vision systems and methods for high-fidelity representation of complex 3D surfaces using deep unsigned distance embeddings are provided. The system receives data associated with the 3D surface. The system processes the data based at least in part on one or more computer vision models to predict an unsigned distance field and a normal vector field. The unsigned distance field is indicative of proximity to the 3D surface and includes a predicted closest unsigned distance to a surface point of the 3D surface from a given point in a 3D space. The normal vector field is indicative of a surface orientation of the 3D surface and includes a predicted normal vector to the surface point closest to the given point. The system further determines the 3D surface representation based at least in part on the unsigned distance field and the normal vector field.
    Type: Application
    Filed: November 24, 2021
    Publication date: May 26, 2022
    Applicant: Insurance Services Office, Inc.
    Inventors: Rahul M. Venkatesh, Sarthak Sharma, Aurobrata Ghosh, Laszlo A. Jeni, Maneesh Kumar Singh
  • Publication number: 20220051003
    Abstract: A method may include obtaining a dataset including a target Action Unit (AU) combination and labeled images of the target AU combination with at least a first category of intensity for each AU of the target AU combination and a second category of intensity for each AU of the target AU combination. The method may also include determining that the first category of intensity for a first AU has a higher number of labeled images than the second category of intensity for the first AU, and based on the determination, identifying a number of new images to be synthesized in the second category of intensity for the first AU. The method may additionally include synthesizing the number of new images with the second category of intensity for the first AU, and adding the new images to the dataset.
    Type: Application
    Filed: August 14, 2020
    Publication date: February 17, 2022
    Applicants: FUJITSU LIMITED, CARNEGIE MELLON UNIVERSITY
    Inventors: Koichiro NIINUMA, Laszlo A. JENI, Itir Onal ERTUGRUL, Jeffrey F. COHN
  • Patent number: 11244206
    Abstract: A method may include obtaining a base facial image, and obtaining a first set of base facial features within the base facial image, the first set of base facial features associated with a first facial AU to be detected in an analysis facial image. The method may also include obtaining a second set of base facial features within the base facial image, the second set of facial features associated with a second facial AU to be detected. The method may include obtaining the analysis facial image, and applying a first image normalization to the analysis facial image using the first set of base facial features to facilitate prediction of a probability of the first facial AU. The method may include applying a second image normalization to the analysis facial image using the second set of base facial features to facilitate prediction of a probability of the second facial AU.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: February 8, 2022
    Assignees: FUJITSU LIMITED, CARNEGIE MELLON UNIVERSITY
    Inventors: Koichiro Niinuma, Laszlo A. Jeni, Itir Onal Ertugrul, Jeffrey F. Cohn
  • Publication number: 20210073600
    Abstract: A method may include obtaining a base facial image, and obtaining a first set of base facial features within the base facial image, the first set of base facial features associated with a first facial AU to be detected in an analysis facial image. The method may also include obtaining a second set of base facial features within the base facial image, the second set of facial features associated with a second facial AU to be detected. The method may include obtaining the analysis facial image, and applying a first image normalization to the analysis facial image using the first set of base facial features to facilitate prediction of a probability of the first facial AU. The method may include applying a second image normalization to the analysis facial image using the second set of base facial features to facilitate prediction of a probability of the second facial AU.
    Type: Application
    Filed: September 6, 2019
    Publication date: March 11, 2021
    Applicants: FUJITSU LIMITED, CARNEGIE MELLON UNIVERSITY
    Inventors: Koichiro NIINUMA, Laszlo A. JENI, Itir Onal ERTUGRUL, Jeffrey F. COHN