Patents by Inventor Michele Merler

Michele Merler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10282677
    Abstract: A method and system are provided. The method includes deriving a set of user attributes from an aggregate analysis of images and videos of a user. The deriving step includes recognizing, by a set of visual classifiers, semantic concepts in the images and videos of the user to generate visual classifier scores. The deriving step further includes deriving, by a statistical aggregator, the set of user attributes. The set of user attributes are derived by mapping the visual classifier scores to a taxonomy of semantic categories to be recognized in visual content. The deriving step also includes displaying, by an interactive user interface having a display, attribute profiles for the attributes and comparisons of the attribute profiles.
    Type: Grant
    Filed: November 5, 2015
    Date of Patent: May 7, 2019
    Assignee: International Business Machines Corporation
    Inventors: Michele Merler, Jae-Eun Park, John R. Smith, Rosario Uceda-Sosa
  • Patent number: 10102454
    Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.
    Type: Grant
    Filed: November 15, 2017
    Date of Patent: October 16, 2018
    Assignee: International Business Machines Corporation
    Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
  • Publication number: 20180089540
    Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.
    Type: Application
    Filed: September 23, 2016
    Publication date: March 29, 2018
    Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
  • Publication number: 20180089543
    Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.
    Type: Application
    Filed: November 15, 2017
    Publication date: March 29, 2018
    Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
  • Patent number: 9928448
    Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: March 27, 2018
    Assignee: International Business Machines Corporation
    Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
  • Patent number: 9684852
    Abstract: A method and systems are provided. A system includes a set of visual and textual classifiers for recognizing semantic concepts in a set of images and assigning semantic scores for the images to predict a gender of a user, and performing gender prediction from visual content and textual content in the images to respectively generate visual-based gender predictions and textual-based gender predictions. The system further includes a multimodal information fusion device for combining, using multimodal information fusion, the visual-based gender predictions, the textual-based gender predictions, and the semantic scores to infer a gender of a user.
    Type: Grant
    Filed: August 2, 2016
    Date of Patent: June 20, 2017
    Assignee: International Business Machines Corporation
    Inventors: Liangliang Cao, Michele Merler, John R. Smith
  • Publication number: 20170132250
    Abstract: A method and system are provided. The method includes deriving a set of user attributes from an aggregate analysis of images and videos of a user. The deriving step includes recognizing, by a set of visual classifiers, semantic concepts in the images and videos of the user to generate visual classifier scores. The deriving step further includes deriving, by a statistical aggregator, the set of user attributes. The set of user attributes are derived by mapping the visual classifier scores to a taxonomy of semantic categories to be recognized in visual content. The deriving step also includes displaying, by an interactive user interface having a display, attribute profiles for the attributes and comparisons of the attribute profiles.
    Type: Application
    Filed: November 5, 2015
    Publication date: May 11, 2017
    Inventors: Michele Merler, Jae-Eun Park, John R. Smith, Rosario Uceda-Sosa
  • Publication number: 20160379086
    Abstract: A method and systems are provided. A system includes a set of visual and textual classifiers for recognizing semantic concepts in a set of images and assigning semantic scores for the images to predict a gender of a user, and performing gender prediction from visual content and textual content in the images to respectively generate visual-based gender predictions and textual-based gender predictions. The system further includes a multimodal information fusion device for combining, using multimodal information fusion, the visual-based gender predictions, the textual-based gender predictions, and the semantic scores to infer a gender of a user.
    Type: Application
    Filed: August 2, 2016
    Publication date: December 29, 2016
    Inventors: Liangliang Cao, Michele Merler, John R. Smith
  • Patent number: 9471851
    Abstract: A method and systems are provided. The method includes recognizing semantic concepts in a set of images and assigning semantic scores for the images to predict a gender of a user. The method further includes performing gender prediction from visual content and textual content in the images to respectively generate visual-based gender predictions and textual-based gender predictions. The method also includes combining, using multimodal information fusion, the visual-based gender predictions, the textual-based gender predictions, and the semantic scores, to infer a gender of a user.
    Type: Grant
    Filed: June 29, 2015
    Date of Patent: October 18, 2016
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Liangliang Cao, Michele Merler, John R. Smith
  • Patent number: 9177229
    Abstract: Techniques for tracking one or more objects at each position in an interval in a video input with the use of a Kalman filter, including obtaining a first location estimate of an object with an object detector, obtaining a second location estimate and a movement estimate of the object with an object tracker, determining a final estimate of a position and/or a velocity of the object with the Kalman filter.
    Type: Grant
    Filed: August 7, 2013
    Date of Patent: November 3, 2015
    Assignee: THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK
    Inventors: Michele Merler, John R. Kender
  • Publication number: 20140010456
    Abstract: Techniques for tracking one or more objects at each position in an interval in a video input with the use of a Kalman filter, including obtaining a first location estimate of an object with an object detector, obtaining a second location estimate and a movement estimate of the object with an object tracker, determining a final estimate of a position and/or a velocity of the object with the Kalman filter.
    Type: Application
    Filed: August 7, 2013
    Publication date: January 9, 2014
    Inventors: Michele Merler, John R. Kender