Patents by Inventor Michele Merler

Michele Merler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240112444
    Abstract: Automated analog gauge reading is provided. The method comprises a computer system receiving input of an image and detecting at least one analog gauge in the image. The computer system corrects the orientation of the analog gauge in the image and detects scene text and tick labels on the analog gauge. The computer system determines a position of a pointer on the analog gauge relative to the scene text and outputs a gauge reading value based on an arithmetic progression of tick labels and angle of the pointer with respect to minimum and maximum values on the analog gauge.
    Type: Application
    Filed: September 29, 2022
    Publication date: April 4, 2024
    Inventors: Michele Merler, Dhiraj Joshi, Apurv Gupta, Sebastien Gilbert, Shyama Prosad Chowdhury, Chidansh Amitkumar Bhatt, Nirmit V. Desai
  • Publication number: 20240104369
    Abstract: A system may receive an existing base set of knowledge, train a neural network on the base set of knowledge, deploy the neural network on a new data set, generate, using the deployment, instances of new knowledge, and validate the instances of new knowledge.
    Type: Application
    Filed: September 26, 2022
    Publication date: March 28, 2024
    Inventors: Dinesh C. Verma, Franck Vinh Le, Michele Merler, Dhiraj Joshi, SUPRIYO CHAKRABORTY, Seraphin Bernard Calo
  • Patent number: 11941038
    Abstract: Systems, methods and/or computer program products for controlling and visualizing topic modeling results using a topic modeling interface. The interface allows user directed exploration, understanding and control of topic modeling algorithms, while offering both semantic summaries and/or structure attribute explanations about results. Explanations and differentiations between results are presented using metrics such as cohesiveness and visual displays depicting hierarchical organization. Through user-manipulation of features of the interface, iterative changes are implemented through user-feedback, adjusting parameters, broadening or narrowing topic results, and/or reorganizing topics by splitting or merging topics. As users trigger visual changes to results being displayed, users can compare and contrast output from the topic modeling algorithm.
    Type: Grant
    Filed: May 19, 2022
    Date of Patent: March 26, 2024
    Assignee: International Business Machines Corporation
    Inventors: Raghu Kiran Ganti, Mudhakar Srivatsa, Shreeranjani Srirangamsridharan, Jae-Wook Ahn, Michele Merler, Dean Steuer
  • Patent number: 11830241
    Abstract: A method and system for auto-curating a media are provided. Media content is received over the network interface. A set of markers is identified for the media content, each marker corresponding to one of a plurality of visible and audible cues in the media content. Segments in the media content are identified based on the identified set of markers. An excitement score is computed for each segment based on the identified markers that fall within the segment. A highlight clip is generated by identifying segments having excitement scores greater than a threshold.
    Type: Grant
    Filed: January 25, 2020
    Date of Patent: November 28, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen C. Hammer, John Joseph Kent, John R. Smith, Rogerio Feris
  • Publication number: 20230376518
    Abstract: Systems, methods and/or computer program products for controlling and visualizing topic modeling results using a topic modeling interface. The interface allows user directed exploration, understanding and control of topic modeling algorithms, while offering both semantic summaries and/or structure attribute explanations about results. Explanations and differentiations between results are presented using metrics such as cohesiveness and visual displays depicting hierarchical organization. Through user-manipulation of features of the interface, iterative changes are implemented through user-feedback, adjusting parameters, broadening or narrowing topic results, and/or reorganizing topics by splitting or merging topics. As users trigger visual changes to results being displayed, users can compare and contrast output from the topic modeling algorithm.
    Type: Application
    Filed: May 19, 2022
    Publication date: November 23, 2023
    Inventors: RAGHU KIRAN GANTI, MUDHAKAR SRIVATSA, Shreeranjani Srirangamsridharan, Jae-Wook Ahn, Michele Merler, Dean Steuer
  • Publication number: 20230259716
    Abstract: A neural architecture search method, system, and computer program product that determines, by a computing device, a best fit language model of a plurality of language models that is a best fit for interpretation of a corpus of natural language and interprets, by the computing device, the corpus of natural language using the best fit language model.
    Type: Application
    Filed: February 14, 2022
    Publication date: August 17, 2023
    Inventors: Michele Merler, Aashka Trivedi, Rameswar Panda, Bishwaranjan Bhattacharjee, Taesun Moon, Avirup Sil
  • Publication number: 20220121924
    Abstract: An embodiment includes identifying an initial plurality of sets of hyperparameter values at which to evaluate an objective function that relates hyperparameter values to performance values of a neural network. The embodiment also executes training processes on the neural network with the hyperparameters set to the each of the initial sets of hyperparameter values such that the training process provides an initial set of the performance values for the objective function. The embodiment also generates an approximation of the objective function using splines at selected performance values. The embodiment approximates a point at which the approximation of the objective function reaches a maximum value, then determines an updated set of hyperparameter values associated with the maximum value. The embodiment then executes a runtime process using the neural network with the hyperparameters set to the updated set of hyperparameter values.
    Type: Application
    Filed: October 21, 2020
    Publication date: April 21, 2022
    Applicant: International Business Machines Corporation
    Inventors: Ulrich Alfons Finkler, Michele Merler, Mayoore Selvarasa Jaiswal, Hui Wu, Rameswar Panda, Wei Zhang
  • Patent number: 11170270
    Abstract: Techniques for content generation are provided. A plurality of discriminative terms is determined based at least in part on a first plurality of documents that are related to a first concept, and a plurality of positive exemplars and a plurality of negative exemplars are identified using the plurality of discriminative terms. A first machine learning (ML) model is trained to classify images into concepts, based on the plurality of positive exemplars and the plurality of negative exemplars. A second concept related to the first concept is then determined, based on the first ML model. A second ML model is trained to generate images based on the second concept, and a first image is generated using the second ML model. The first image is then refined using a style transfer ML model that was trained using a plurality of style images.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: November 9, 2021
    Assignee: International Business Machines Corporation
    Inventors: Michele Merler, Mauro Martino, Cicero Nogueira Dos Santos, Alfio Massimiliano Gliozzo, John R. Smith
  • Publication number: 20210117736
    Abstract: Techniques for content generation are provided. A plurality of discriminative terms is determined based at least in part on a first plurality of documents that are related to a first concept, and a plurality of positive exemplars and a plurality of negative exemplars are identified using the plurality of discriminative terms. A first machine learning (ML) model is trained to classify images into concepts, based on the plurality of positive exemplars and the plurality of negative exemplars. A second concept related to the first concept is then determined, based on the first ML model. A second ML model is trained to generate images based on the second concept, and a first image is generated using the second ML model. The first image is then refined using a style transfer ML model that was trained using a plurality of style images.
    Type: Application
    Filed: October 17, 2019
    Publication date: April 22, 2021
    Inventors: Michele Merler, Mauro Martino, Cicero NOGUEIRA DOS SANTOS, Alfio Massimiliano Gliozzo, John R. Smith
  • Publication number: 20200162799
    Abstract: A method and system for auto-curating a media are provided. Media content is received over the network interface. A set of markers is identified for the media content, each marker corresponding to one of a plurality of visible and audible cues in the media content. Segments in the media content are identified based on the identified set of markers. An excitement score is computed for each segment based on the identified markers that fall within the segment. A highlight clip is generated by identifying segments having excitement scores greater than a threshold.
    Type: Application
    Filed: January 25, 2020
    Publication date: May 21, 2020
    Inventors: Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen C. Hammer, John Joseph Kent, John R. Smith, Rogerio Feris
  • Patent number: 10595101
    Abstract: A method and system for auto-curating a media are provided. Media content is received over the network interface. A set of markers is identified for the media content, each marker corresponding to one of a plurality of visible and audible cues in the media content. Segments in the media content are identified based on the identified set of markers. An excitement score is computed for each segment based on the identified markers that fall within the segment. A highlight clip is generated by identifying segments having excitement scores greater than a threshold.
    Type: Grant
    Filed: March 15, 2018
    Date of Patent: March 17, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen C. Hammer, John Joseph Kent, John R. Smith, Rogerio Feris
  • Publication number: 20190289372
    Abstract: A method and system for auto-curating a media are provided. Media content is received over the network interface. A set of markers is identified for the media content, each marker corresponding to one of a plurality of visible and audible cues in the media content. Segments in the media content are identified based on the identified set of markers. An excitement score is computed for each segment based on the identified markers that fall within the segment. A highlight clip is generated by identifying segments having excitement scores greater than a threshold.
    Type: Application
    Filed: March 15, 2018
    Publication date: September 19, 2019
    Inventors: Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen C. Hammer, John Joseph Kent, John R. Smith, Rogerio Feris
  • Patent number: 10282677
    Abstract: A method and system are provided. The method includes deriving a set of user attributes from an aggregate analysis of images and videos of a user. The deriving step includes recognizing, by a set of visual classifiers, semantic concepts in the images and videos of the user to generate visual classifier scores. The deriving step further includes deriving, by a statistical aggregator, the set of user attributes. The set of user attributes are derived by mapping the visual classifier scores to a taxonomy of semantic categories to be recognized in visual content. The deriving step also includes displaying, by an interactive user interface having a display, attribute profiles for the attributes and comparisons of the attribute profiles.
    Type: Grant
    Filed: November 5, 2015
    Date of Patent: May 7, 2019
    Assignee: International Business Machines Corporation
    Inventors: Michele Merler, Jae-Eun Park, John R. Smith, Rosario Uceda-Sosa
  • Patent number: 10102454
    Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.
    Type: Grant
    Filed: November 15, 2017
    Date of Patent: October 16, 2018
    Assignee: International Business Machines Corporation
    Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
  • Publication number: 20180089540
    Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.
    Type: Application
    Filed: September 23, 2016
    Publication date: March 29, 2018
    Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
  • Publication number: 20180089543
    Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.
    Type: Application
    Filed: November 15, 2017
    Publication date: March 29, 2018
    Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
  • Patent number: 9928448
    Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: March 27, 2018
    Assignee: International Business Machines Corporation
    Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
  • Patent number: 9684852
    Abstract: A method and systems are provided. A system includes a set of visual and textual classifiers for recognizing semantic concepts in a set of images and assigning semantic scores for the images to predict a gender of a user, and performing gender prediction from visual content and textual content in the images to respectively generate visual-based gender predictions and textual-based gender predictions. The system further includes a multimodal information fusion device for combining, using multimodal information fusion, the visual-based gender predictions, the textual-based gender predictions, and the semantic scores to infer a gender of a user.
    Type: Grant
    Filed: August 2, 2016
    Date of Patent: June 20, 2017
    Assignee: International Business Machines Corporation
    Inventors: Liangliang Cao, Michele Merler, John R. Smith
  • Publication number: 20170132250
    Abstract: A method and system are provided. The method includes deriving a set of user attributes from an aggregate analysis of images and videos of a user. The deriving step includes recognizing, by a set of visual classifiers, semantic concepts in the images and videos of the user to generate visual classifier scores. The deriving step further includes deriving, by a statistical aggregator, the set of user attributes. The set of user attributes are derived by mapping the visual classifier scores to a taxonomy of semantic categories to be recognized in visual content. The deriving step also includes displaying, by an interactive user interface having a display, attribute profiles for the attributes and comparisons of the attribute profiles.
    Type: Application
    Filed: November 5, 2015
    Publication date: May 11, 2017
    Inventors: Michele Merler, Jae-Eun Park, John R. Smith, Rosario Uceda-Sosa
  • Publication number: 20160379086
    Abstract: A method and systems are provided. A system includes a set of visual and textual classifiers for recognizing semantic concepts in a set of images and assigning semantic scores for the images to predict a gender of a user, and performing gender prediction from visual content and textual content in the images to respectively generate visual-based gender predictions and textual-based gender predictions. The system further includes a multimodal information fusion device for combining, using multimodal information fusion, the visual-based gender predictions, the textual-based gender predictions, and the semantic scores to infer a gender of a user.
    Type: Application
    Filed: August 2, 2016
    Publication date: December 29, 2016
    Inventors: Liangliang Cao, Michele Merler, John R. Smith