Patents by Inventor Michele Merler
Michele Merler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240112444Abstract: Automated analog gauge reading is provided. The method comprises a computer system receiving input of an image and detecting at least one analog gauge in the image. The computer system corrects the orientation of the analog gauge in the image and detects scene text and tick labels on the analog gauge. The computer system determines a position of a pointer on the analog gauge relative to the scene text and outputs a gauge reading value based on an arithmetic progression of tick labels and angle of the pointer with respect to minimum and maximum values on the analog gauge.Type: ApplicationFiled: September 29, 2022Publication date: April 4, 2024Inventors: Michele Merler, Dhiraj Joshi, Apurv Gupta, Sebastien Gilbert, Shyama Prosad Chowdhury, Chidansh Amitkumar Bhatt, Nirmit V. Desai
-
Publication number: 20240104369Abstract: A system may receive an existing base set of knowledge, train a neural network on the base set of knowledge, deploy the neural network on a new data set, generate, using the deployment, instances of new knowledge, and validate the instances of new knowledge.Type: ApplicationFiled: September 26, 2022Publication date: March 28, 2024Inventors: Dinesh C. Verma, Franck Vinh Le, Michele Merler, Dhiraj Joshi, SUPRIYO CHAKRABORTY, Seraphin Bernard Calo
-
Patent number: 11941038Abstract: Systems, methods and/or computer program products for controlling and visualizing topic modeling results using a topic modeling interface. The interface allows user directed exploration, understanding and control of topic modeling algorithms, while offering both semantic summaries and/or structure attribute explanations about results. Explanations and differentiations between results are presented using metrics such as cohesiveness and visual displays depicting hierarchical organization. Through user-manipulation of features of the interface, iterative changes are implemented through user-feedback, adjusting parameters, broadening or narrowing topic results, and/or reorganizing topics by splitting or merging topics. As users trigger visual changes to results being displayed, users can compare and contrast output from the topic modeling algorithm.Type: GrantFiled: May 19, 2022Date of Patent: March 26, 2024Assignee: International Business Machines CorporationInventors: Raghu Kiran Ganti, Mudhakar Srivatsa, Shreeranjani Srirangamsridharan, Jae-Wook Ahn, Michele Merler, Dean Steuer
-
Patent number: 11830241Abstract: A method and system for auto-curating a media are provided. Media content is received over the network interface. A set of markers is identified for the media content, each marker corresponding to one of a plurality of visible and audible cues in the media content. Segments in the media content are identified based on the identified set of markers. An excitement score is computed for each segment based on the identified markers that fall within the segment. A highlight clip is generated by identifying segments having excitement scores greater than a threshold.Type: GrantFiled: January 25, 2020Date of Patent: November 28, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen C. Hammer, John Joseph Kent, John R. Smith, Rogerio Feris
-
Publication number: 20230376518Abstract: Systems, methods and/or computer program products for controlling and visualizing topic modeling results using a topic modeling interface. The interface allows user directed exploration, understanding and control of topic modeling algorithms, while offering both semantic summaries and/or structure attribute explanations about results. Explanations and differentiations between results are presented using metrics such as cohesiveness and visual displays depicting hierarchical organization. Through user-manipulation of features of the interface, iterative changes are implemented through user-feedback, adjusting parameters, broadening or narrowing topic results, and/or reorganizing topics by splitting or merging topics. As users trigger visual changes to results being displayed, users can compare and contrast output from the topic modeling algorithm.Type: ApplicationFiled: May 19, 2022Publication date: November 23, 2023Inventors: RAGHU KIRAN GANTI, MUDHAKAR SRIVATSA, Shreeranjani Srirangamsridharan, Jae-Wook Ahn, Michele Merler, Dean Steuer
-
Publication number: 20230259716Abstract: A neural architecture search method, system, and computer program product that determines, by a computing device, a best fit language model of a plurality of language models that is a best fit for interpretation of a corpus of natural language and interprets, by the computing device, the corpus of natural language using the best fit language model.Type: ApplicationFiled: February 14, 2022Publication date: August 17, 2023Inventors: Michele Merler, Aashka Trivedi, Rameswar Panda, Bishwaranjan Bhattacharjee, Taesun Moon, Avirup Sil
-
Publication number: 20220121924Abstract: An embodiment includes identifying an initial plurality of sets of hyperparameter values at which to evaluate an objective function that relates hyperparameter values to performance values of a neural network. The embodiment also executes training processes on the neural network with the hyperparameters set to the each of the initial sets of hyperparameter values such that the training process provides an initial set of the performance values for the objective function. The embodiment also generates an approximation of the objective function using splines at selected performance values. The embodiment approximates a point at which the approximation of the objective function reaches a maximum value, then determines an updated set of hyperparameter values associated with the maximum value. The embodiment then executes a runtime process using the neural network with the hyperparameters set to the updated set of hyperparameter values.Type: ApplicationFiled: October 21, 2020Publication date: April 21, 2022Applicant: International Business Machines CorporationInventors: Ulrich Alfons Finkler, Michele Merler, Mayoore Selvarasa Jaiswal, Hui Wu, Rameswar Panda, Wei Zhang
-
Patent number: 11170270Abstract: Techniques for content generation are provided. A plurality of discriminative terms is determined based at least in part on a first plurality of documents that are related to a first concept, and a plurality of positive exemplars and a plurality of negative exemplars are identified using the plurality of discriminative terms. A first machine learning (ML) model is trained to classify images into concepts, based on the plurality of positive exemplars and the plurality of negative exemplars. A second concept related to the first concept is then determined, based on the first ML model. A second ML model is trained to generate images based on the second concept, and a first image is generated using the second ML model. The first image is then refined using a style transfer ML model that was trained using a plurality of style images.Type: GrantFiled: October 17, 2019Date of Patent: November 9, 2021Assignee: International Business Machines CorporationInventors: Michele Merler, Mauro Martino, Cicero Nogueira Dos Santos, Alfio Massimiliano Gliozzo, John R. Smith
-
Publication number: 20210117736Abstract: Techniques for content generation are provided. A plurality of discriminative terms is determined based at least in part on a first plurality of documents that are related to a first concept, and a plurality of positive exemplars and a plurality of negative exemplars are identified using the plurality of discriminative terms. A first machine learning (ML) model is trained to classify images into concepts, based on the plurality of positive exemplars and the plurality of negative exemplars. A second concept related to the first concept is then determined, based on the first ML model. A second ML model is trained to generate images based on the second concept, and a first image is generated using the second ML model. The first image is then refined using a style transfer ML model that was trained using a plurality of style images.Type: ApplicationFiled: October 17, 2019Publication date: April 22, 2021Inventors: Michele Merler, Mauro Martino, Cicero NOGUEIRA DOS SANTOS, Alfio Massimiliano Gliozzo, John R. Smith
-
Publication number: 20200162799Abstract: A method and system for auto-curating a media are provided. Media content is received over the network interface. A set of markers is identified for the media content, each marker corresponding to one of a plurality of visible and audible cues in the media content. Segments in the media content are identified based on the identified set of markers. An excitement score is computed for each segment based on the identified markers that fall within the segment. A highlight clip is generated by identifying segments having excitement scores greater than a threshold.Type: ApplicationFiled: January 25, 2020Publication date: May 21, 2020Inventors: Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen C. Hammer, John Joseph Kent, John R. Smith, Rogerio Feris
-
Patent number: 10595101Abstract: A method and system for auto-curating a media are provided. Media content is received over the network interface. A set of markers is identified for the media content, each marker corresponding to one of a plurality of visible and audible cues in the media content. Segments in the media content are identified based on the identified set of markers. An excitement score is computed for each segment based on the identified markers that fall within the segment. A highlight clip is generated by identifying segments having excitement scores greater than a threshold.Type: GrantFiled: March 15, 2018Date of Patent: March 17, 2020Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen C. Hammer, John Joseph Kent, John R. Smith, Rogerio Feris
-
Publication number: 20190289372Abstract: A method and system for auto-curating a media are provided. Media content is received over the network interface. A set of markers is identified for the media content, each marker corresponding to one of a plurality of visible and audible cues in the media content. Segments in the media content are identified based on the identified set of markers. An excitement score is computed for each segment based on the identified markers that fall within the segment. A highlight clip is generated by identifying segments having excitement scores greater than a threshold.Type: ApplicationFiled: March 15, 2018Publication date: September 19, 2019Inventors: Michele Merler, Dhiraj Joshi, Quoc-Bao Nguyen, Stephen C. Hammer, John Joseph Kent, John R. Smith, Rogerio Feris
-
Patent number: 10282677Abstract: A method and system are provided. The method includes deriving a set of user attributes from an aggregate analysis of images and videos of a user. The deriving step includes recognizing, by a set of visual classifiers, semantic concepts in the images and videos of the user to generate visual classifier scores. The deriving step further includes deriving, by a statistical aggregator, the set of user attributes. The set of user attributes are derived by mapping the visual classifier scores to a taxonomy of semantic categories to be recognized in visual content. The deriving step also includes displaying, by an interactive user interface having a display, attribute profiles for the attributes and comparisons of the attribute profiles.Type: GrantFiled: November 5, 2015Date of Patent: May 7, 2019Assignee: International Business Machines CorporationInventors: Michele Merler, Jae-Eun Park, John R. Smith, Rosario Uceda-Sosa
-
Patent number: 10102454Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.Type: GrantFiled: November 15, 2017Date of Patent: October 16, 2018Assignee: International Business Machines CorporationInventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
-
Publication number: 20180089540Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.Type: ApplicationFiled: September 23, 2016Publication date: March 29, 2018Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
-
Publication number: 20180089543Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.Type: ApplicationFiled: November 15, 2017Publication date: March 29, 2018Inventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
-
Patent number: 9928448Abstract: A method includes utilizing two or more classifiers to calculate, for an input image, probability scores for a plurality of classes based on visual information extracted from the input image and semantic relationships in a classification hierarchy, wherein each of the two or more classifiers is associated with a given one of two or more levels in the classification hierarchy with each level in the classification hierarchy comprising a subset of the plurality of classes, and classifying the input image based on the calculated probability scores.Type: GrantFiled: September 23, 2016Date of Patent: March 27, 2018Assignee: International Business Machines CorporationInventors: Michele Merler, John R. Smith, Rosario A. Uceda-Sosa, Hui Wu
-
Patent number: 9684852Abstract: A method and systems are provided. A system includes a set of visual and textual classifiers for recognizing semantic concepts in a set of images and assigning semantic scores for the images to predict a gender of a user, and performing gender prediction from visual content and textual content in the images to respectively generate visual-based gender predictions and textual-based gender predictions. The system further includes a multimodal information fusion device for combining, using multimodal information fusion, the visual-based gender predictions, the textual-based gender predictions, and the semantic scores to infer a gender of a user.Type: GrantFiled: August 2, 2016Date of Patent: June 20, 2017Assignee: International Business Machines CorporationInventors: Liangliang Cao, Michele Merler, John R. Smith
-
Publication number: 20170132250Abstract: A method and system are provided. The method includes deriving a set of user attributes from an aggregate analysis of images and videos of a user. The deriving step includes recognizing, by a set of visual classifiers, semantic concepts in the images and videos of the user to generate visual classifier scores. The deriving step further includes deriving, by a statistical aggregator, the set of user attributes. The set of user attributes are derived by mapping the visual classifier scores to a taxonomy of semantic categories to be recognized in visual content. The deriving step also includes displaying, by an interactive user interface having a display, attribute profiles for the attributes and comparisons of the attribute profiles.Type: ApplicationFiled: November 5, 2015Publication date: May 11, 2017Inventors: Michele Merler, Jae-Eun Park, John R. Smith, Rosario Uceda-Sosa
-
Publication number: 20160379086Abstract: A method and systems are provided. A system includes a set of visual and textual classifiers for recognizing semantic concepts in a set of images and assigning semantic scores for the images to predict a gender of a user, and performing gender prediction from visual content and textual content in the images to respectively generate visual-based gender predictions and textual-based gender predictions. The system further includes a multimodal information fusion device for combining, using multimodal information fusion, the visual-based gender predictions, the textual-based gender predictions, and the semantic scores to infer a gender of a user.Type: ApplicationFiled: August 2, 2016Publication date: December 29, 2016Inventors: Liangliang Cao, Michele Merler, John R. Smith