Patents by Inventor Michael Heilman

Michael Heilman has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240093050
    Abstract: A UV curable inkjet ink containing covert or overt ultraviolet or infrared reactive material. The ultraviolet or infrared reactive materials are processed in acrylate monomer or combination of acrylate monomer and acrylate oligomer media, along with photoinitiators and surfactants to produce an inkjet ink for printing on non-porous substrates such as plastic, glass, ceramic or metal with high adhesion, scratch and chemical resistance and providing a security feature responsive to ultraviolet or infrared radiation.
    Type: Application
    Filed: November 15, 2021
    Publication date: March 21, 2024
    Inventors: Xiaorong Cai, Malissa Marie Wolfe, Kevin Heilman, Michael R. Riley
  • Patent number: 11475273
    Abstract: Systems and methods are provided for automatically scoring a constructed response. The constructed response is processed to generate a plurality of numerical vectors that is representative of the constructed response. A model is applied to the plurality of numerical vectors. The model includes an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the model via a first plurality of connections. Each of the connections has a first weight. An intermediate layer of nodes is configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the connections having a second weight. An output layer is connected to the intermediate layer via a third plurality of connections, each of the connections having a third weight. The output layer is configured to generate a score for the constructed response.
    Type: Grant
    Filed: March 24, 2020
    Date of Patent: October 18, 2022
    Assignee: Educational Testing Service
    Inventors: Derrick Higgins, Lei Chen, Michael Heilman, Klaus Zechner, Nitin Madnani
  • Patent number: 10628731
    Abstract: Systems and methods are provided for automatically scoring a constructed response. The constructed response is processed to generate a plurality of numerical vectors that is representative of the constructed response. A model is applied to the plurality of numerical vectors. The model includes an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the model via a first plurality of connections. Each of the connections has a first weight. An intermediate layer of nodes is configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the connections having a second weight. An output layer is connected to the intermediate layer via a third plurality of connections, each of the connections having a third weight. The output layer is configured to generate a score for the constructed response.
    Type: Grant
    Filed: June 27, 2019
    Date of Patent: April 21, 2020
    Assignee: Educational Testing Service
    Inventors: Derrick Higgins, Lei Chen, Michael Heilman, Klaus Zechner, Nitin Madnani
  • Patent number: 10515153
    Abstract: A computer-implemented method of training an assessment model for assessing constructed texts expressing opinions on subjects includes accessing a plurality of training texts, which are constructed texts. The training texts are analyzed with the processing system to derive values of a plurality of linguistic features of an assessment model. At least one of the plurality of linguistic features relates to sentiment and at least one of the plurality of linguistic feature relates to specificity. The assessment model is trained with the processing system based on the values of the plurality of linguistic features. Based on the training, a weight for each of the plurality of linguistic features is determined. The assessment model is calibrated to include the weights for at least some of the plurality of linguistic features such that the assessment model is configured to generate assessment measures for constructed texts expressing opinions on subjects.
    Type: Grant
    Filed: May 16, 2014
    Date of Patent: December 24, 2019
    Assignee: Educational Testing Service
    Inventors: Michael Heilman, F. Jay Breyer, Michael Flor
  • Patent number: 10373047
    Abstract: Systems and methods are provided for automatically scoring a constructed response. The constructed response is processed to generate a plurality of numerical vectors that is representative of the constructed response. A model is applied to the plurality of numerical vectors. The model includes an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the model via a first plurality of connections. Each of the connections has a first weight. An intermediate layer of nodes is configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the connections having a second weight. An output layer is connected to the intermediate layer via a third plurality of connections, each of the connections having a third weight. The output layer is configured to generate a score for the constructed response.
    Type: Grant
    Filed: February 27, 2015
    Date of Patent: August 6, 2019
    Assignee: Educational Testing Service
    Inventors: Derrick Higgins, Lei Chen, Michael Heilman, Klaus Zechner, Nitin Madnani
  • Patent number: 10255820
    Abstract: Systems and methods are provided for determining a susceptibility of a computer-implemented automated scoring engine to gaming strategies. A plurality of responses to a prompt are provided to a computer-implemented automated scoring engine to receive a first set of scores. A first transformation is performed on each of the plurality of responses to generate a first set of transformed responses. The first set of transformed responses is provided to the computer-implemented automatic scoring engine to receive a second set of scores, and a gaming susceptibility metric is determined based on the first set of scores and the second set of scores.
    Type: Grant
    Filed: March 26, 2014
    Date of Patent: April 9, 2019
    Assignee: Educational Testing Service
    Inventors: Derrick Higgins, Isaac Bejar, Michael Heilman, Yoko Futagi, Michael Flor
  • Patent number: 9852379
    Abstract: Systems and methods described herein utilize supervised machine learning to generate a figure-of-speech prediction model for classify content words in a running text as either being figurative (e.g., as a metaphor, simile, etc.) or non-figurative (i.e., literal). The prediction model may extract and analyze any number of features in making its prediction, including a topic model feature, unigram feature, part-of-speech feature, concreteness feature, concreteness difference feature, literal context feature, non-literal context feature, and off-topic feature, each of which are described in detail herein. Since uses of figure of speech in writings may signal content sophistication, the figure-of-speech prediction model allows scoring engines to further take into consideration a text's use of figure of speech when generating a score.
    Type: Grant
    Filed: March 6, 2015
    Date of Patent: December 26, 2017
    Assignee: Educational Testing Service
    Inventors: Beata Beigman Klebanov, Chee Wee Leong, Michael Flor, Michael Heilman
  • Patent number: 9208139
    Abstract: In accordance with the teachings described herein, systems and methods are provided for identifying organizational elements in argumentative or persuasive discourse. A text that has been annotated is received. The annotated text includes argumentative or persuasive discourse that includes claims and evidence and organizational elements configured to organize the claims and evidence. Annotations of the annotated text distinguish the organizational elements from the claims and evidence. A rule set or a feature set is identified from the annotated text, where the rule set or the feature set includes textual patterns or word frequency features related to the organizational elements of the annotated text. A model is built based on the annotations and on the rule set or the feature set. The model is configured to identify organizational elements in a new text. The model is applied to the new text.
    Type: Grant
    Filed: January 7, 2013
    Date of Patent: December 8, 2015
    Assignee: Educational Testing Service
    Inventors: Nitin Madnani, Michael Heilman, Joel Tetreault, Martin Chodorow
  • Publication number: 20150254565
    Abstract: Systems and methods described herein utilize supervised machine learning to generate a figure-of-speech prediction model for classify content words in a running text as either being figurative (e.g., as a metaphor, simile, etc.) or non-figurative (i.e., literal). The prediction model may extract and analyze any number of features in making its prediction, including a topic model feature, unigram feature, part-of-speech feature, concreteness feature, concreteness difference feature, literal context feature, non-literal context feature, and off-topic feature, each of which are described in detail herein. Since uses of figure of speech in writings may signal content sophistication, the figure-of-speech prediction model allows scoring engines to further take into consideration a text's use of figure of speech when generating a score.
    Type: Application
    Filed: March 6, 2015
    Publication date: September 10, 2015
    Inventors: Beata Beigman Klebanov, Chee Wee Leong, Michael Flor, Michael Heilman
  • Publication number: 20150248608
    Abstract: Systems and methods are provided for automatically scoring a constructed response. The constructed response is processed to generate a plurality of numerical vectors that is representative of the constructed response. A model is applied to the plurality of numerical vectors. The model includes an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the model via a first plurality of connections. Each of the connections has a first weight. An intermediate layer of nodes is configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the connections having a second weight. An output layer is connected to the intermediate layer via a third plurality of connections, each of the connections having a third weight. The output layer is configured to generate a score for the constructed response.
    Type: Application
    Filed: February 27, 2015
    Publication date: September 3, 2015
    Inventors: Derrick Higgins, Lei Chen, Michael Heilman, Klaus Zechner, Nitin Madnani
  • Publication number: 20140343923
    Abstract: A computer-implemented method of training an assessment model for assessing constructed texts expressing opinions on subjects includes accessing a plurality of training texts, which are constructed texts. The training texts are analyzed with the processing system to derive values of a plurality of linguistic features of an assessment model. At least one of the plurality of linguistic features relates to sentiment and at least one of the plurality of linguistic feature relates to specificity. The assessment model is trained with the processing system based on the values of the plurality of linguistic features. Based on the training, a weight for each of the plurality of linguistic features is determined. The assessment model is calibrated to include the weights for at least some of the plurality of linguistic features such that the assessment model is configured to generate assessment measures for constructed texts expressing opinions on subjects.
    Type: Application
    Filed: May 16, 2014
    Publication date: November 20, 2014
    Applicant: Educational Testing Service
    Inventors: Michael Heilman, F. Jay Breyer, Michael Flor
  • Publication number: 20140295387
    Abstract: Systems and methods are provided for scoring a constructed response. The constructed response is processed according to a set of grammar rules to generate a data structure. The grammar rules specify a set of preferred responses for the item. The grammar rules utilize a plurality of variables that specify legitimate word patterns for the constructed response. It is determined whether the data structure indicates that the constructed response is included in the set of preferred responses, and if so, a maximum score is assigned to the constructed response. If the data structure indicates that the constructed response is not included in the set of preferred responses, a partial credit score for the constructed response is determined by assessing from the data structure which ones of the concepts represented by the variables are present in the constructed response. The partial credit score is assigned based on the presence of the concepts.
    Type: Application
    Filed: March 27, 2014
    Publication date: October 2, 2014
    Applicant: Educational Testing Service
    Inventors: Michael Heilman, Daniel Blanchard
  • Publication number: 20140295399
    Abstract: Systems and methods are provided for determining a susceptibility of a computer-implemented automated scoring engine to gaming strategies. A plurality of responses to a prompt are provided to a computer-implemented automated scoring engine to receive a first set of scores. A first transformation is performed on each of the plurality of responses to generate a first set of transformed responses. The first set of transformed responses is provided to the computer-implemented automatic scoring engine to receive a second set of scores, and a gaming susceptibility metric is determined based on the first set of scores and the second set of scores.
    Type: Application
    Filed: March 26, 2014
    Publication date: October 2, 2014
    Applicant: Educational Testing Service
    Inventors: Derrick Higgins, Isaac Bejar, Michael Heilman, Yoko Futagi, Michael Flor
  • Patent number: 8668272
    Abstract: A vehicle seat (10) includes an improved seat frame member (14) used as a seat back, a recliner mechanism connection (16) and a vehicle seat track actuator mechanism (18). The seat back frame member (14) includes a side frame member (30) having a side frame structural member (32) preferably made from a relatively high strength steel and a stiffening insert member (42) to provide strength and rigidity to the recliner mechanism connection (16) and to reduce the overall mass of the vehicle seat frame member and thereby the vehicle seat (10). The seat frame member (14) further includes a recliner mechanism (34) welded to the side frame structural member (32) preferably utilizing a shaped laser weld pattern (40). The vehicle seat track actuator mechanism (18) includes a bar (56), first and second pivot pins (62, 64) and connectors (70).
    Type: Grant
    Filed: March 12, 2009
    Date of Patent: March 11, 2014
    Assignee: Johnson Controls Technology Company
    Inventors: Nandakumar Sankaran, Elizabeth Ann Allen, Robert Michael Heilman
  • Publication number: 20110006575
    Abstract: A vehicle seat (10) includes an 2 improved seat frame member (14) used as a seat back, a recliner mechanism connection (16) and a vehicle seat track actuator mechanism (18). The seat back frame member (14) includes a side frame member (30) having a side frame structural member (32) preferably made from a relatively high strength steel and a stiffening insert member (42) to provide strength and rigidity to the recliner mechanism connection (16) and to reduce the overall mass of the vehicle seat frame member and thereby the vehicle seat (10). The seat frame member (14) further includes a recliner mechanism (34) welded to the side frame structural member (32) preferably utilizing a shaped laser weld pattern (40). The vehicle seat track actuator mechanism (18) includes a bar (56), first and second pivot pins (62, 64) and connectors (70).
    Type: Application
    Filed: March 12, 2009
    Publication date: January 13, 2011
    Applicant: Johnson Controls Technology Company
    Inventors: Nandakumar Sankaran, Elizabeth Ann Allen, Robert Michael Heilman