Patents by Inventor Vyacheslav Andreyev

Vyacheslav Andreyev has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 8472861
    Abstract: Systems and methods for building a model for use in grading an essay are provided. A plurality of human graded essays are evaluated using a processor to generate a set of features. A score category is determined for each of the plurality of human graded essays. A weight is produced using a processor for each feature based on the score category for each of the plurality of human graded essays and the set of features. A model is generated using a processor based on the weights for the set of features for evaluating an essay. The set of features includes n features, where the first k features have optimized weights, and the last n?k features have fixed predetermined weights.
    Type: Grant
    Filed: October 13, 2010
    Date of Patent: June 25, 2013
    Assignee: Educational Testing Service
    Inventors: Vyacheslav Andreyev, Yigal Attali, Jill Burstein
  • Patent number: 8467716
    Abstract: Systems and methods for building a trait model for essay evaluation are provided. At least one evaluated essay is received. A plurality of features pertaining to one or more traits from the at least one evaluated essay are identified and extracted. The one or more traits comprise writing errors, discourse, or vocabulary usage. A plurality of vector files based upon the plurality of features are created. A trait model for essay evaluation based upon the plurality of vector files is built. The trait model is evaluated, where the evaluation includes mapping features of a new essay to the trait model by navigating a multi-branched decision tree. At each branch of the decision tree, a value associated with the features of the new essay is used to determine how to proceed through the trait model.
    Type: Grant
    Filed: July 30, 2010
    Date of Patent: June 18, 2013
    Assignee: Educational Testing Service
    Inventors: Jill Burstein, Vyacheslav Andreyev, Chi Lu
  • Patent number: 8452225
    Abstract: Systems and methods for creating a mathematical model for use in identifying discourse elements are described. A plurality of first essays relating to a particular subject are received, where each first essay is in an electronic format. Annotations for each first essay are received, where each annotation identifies at least one discourse element. Features are identified with a processor, where each feature is exhibited by at least one identified discourse element. Empirical frequencies are computed with a processor, where each empirical frequency relates to the presence of a feature with respect to the identified discourse elements across the plurality of first essays. Each empirical frequency is associated with the related identified discourse element with a processor. The empirical frequencies are utilized to select discourse elements in at least one second essay.
    Type: Grant
    Filed: May 24, 2010
    Date of Patent: May 28, 2013
    Assignee: Educational Testing Service
    Inventors: Jill Burstein, Daniel Marcu, Vyacheslav Andreyev, Martin Sanford Chodorow, Claudia Leacock
  • Publication number: 20110027769
    Abstract: A method of grading an essay using an automated essay scoring system is provided. The method comprises the steps of deriving a set of predetermined features from the essay, wherein the predetermined feature set comprises one or more features that are independent from the test prompt, scoring the feature set with a scoring equation, wherein a multiple regression analysis with graded essay data produces weights for the scoring equation, generating a raw score for the essay; and processing the raw score for the essay into a score category based on an adaptive cutoff algorithm. Also provided is a method of generating a model in which to grade essays, wherein the data used to generate the model is independent from the test prompt or essay topic.
    Type: Application
    Filed: October 13, 2010
    Publication date: February 3, 2011
    Inventors: Vyacheslav Andreyev, Yigal Attali, Jill Burstein
  • Publication number: 20100297596
    Abstract: To automatically evaluate an essay, the essay is applied to a plurality of trait models and a plurality of trait scores are determined based on the plurality of trait models. Each of these trait scores having been generated from a respective trait model. In addition, a score is determined based on the plurality of trait scores.
    Type: Application
    Filed: July 30, 2010
    Publication date: November 25, 2010
    Inventors: Jill Burstein, Vyacheslav Andreyev, Chi Lu
  • Patent number: 7831196
    Abstract: A method of grading an essay using an automated essay scoring system is provided. The method comprises the steps of deriving a set of predetermined features from the essay, wherein the predetermined feature set comprises one or more features that are independent from the test prompt, scoring the feature set with a scoring equation, wherein a multiple regression analysis with graded essay data produces weights for the scoring equation, generating a raw score for the essay; and processing the raw score for the essay into a score category based on an adaptive cutoff algorithm. Also provided is a method of generating a model in which to grade essays, wherein the data used to generate the model is independent from the test prompt or essay topic.
    Type: Grant
    Filed: October 27, 2004
    Date of Patent: November 9, 2010
    Assignee: Educational Testing Service
    Inventors: Yigal Attali, Jill Burstein, Vyacheslav Andreyev
  • Publication number: 20100233666
    Abstract: An essay is analyzed automatically by accepting the essay and determining whether each of a predetermined set of features is present or absent in each sentence of the essay. For each sentence in the essay a probability that the sentence is a member of a certain discourse element category is calculated. The probability is based on the determinations of whether each feature in the set of features is present or absent. Furthermore, based on the calculated probabilities, a sentence is chosen as the choice for the discourse element category.
    Type: Application
    Filed: May 24, 2010
    Publication date: September 16, 2010
    Inventors: Jill Burstein, Daniel Marcu, Vyacheslav Andreyev, Martin Sanford Chodorow, Claudia Leacock
  • Patent number: 7729655
    Abstract: An essay is analyzed automatically by accepting the essay and determining whether each of a predetermined set of features is present or absent in each sentence of the essay. For each sentence in the essay a probability that the sentence is a member of a certain discourse element category is calculated. The probability is based on the determinations of whether each feature in the set of features is present or absent. Furthermore, based on the calculated probabilities, a sentence is chosen as the choice for the discourse element category.
    Type: Grant
    Filed: September 22, 2004
    Date of Patent: June 1, 2010
    Assignee: Educational Testing Service
    Inventors: Jill Burstein, Daniel Marcu, Martin Sanford Chodorow, Claudia Leacock, Vyacheslav Andreyev
  • Publication number: 20050042592
    Abstract: An essay is analyzed automatically by accepting the essay and determining whether each of a predetermined set of features is present or absent in each sentence of the essay. For each sentence in the essay a probability that the sentence is a member of a certain discourse element category is calculated. The probability is based on the determinations of whether each feature in the set of features is present or absent. Furthermore, based on the calculated probabilities, a sentence is chosen as the choice for the discourse element category.
    Type: Application
    Filed: September 22, 2004
    Publication date: February 24, 2005
    Inventors: Jill Burstein, Daniel Marcu, Vyacheslav Andreyev, Martin Chodorow, Claudia Leacock
  • Patent number: 6796800
    Abstract: An essay is analyzed automatically by accepting the essay and determining whether each of a predetermined set of features is present or absent in each sentence of the essay. For each sentence in the essay a probability that the sentence is a member of a certain discourse element category is calculated. The probability is based on the determinations of whether each feature in the set of features is present or absent. Furthermore, based on the calculated probabilities, a sentence is chosen as the choice for the discourse element category.
    Type: Grant
    Filed: January 23, 2002
    Date of Patent: September 28, 2004
    Assignee: Educational Testing Service
    Inventors: Jill Burstein, Daniel Marcu, Vyacheslav Andreyev, Martin Sanford Chodorow, Claudia Leacock
  • Publication number: 20020142277
    Abstract: An essay is analyzed automatically by accepting the essay and determining whether each of a predetermined set of features is present or absent in each sentence of the essay. For each sentence in the essay a probability that the sentence is a member of a certain discourse element category is calculated. The probability is based on the determinations of whether each feature in the set of features is present or absent. Furthermore, based on the calculated probabilities, a sentence is chosen as the choice for the discourse element category.
    Type: Application
    Filed: January 23, 2002
    Publication date: October 3, 2002
    Inventors: Jill Burstein, Daniel Marcu, Vyacheslav Andreyev, Martin Sanford Chodorow, Claudia Leacock`