Patents by Inventor Paul Deane

Paul Deane has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11776415
    Abstract: A method comprising accessing a first data structure that is associated with a first product prepared by a student and that includes first process data associated with a process performed by the student in generating the first product, analyzing the first data structure to generate a first characterization score based on the first product and the first process data, accessing a second data structure that is associated with a second product prepared by the student and that includes second process data associated with a process performed by the student in generating the second product, analyzing the second data structure to generate a second characterization score based on the second product and the second process data, and calculating a skill level change metric based on the first characterization score and the second characterization score indicating a change in ability level of the student over a course of the scenario-based assessment.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: October 3, 2023
    Assignee: Educational Testing Service
    Inventors: Paul Deane, Mo Zhang, Chen Li, Peter van Rijn, Hongwen Guo, Amanda Roth, Eowyn Winchester, Theresa Richter, Randy Bennett
  • Patent number: 11195431
    Abstract: Systems and methods for defining and using an optimal burst boundary threshold to assess the reliability of a manual/automatic writing score are presented. Keystroke data, including inter-key interval data, such as inter-word interval data, may be gathered from writings. Clustering analyses may be performed on the inter-key interval data to determine an optimal number of bursts for the writings. An optimal burst boundary may be determined from the optimal number of bursts. Other burst-related measures and statistics, including the average and maximum burst lengths, may be determined from the writings based on the optimal burst boundary threshold. A score may be received for each of the writings. A validation indication metric may be generated for each of the writings based on the received score and the optimal burst boundary threshold. The resulting measures and statistics may be used or applied in different ways and provide personalized feedback as learning analytics.
    Type: Grant
    Filed: March 12, 2019
    Date of Patent: December 7, 2021
    Assignee: Educational Testing Service
    Inventors: Mo Zhang, Jiangang Hao, Paul Deane, Chen Li
  • Patent number: 10964224
    Abstract: Systems and methods are provided for providing feedback on a user's writing behavior in generating a constructed response. An electronic process log for the constructed response is received. The electronic process log is processed to generate a vector having a predetermined number of elements. The vector comprises information related to the user's actions in generating the constructed response and includes (i) data indicating types of actions performed by the user in generating the constructed response, (ii) time points associated with the actions, and (iii) locations associated with the actions, each location indicating whether an associated action occurred within a word, between words, within a phrase, between phrases, within a sentence, between sentences, within a paragraph, or between paragraph. The vector is compared to one or more vectors associated with other constructed responses, and feedback is generated based on the comparison.
    Type: Grant
    Filed: March 13, 2017
    Date of Patent: March 30, 2021
    Assignee: Educational Testing Service
    Inventors: Mo Zhang, Jiangang Hao, Paul Deane
  • Patent number: 10332416
    Abstract: A method and system for using a natural language generator for automatic assessment item generation is disclosed. The natural language generator includes a document structure generator that produces an abstract document specification defining a structure for an assessment item based on user input. The abstract document specification is input into a logical schema generator, which produces a logical schema specification that creates a more detailed specification for an assessment item. Finally, a sentence generator receives the logical schema specification and creates natural language for the assessment item based on the variables defined in the logical schema specification.
    Type: Grant
    Filed: April 12, 2004
    Date of Patent: June 25, 2019
    Assignee: Educational Testing Service
    Inventors: Paul Deane, Derrick Higgins
  • Patent number: 10262547
    Abstract: Systems and methods are provided for scoring a constructed response generated by a user and providing information on the user's writing behavior. A constructed response and associated electronic process log are received. The constructed response is processed to generate first feature values representative of aspects of the constructed response. The electronic process log is processed to generate second feature values related to the user's actions in generating the constructed response. A score for the constructed response is generated using the processing system by applying a computer scoring model to the first and second feature values. A rule of a rule engine that is satisfied is identified, the rule being satisfied when one or more feature values of the second feature values meet a condition associated with the rule. Information on the user's actions in generating the constructed response is provided based on the satisfied rule.
    Type: Grant
    Filed: November 10, 2015
    Date of Patent: April 16, 2019
    Assignee: Educational Testing Service
    Inventors: Paul Deane, Gary Feng, Mo Zhang, Jiangang Hao, Yoav Bergner, Michael Flor, Michael E. Wagner, Nathan Lederer, Yigal Attali
  • Publication number: 20160133147
    Abstract: Systems and methods are provided for scoring a constructed response generated by a user and providing information on the user's writing behavior. A constructed response and associated electronic process log are received. The constructed response is processed to generate first feature values representative of aspects of the constructed response. The electronic process log is processed to generate second feature values related to the user's actions in generating the constructed response. A score for the constructed response is generated using the processing system by applying a computer scoring model to the first and second feature values. A rule of a rule engine that is satisfied is identified, the rule being satisfied when one or more feature values of the second feature values meet a condition associated with the rule. Information on the user's actions in generating the constructed response is provided based on the satisfied rule.
    Type: Application
    Filed: November 10, 2015
    Publication date: May 12, 2016
    Inventors: Paul Deane, Gary Feng, Mo Zhang, Jiangang Hao, Yoav Bergner, Michael Flor, Michael E. Wagner, Nathan Lederer
  • Patent number: 9208145
    Abstract: Systems and methods are provided for non-monotonic recognition of phrasal terms. Phrasal terms are identified from a corpus of written materials and ranked based on, for example, a mutual rank ratio. The phrasal terms are sequentially selected and a determination is made as to whether to accept or reject the selected phrasal term based on at least one predetermined criteria. The ranking of the phrasal terms may also rely on linguistic support to reduce duplication of phrasal terms and to distinguish different confidence levels for identified and accepted phrasal terms.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: December 8, 2015
    Assignee: Educational Testing Service
    Inventors: Robert Krovetz, Paul Deane
  • Publication number: 20140023984
    Abstract: A dental charting system having a control device configured to be held by a user or which is mounted to another device held by a user and the control device including one or more movement sensors for sensing movement of the control device in space and generating representative movement signals. A gesture processing module is provided to receive and process the movement signals to detect the occurrence of a gesture event from a set of predetermined gesture events, and which generates representative gesture control signals. A dental charting application program is also provided and runs on a host device and which provides a graphic user interface on a display associated with the host device for interacting with the application program, the application program being configured to receive and process the gesture control signals to enable interaction with the graphic user interface by the user via hand gesture movements of the control device.
    Type: Application
    Filed: December 22, 2011
    Publication date: January 23, 2014
    Inventors: Paul Deane Weatherly, Shane Allan Blackett, Paul David Harris, Russell Petherick
  • Publication number: 20130297294
    Abstract: Systems and methods are provided for non-monotonic recognition of phrasal terms. Phrasal terms are identified from a corpus of written materials and ranked based on, for example, a mutual rank ratio. The phrasal terms are sequentially selected and a determination is made as to whether to accept or reject the selected phrasal term based on at least one predetermined criteria. The ranking of the phrasal terms may also rely on linguistic support to reduce duplication of phrasal terms and to distinguish different confidence levels for identified and accepted phrasal terms.
    Type: Application
    Filed: March 14, 2013
    Publication date: November 7, 2013
    Applicant: Educational Testing Service
    Inventors: Robert Krovetz, Paul Deane
  • Patent number: 8147250
    Abstract: A method and system for performing automatic text analysis is described. A local ranking for one or more contexts with respect to a word and a global ranking for one or more contexts are generated. The rankings are based on the frequency with which the contexts appear in a corpus. A statistic may be generated using the local and global rankings, such as a log ratio rank statistic equal to the logarithm of the global rank divided by local rank, to measure the similarity of contexts with respect to words with which they combine. A source matrix of word to context values is then created. Singular value decomposition is used to create sub-matrices from the source matrix. Vectors from the sub-matrices corresponding to context(s) and/or word(s) are then selected to determine term-term or context-context similarity or term-context correspondence.
    Type: Grant
    Filed: April 2, 2008
    Date of Patent: April 3, 2012
    Assignee: Educational Testing Service
    Inventor: Paul Deane
  • Patent number: 8078452
    Abstract: A method and system for determining a lexical association of phrasal terms are described. A corpus having a plurality of words is received, and a plurality of contexts including one or more context words proximate to a word in the corpus is determined. An occurrence count for each context is determined, and a global rank is assigned based on the occurrence count. Similarly, a number of occurrences of a word being used in a context is determined, and a local rank is assigned to the word-context pair based on the number of occurrences. A rank ratio is then determined for each word-context pair. A rank ratio is equal to the global rank divided by the local rank for a word-context pair. A mutual rank ratio is determined by multiplying the rank ratios corresponding to a phrase. The mutual rank ratio is used to identify phrasal terms in the corpus.
    Type: Grant
    Filed: June 14, 2010
    Date of Patent: December 13, 2011
    Assignee: Educational Testing Service
    Inventor: Paul Deane
  • Publication number: 20100250238
    Abstract: A method and system for determining a lexical association of phrasal terms are described. A corpus having a plurality of words is received, and a plurality of contexts including one or more context words proximate to a word in the corpus is determined. An occurrence count for each context is determined, and a global rank is assigned based on the occurrence count. Similarly, a number of occurrences of a word being used in a context is determined, and a local rank is assigned to the word-context pair based on the number of occurrences. A rank ratio is then determined for each word-context pair. A rank ratio is equal to the global rank divided by the local rank for a word-context pair. A mutual rank ratio is determined by multiplying the rank ratios corresponding to a phrase. The mutual rank ratio is used to identify phrasal terms in the corpus.
    Type: Application
    Filed: June 14, 2010
    Publication date: September 30, 2010
    Inventor: Paul Deane
  • Patent number: 7739103
    Abstract: A method and system for determining a lexical association of phrasal terms are described. A corpus having a plurality of words is received, and a plurality of contexts including one or more context words proximate to a word in the corpus is determined. An occurrence count for each context is determined, and a global rank is assigned based on the occurrence count. Similarly, a number of occurrences of a word being used in a context is determined, and a local rank is assigned to the word-context pair based on the number of occurrences. A rank ratio is then determined for each word-context pair. A rank ratio is equal to the global rank divided by the local rank for a word-context pair. A mutual rank ratio is determined by multiplying the rank ratios corresponding to a phrase. The mutual rank ratio is used to identify phrasal terms in the corpus.
    Type: Grant
    Filed: April 6, 2005
    Date of Patent: June 15, 2010
    Assignee: Educational Testing Service
    Inventor: Paul Deane
  • Publication number: 20080183463
    Abstract: A method and system for performing automatic text analysis is described. A local ranking for one or more contexts with respect to a word and a global ranking for one or more contexts are generated. The rankings are based on the frequency with which the contexts appear in a corpus. A statistic may be generated using the local and global rankings, such as a log ratio rank statistic equal to the logarithm of the global rank divided by local rank, to measure the similarity of contexts with respect to words with which they combine. A source matrix of word to context values is then created. Singular value decomposition is used to create sub-matrices from the source matrix. Vectors from the sub-matrices corresponding to context(s) and/or word(s) are then selected to determine term-term or context-context similarity or term-context correspondence.
    Type: Application
    Filed: April 2, 2008
    Publication date: July 31, 2008
    Inventor: Paul Deane
  • Patent number: 7373102
    Abstract: A method and system for performing automatic text analysis is described. A local ranking for one or more contexts with respect to a word and a global ranking for one or more contexts are generated. The rankings are based on the frequency with which the contexts appear in a corpus. A statistic may be generated using the local and global rankings, such as a log ratio rank statistic equal to the logarithm of the global rank divided by local rank, to measure the similarity of contexts with respect to words with which they combine. A source matrix of word to context values is then created. Singular value decomposition is used to create sub-matrices from the source matrix. Vectors from the sub-matrices corresponding to context(s) and/or word(s) are then selected to determine term-term or context-context similarity or term-context correspondence.
    Type: Grant
    Filed: August 11, 2004
    Date of Patent: May 13, 2008
    Assignee: Educational Testing Service
    Inventor: Paul Deane
  • Publication number: 20070106499
    Abstract: A natural language system searching system develops concept and string indexes of a textual database, such as a group of litigation documents, by breaking the text to be indexed into sentences, words, dates, names and places in a reader, identifying phrases in a phrase parser, recovering word stems in a morphology module and determining the sense of potentially ambiguous words in a sense selector, all in accordance with words and concepts (word senses) stored in lexicon database 9-32. A query may then be processed by the reader, phrase parser, morphology module, and sense selector to provide a text meaning output which can be compared with the concept and string indexes to identify, retrieve and display documents and/or portions of documents related to the query. A lexicon enhancer adds vocabulary semi-automatically.
    Type: Application
    Filed: August 8, 2006
    Publication date: May 10, 2007
    Inventors: Kathleen Dahlgren, Edward Stabler, Karen Wallace, Paul Deane
  • Publication number: 20060042706
    Abstract: This invention relates to a drinks dispenser, and in particular to a drinks dispenser suitable for use at commercial premises such as a bar or public house for serving beer and the like. According to the invention there is provided a drinks dispenser comprising a frame (14) carrying at least one tap (20), the frame being connected to a column (12) within which can be located a conduit (52) for delivering liquid to the tap, the frame having connectors (30) by which separate and additional frame(s) (16) may be connected thereto, a separate cover (76) being provided which can be mounted upon the frame means. The drinks dispenser is therefore modular in construction, with the frame(s) providing the structural strength of the dispenser and the cover(s) fulfilling the aesthetic requirements.
    Type: Application
    Filed: November 11, 2003
    Publication date: March 2, 2006
    Inventors: Keith Perry, Paul Deane, Christopher Gregson
  • Publication number: 20050222837
    Abstract: A method and system for determining a lexical association of phrasal terms are described. A corpus having a plurality of words is received, and a plurality of contexts including one or more context words proximate to a word in the corpus is determined. An occurrence count for each context is determined, and a global rank is assigned based on the occurrence count. Similarly, a number of occurrences of a word being used in a context is determined, and a local rank is assigned to the word-context pair based on the number of occurrences. A rank ratio is then determined for each word-context pair. A rank ratio is equal to the global rank divided by the local rank for a word-context pair. A mutual rank ratio is determined by multiplying the rank ratios corresponding to a phrase. The mutual rank ratio is used to identify phrasal terms in the corpus.
    Type: Application
    Filed: April 6, 2005
    Publication date: October 6, 2005
    Inventor: Paul Deane
  • Publication number: 20050049867
    Abstract: A method and system for performing automatic text analysis is described. A local ranking for one or more contexts with respect to a word and a global ranking for one or more contexts are generated. The rankings are based on the frequency with which the contexts appear in a corpus. A statistic may be generated using the local and global rankings, such as a log ratio rank statistic equal to the logarithm of the global rank divided by local rank, to measure the similarity of contexts with respect to words with which they combine. A source matrix of word to context values is then created. Singular value decomposition is used to create sub-matrices from the source matrix. Vectors from the sub-matrices corresponding to context(s) and/or word(s) are then selected to determine term-term or context-context similarity or term-context correspondence.
    Type: Application
    Filed: August 11, 2004
    Publication date: March 3, 2005
    Inventor: Paul Deane
  • Publication number: 20040253569
    Abstract: A method and system for using a natural language generator for automatic assessment item generation is disclosed. The natural language generator includes a document structure generator that produces an abstract document specification defining a structure for an assessment item based on user input. The abstract document specification is input into a logical schema generator, which produces a logical schema specification that creates a more detailed specification for an assessment item. Finally, a sentence generator receives the logical schema specification and creates natural language for the assessment item based on the variables defined in the logical schema specification.
    Type: Application
    Filed: April 12, 2004
    Publication date: December 16, 2004
    Inventors: Paul Deane, Derrick Higgins