Abstract: Digital learning or tutoring systems as described herein embed, by a trained machine learning knowledge tracing engine, an array for learner interactions X into a static representation ej corresponding to a prior learner interaction xj and determine a contextualized interaction representation hj based on this. Digital tutoring systems described herein calculate, by a masked attention layer of the trained machine learning knowledge tracing engine, an attention weight Aij based on a time gap between two learner interactions with the system, and can calculate a contextualized interaction representation hj, wherein the contextualized interaction representation hj is proportional to the attention weight Aij. The systems can provide for display at the GUI a second question item based on the contextualized interaction representation hj, the second question item corresponding to a recommended learner recommendation.

Abstract: The present disclosure provides systems and methods for providing interface rendering of passages for test item generation. Methods and systems can utilize natural language processing (NLP) and machine learning (ML) models to analyze passages that were provided in historical testing environments (e.g., first passage), determine one or more similar search strings that are also found in a current passage (e.g., second passage), and provide the first and second passages to a user interface of a user device. On the display, the search string in the historical and current passages may be highlighted at the user interface to identify the similarities.

Abstract: A computer-implemented method for automatic item generation in an digital examination that includes obtaining a first string of text, the first string of text being organized based on a linguistic context, selecting a first textual term from the first string of text, identifying a first set of linguistic characteristics corresponding to the first textual term, obtaining a second textual term exhibiting at least one linguistic characteristic that is different from any linguistic characteristic of the first set of linguistic characteristics, and generating a second string of text by replacing the first textual term in the first string of text with the second textual term.

Abstract: A kit for administering a secure examination includes examinee interfaces and an enclosure with a gateway, power adapters to power the examinee interfaces, and a local examination server, wherein the local examination server includes a first network adapter configured to communicatively couple to a central examination server via a first network connection through the gateway and a second network adapter configured to communicatively couple to the plurality of examinee interface via a second network connection, and wherein the local examination server obtains examination items from the central examination server, transmits the examination items to the examinee interfaces, obtains a responsive input to the examination items from the examinee interfaces, transmits the responsive input to the central examination server, and causes the examinee interfaces to enter an examination mode that restricts access to applications, networks, and devices not required for taking the examination.

Abstract: A computerized system for scoring constructed responses to one or more prompts. The system receives a plurality of constructed responses in an electronic font-based format and separates the plurality of constructed responses into a first group of constructed responses that are scorable by the system and a second group of constructed responses that are not scorable by the system. The constructed responses in the first group are assigned scores based on predetermined rules, and the scores are sent to a score database. In a preferred embodiment, the first group includes constructed responses that do not answer the prompt and constructed responses that match pre-scored responses. The second group of constructed responses are sent by the system to a hand-scorer for manual scoring.

Abstract: A computer implemented method for evaluating examination responses includes receiving, with an examination evaluation server, an examination response, tokenizing the examination response into one or more n-word segments, extracting, from the response, a set of construct-relevant features indicating one or more scoring metrics, generating a set of scoring rules, and generating a score estimate as a function of one or more scoring rules from the set of scoring rules and one or more of the scoring metrics.

Abstract: A computer implemented method for identifying and removing similar examination items in a digital examination includes obtaining, with an examination evaluation server, a digital examination with a plurality of examination items, tokenizing a first examination item of the plurality of examination items into a first set of n-grams, tokenizing a second examination item of the plurality of examination items into a second set of n-grams, generating a first item vector from the first set of n-grams, generating a second item vector from the second set of n-grams, generating multiple item congruence values for corresponding similarity dimensions by comparing the first item vector with the second item vector, and identifying that the first and second examination items are a potential enemy item pair if one or more of the item congruence values exceed corresponding threshold values.

Abstract: A method for use of pretest items in a test to calculate interim scores is provided. The method includes, for example, a computer implemented test having a plurality of test items that include, for example, a plurality of operational items and one or more pretest items having one or more pretest item parameters. An interim latent construct estimate is calculated using both operational and pretest items. The error for the latent construct estimation is controlled by weighting the contribution of the one or more pretest items.

Abstract: A computer implemented method of examination scoring includes receiving, with an examination evaluation server, a language corpus with a plurality of corpus words, deriving, for each corpus word, a corpus sematic vector within a multi-dimensional semantic vector space, receiving first and second examination responses, tokenizing each examination response into a plurality of response words, identifying a set of matching response words from the plurality of response words from each examination response, identifying a set of semantic vectors corresponding to the matching response words for each examination response, and comparing the semantic vectors from the first examination response with the semantic vectors from the second examination response to derive a response semantic similarity value for use as an input for automated scoring.

Abstract: A method for test item selection is provided that includes a computer implemented test battery having at least two or more sections with a plurality of test items. An ability estimate is calculated from an earlier section(s) of the at least two or more sections and an initial item and subsequent items for a subsequent section are selected from the plurality of test items based upon the ability estimate(s) from the earlier section(s). Use of a more informative initial ability estimate in the item selection process can improve interim ability estimation accuracy and item selection efficiency while keeping item exposure and item usage rates at acceptable levels.

Abstract: A computer implemented method for detecting linguistic uniqueness includes receiving, with an examination evaluation server, a list of word n-grams and corresponding frequency values indicating the frequency at which each word n-gram appears in a language corpus, receiving an examination response with one or more sentences, tokenizing the sentences into a plurality of words or phrases, combining contiguous words or phrases into n-word segments, and identifying, for each n-word segment that matches a matching word n-gram from the list, the frequency value corresponding to the matching word n-gram.

Abstract: Computer-implemented methods and systems for textual analysis by generating models of the progression of writing and writing abilities are provided. A set of examinee-generated responses for one or more test items may be identified based upon at least one index. One or more data-based profiles may be assembled from the identified set of examinee-generated responses. Writing characteristics may be quantified from the assembled one or more data-based profiles based on the at least one index.

Abstract: A novel compound, (E)-1-(pyridyn-4-yl)-3-(7-(trifluoromethyl)quinolin-2-yl)-prop-2-en-1-one, is provided herein. (E)-1-(pyridyn-4-yl)-3-(7-(trifluoromethyl)quinolin-2-yl)-prop-2-en-1-one is an inhibitor of 6-phosphofructo-2-kinase/fructose-2,6-biphosphatase 3 (PFKFB3) with surprisingly superior efficacy and pharmacodynamic properties in vitro and in vivo. Also provided are pharmaceutical compositions including the compound and methods of use of the compound in treating cancer and tumors in vivo, as well as inhibiting glycolytic flux and PFKFB3 enzymatic activity in cells.

Abstract: Methods and systems for testing with test booklets and electronic devices are disclosed. In one aspect, a computer-assisted testing method and system is provided. A paper-delivered examination is used and includes an examination booklet and a plurality of test items. Solutions are entered into an electronic answer sheet for the test items in the examination booklet. An electronic attendance request from a student can be confirmed by granting the student access to an electronic response sheet corresponding to the paper-delivered exam. Student responses to the plurality of test items in the paper-delivered exam can be entered in the electronic response sheet.

Abstract: Computer-implemented methods and systems for textual analysis by generating models of the progression of writing and writing abilities are provided. A set of examinee-generated responses for one or more test items may be identified based upon at least one index. One or more data-based profiles may be assembled from the identified set of examinee-generated responses. Writing characteristics may be quantified from the assembled one or more data-based profiles based on the at least one index.

Abstract: The present invention provides a gaming platform and method, such as a mobile game and method, for crowd-sourcing one or more items of interest. One aspect is a gaming platform and method for crowd-sourcing one or more items of interest by matching a visual representation to a prompt using a mobile or electronic device. Queries are displayed to a player and an image representative of the query is acquired. A time period for the image to score is allocated. Points may be awarded to the player. Crowd-sourced items may be analyzed to determine public bias, perception and misconception.

Abstract: A method and system for assembling a test having a plurality of slots is disclosed. The method includes executing a test administration script to associate each of the plurality of slots of the test with an item collection from which an item to fill the slot is to be chosen and to determine a lookup table of optimization statistics and a degree of randomization to use in selecting items from the item collection. An interim test score is obtained based on a portion of the test previously assembled. Optimization statistics are applied to control a property of the test based on the interim score while taking into account the degree of randomization.