Abstract: Systems and methods of the present invention may be used to determine metrics and health scores for content that may correspond to an educational course or textbook, which may be in a digital format. The metrics and health scores may be determined at various hierarchical content levels, and may be used to quantitatively assess how well the corresponding content is performing based on responses submitted to assessment item parts of the content by responders. The metrics may include difficulty and discrimination metrics, which may be determined using maximum likelihood estimation methods based on a modified two parameter item response model. A content analytics interface corresponding to a given content element may be generated and displayed via a user device, and may include content health scores of subcontent within that content element. The subcontent may be ordered according to content health score.

Abstract: Systems and methods of the present invention provide for estimating latent ability of responders to a digital assessment in the form of ability scores and estimating item parameters an assessment item of the digital assessment including difficulty scores and discrimination scores. Maximum likelihood estimation may be performed based on an item response theory model to estimate the item parameters. Supervisory, extraction, and worker modules of a workflow manager module may initiate general purpose graphics processing unit instances and cause these instances to perform the maximum likelihood estimation calculations. The item response theory model may be a two parameter model that is modified to account for changes in difficulty caused by the use of hints.

Abstract: Systems and methods of the present invention provide for one or more machine learning models configured to generate one or more student outcome predictions, such as whether a student will correctly respond to items of an assessment or will pass the assessment, based on monitored student activity and associated parameters. Inputs to the machine learning models may include outputs of other predictive models, such as an item response theory model and a short term prediction model. The machine learning models may output a student outcome prediction vector containing student outcome predictions for each uncompleted item of an assessment being delivered to a student in real-time. Remediation activities may be recommended to or automatically initiated for the student based on the student outcome predictions. A delivery order of the assessment may be modified based on the student outcome predictions.

Abstract: Systems and methods of the present invention may be used to determine metrics and health scores for content that may correspond to an educational course or textbook, which may be in a digital format. The metrics and health scores may be determined at various hierarchical content levels, and may be used to quantitatively assess how well the corresponding content is performing based on responses submitted to assessment item parts of the content by responders. The metrics may include difficulty and discrimination metrics, which may be determined using maximum likelihood estimation methods based on a modified two parameter item response model. A content analytics interface corresponding to a given content element may be generated and displayed via a user device, and may include content health scores of subcontent within that content element. The subcontent may be ordered according to content health score.

Abstract: Systems and methods of the present invention may be used to determine metrics and health scores for content that may correspond to an educational course or textbook, which may be in a digital format. The metrics and health scores may be determined at the assessment-item-part-level, assessment-item-level, section-level, chapter-level, and title-level, and may be used to quantitatively assess how well the corresponding content is performing based on responses submitted to assessment item parts of the content by one or more responders. The assessment-item-part-level metrics may include difficulty and discrimination values, scores, weights, and reliability values, which may be determined in whole or in part using maximum likelihood estimation methods based on a modified two parameter item response model.

Abstract: Systems and methods of the present invention may be used to determine metrics and health scores for content that may correspond to an educational course or textbook, which may be in a digital format. The metrics and health scores may be determined at various hierarchical content levels, and may be used to quantitatively assess how well the corresponding content is performing based on responses submitted to assessment item parts of the content by responders. The metrics may include difficulty and discrimination metrics, which may be determined using maximum likelihood estimation methods based on a modified two parameter item response model. A content analytics interface corresponding to a given content element may be generated and displayed via a user device, and may include content health scores of subcontent within that content element. The subcontent may be ordered according to content health score.

Abstract: Systems and methods for automated and direct network positioning are disclosed herein. The system can include memory that can include a content library database and a structure sub-database. The system can include at least one server. The at least one server can: receive a data packet previously unassociated with the hierarchy in the structure sub-database; identify one of the plurality of positions within the hierarchy for the data packet; receive user information; present a series of assessment data packets to the user; receive a response from the user subsequent to presentation of each of the assessment data packets; evaluate the received responses; adjust a location of the user within the hierarchy based on the evaluating of the received responses; and present a content data packet to the user.

Abstract: Systems and methods for virtual reality interaction evaluation are disclosed herein. The system can include a memory including: an interaction sub-database containing information relating to user interactions with at least one virtual asset in a virtual environment, and a content library database containing a plurality of virtual assets and information relating to those virtual assets. The system can include at least one server that can determine user engagement with at least one of the plurality of virtual assets, receive data indicative of an interaction with at least one of the plurality of virtual assets, and determine an interaction type of the interaction associated with the received data. The server can perform a speech capture and analysis process, perform a manipulation process, generate an evaluation of the user interactions with the at least one of the plurality of virtual assets, and deliver the generated evaluation.

Abstract: Embodiments of the present disclosure relate to systems and methods for reinforcement learning based content recommendation. The method includes receiving configuration data for creation of a reinforcement learning model, generating a plurality of correlation matrices, receiving a request for content for providing to a user, determining a user context, the user context characterizing an aggregation of attributes of the user, and selecting a next piece of content from a database of pieces of content. The method can include presenting the selected piece of content to the user, receiving user inputs in response to the presenting of the selected piece of content to the user, and updating the value characterizing the outcome of previous presentation of the selected piece of content based on the received user input.

Abstract: Systems and methods of the present invention may be used to determine metrics and health scores for content that may correspond to an educational course or textbook, which may be in a digital format. The metrics and health scores may be determined at various hierarchical content levels, and may be used to quantitatively assess how well the corresponding content is performing based on responses submitted to assessment item parts of the content by responders. The metrics may include difficulty and discrimination metrics, which may be determined using maximum likelihood estimation methods based on a modified two parameter item response model. A content analytics interface corresponding to a given content element may be generated and displayed via a user device, and may include content health scores of subcontent within that content element. The subcontent may be ordered according to content health score.

Abstract: Techniques described herein relate to mapping of digital credential objects to various field data objects. For example, requests may be received by a digital credential platform server from digital credential template owner devices, issuer devices, and/or receiver devices. In response, the digital credential platform server may determine and transmit back mappings between the digital credentials and the selected field data objects. To generate mappings, digital credential objects may be tokenize and transformed into vectors within a multi-dimensional vector space. Individual field data objects stored within a high-performance text search engine also may be transformed into vectors within the same multi-dimensional vector space, and the distances between the vectors may be calculated to select a number of field data objects corresponding to the digital credential objects.

Abstract: Systems and methods of the present invention provide for estimating latent ability of responders to a digital assessment in the form of ability scores and estimating item parameters an assessment item of the digital assessment including difficulty scores and discrimination scores. Maximum likelihood estimation may be performed based on an item response theory model to estimate the item parameters. Supervisory, extraction, and worker modules of a workflow manager module may initiate general purpose graphics processing unit instances and cause these instances to perform the maximum likelihood estimation calculations. The item response theory model may be a two parameter model that is modified to account for changes in difficulty caused by the use of hints.

Abstract: Systems and methods of the present invention may be used to determine metrics and health scores for content that may correspond to an educational course or textbook, which may be in a digital format. The metrics and health scores may be determined at the assessment-item-part-level, assessment-item-level, section-level, chapter-level, and title-level, and may be used to quantitatively assess how well the corresponding content is performing based on responses submitted to assessment item parts of the content by one or more responders. The assessment-item-part-level metrics may include difficulty and discrimination values, scores, weights, and reliability values, which may be determined in whole or in part using maximum likelihood estimation methods based on a modified two parameter item response model.

Abstract: Systems and methods of the present invention provide for one or more machine learning models configured to generate one or more student outcome predictions, such as whether a student will correctly respond to items of an assessment or will pass the assessment, based on monitored student activity and associated parameters. Inputs to the machine learning models may include outputs of other predictive models, such as an item response theory model and a short term prediction model. The machine learning models may output a student outcome prediction vector containing student outcome predictions for each uncompleted item of an assessment being delivered to a student in real-time. Remediation activities may be recommended to or automatically initiated for the student based on the student outcome predictions. A delivery order of the assessment may be modified based on the student outcome predictions.

Abstract: Systems and methods for automated and direct network positioning are disclosed herein. The system can include memory that can include a content library database and a structure sub-database. The system can include at least one server. The at least one server can: receive a data packet previously unassociated with the hierarchy in the structure sub-database; identify one of the plurality of positions within the hierarchy for the data packet; receive user information; present a series of assessment data packets to the user; receive a response from the user subsequent to presentation of each of the assessment data packets; evaluate the received responses; adjust a location of the user within the hierarchy based on the evaluating of the received responses; and present a content data packet to the user.

Abstract: Systems and methods for automated content delivery and evaluation are disclosed herein. The system can include a memory. The memory can include a content library database including a plurality of problems and data for stepwise evaluation of each of the plurality of problems. The system can include at least one server. The at least one server can automatically decompose a content item into a plurality of potential steps and associate attributes with the potential steps. The at least one server can receive a response from a user for the content item, identify steps in the received response, and select a next action based the identified steps of the received response.

Abstract: Systems and methods for automated content delivery and evaluation are disclosed herein. The system can include a memory. The memory can include a content library database including a plurality of problems and data for stepwise evaluation of each of the plurality of problems. The system can include at least one server. The at least one server can automatically decompose a content item into a plurality of potential steps and associate attributes with the potential steps. The at least one server can receive a response from a user for the content item, identify steps in the received response, and select a next action based the identified steps of the received response.

Abstract: Techniques described herein relate to mapping of digital credential objects to various field data objects. For example, requests may be received by a digital credential platform server from digital credential template owner devices, issuer devices, and/or receiver devices. In response, the digital credential platform server may determine and transmit back mappings between the digital credentials and the selected field data objects. To generate mappings, digital credential objects may be tokenize and transformed into vectors within a multi-dimensional vector space. Individual field data objects stored within a high-performance text search engine also may be transformed into vectors within the same multi-dimensional vector space, and the distances between the vectors may be calculated to select a number of field data objects corresponding to the digital credential objects.

Abstract: Systems and methods for virtual reality interaction evaluation are disclosed herein. The system can include a memory including: an interaction sub-database containing information relating to user interactions with at least one virtual asset in a virtual environment, and a content library database containing a plurality of virtual assets and information relating to those virtual assets. The system can include at least one server that can determine user engagement with at least one of the plurality of virtual assets, receive data indicative of an interaction with at least one of the plurality of virtual assets, and determine an interaction type of the interaction associated with the received data. The server can perform a speech capture and analysis process, perform a manipulation process, generate an evaluation of the user interactions with the at least one of the plurality of virtual assets, and deliver the generated evaluation.

Abstract: Systems and methods for virtual reality interaction evaluation are disclosed herein. The system can include a memory including: an interaction sub-database containing information relating to user interactions with at least one virtual asset in a virtual environment, and a content library database containing a plurality of virtual assets and information relating to those virtual assets. The system can include at least one server that can determine user engagement with at least one of the plurality of virtual assets, receive data indicative of an interaction with at least one of the plurality of virtual assets, and determine an interaction type of the interaction associated with the received data. The server can perform a speech capture and analysis process, perform a manipulation process, generate an evaluation of the user interactions with the at least one of the plurality of virtual assets, and deliver the generated evaluation.