Abstract: Methods and systems are disclosed for creating and linking a series of interfaces configured to display information and receive confirmation of classifications made by a natural language modeling engine to improve organization of a collection of documents into an hierarchical structure. In some embodiments, the interfaces may display to an annotator a plurality of labels of potential classifications for a document as identified by a natural language modeling engine, collect annotated responses from the annotator, aggregate the annotated responses across other annotators, analyze the accuracy of the natural language modeling engine based on the aggregated annotated responses, and predict accuracies of the natural language modeling engine's classifications of the documents.
February 22, 2021
July 29, 2021
AI IP INVESTMENTS LTD
Robert J. Munro, Christopher Walker, Sarah K. Luger, Jason Brenier, Paul A. Tepper, Ross Mechanic, Andrew Gilchrist-Scott, Gary C. King, Brendan D. Callahan, Tyler J. Schnoebelen, Edgar Nunez, Haley Most