Abstract: In various embodiments, a system and method for recognizing and integrating datasets disclosed. The system comprises a processor and a memory unit. A training dataset is developed that forms the basis to measure similarities between and among the datasets. Incoming datasets are examined for features and a measurement is made to determine similarity with datasets in the training dataset. An estimate can be made of the probability that an incoming dataset contains specified attributes. The incoming dataset can be assigned an attribute based on the probability estimate.

Abstract: A system and method for record linkage includes performing an entity augmentation process for linking new data records with existing entities in a database. Performing the entity augmentation process includes performing an exact matching sub-process that includes accessing existing entity unique identifier (UID) keys in a memory cache layer and comparing a new data record UID key to the existing entity UID keys.

Abstract: In various embodiments, a system for ingesting, organizing, and storing data is disclosed. The system comprises a processor and a memory unit. A document database is stored by the memory unit. The document database is configured to store data without any foreknowledge of a structure of the data. The data comprises an ontology comprising a plurality of terms describing the data within the document database. A graph database is stored by the memory unit. The graph database comprises a materialized view of the document database. The graph database provides connections between the ontology. The document database and the graph database share common entity profile UUIDs.

Abstract: A system and method for record linkage includes performing an entity augmentation process for linking new data records with existing entities in a database. Performing the entity augmentation process includes performing an exact matching sub-process that includes accessing existing entity unique identifier (UID) keys in a memory cache layer and comparing a new data record UID key to the existing entity UID keys.

Abstract: In various embodiments, a system for ingesting, organizing, and storing data is disclosed. The system comprises a processor and a memory unit. A document database is stored by the memory unit. The document database is configured to store data without any foreknowledge of a structure of the data. The data comprises an ontology comprising a plurality of terms describing the data within the document database. A graph database is stored by the memory unit. The graph database comprises a materialized view of the document database. The graph database provides connections between the ontology. The document database and the graph database share common entity profile UUIDs.