Abstract: Various methods and processes, apparatuses or systems, and media for operating a low latency data store that is designed to provide rapid accessibility to data while ensuring data integrity, consistency, and reliability are disclosed. The method includes: receiving a set of data; storing the set of data in a storage medium; receiving, from a user, a query that relates to the set of data; and providing a subset of the set of data to the user in response to the query. The storage medium includes a non-relational database that implements a Command Query Responsibility Segregation (CQRS) architecture within which a command part performs write operations and a query part performs read operations. The query part is horizontally scaled such that the provision of the subset of the set of data is performable within less than one second of the receiving of the query.

Abstract: Systems and methods for self-service data structure discovery are disclosed. In one embodiment, a method may include: (1) retrieving, by a data crawler, data from one or more data sources; (2) storing, by the data crawler, the data to a data catalog; (3) receiving, at a search dashboard, a query from a user, the query comprising a search field; (4) submitting, by the search dashboard and using a query tool, the query to a data catalog, wherein the query tool searches the search field by data structure, datatype, field journey, primary key details, and/or multi-value column detail across layers, data lineage controls in the data catalog; (5) receiving, at the search dashboard, a result of the query from the data catalog; and (6) presenting, by the search dashboard, the results.

Abstract: In some aspects, the techniques described herein relate to a method including: receiving, at a data management platform, incoming data; writing the incoming data to a primary database cluster; executing an incremental backup operation, wherein the incremental backup operation generates an incremental backup of the primary database cluster; storing the incremental backup of the primary database cluster in a storage location; after a predetermined amount of time, executing an incremental restore operation on a delayed database cluster, wherein the incremental restore operation restores the incremental backup of the primary database cluster to the delayed database cluster; determining a data anomaly in the incoming data; and executing a failover command, wherein the failover command redirects database queries from the primary database cluster to the delayed database cluster.

Abstract: Systems and methods for self-service data structure discovery are disclosed. In one embodiment, a method may include: (1) retrieving, by a data crawler, data from one or more data sources; (2) storing, by the data crawler, the data to a data catalog; (3) receiving, at a search dashboard, a query from a user, the query comprising a search field; (4) submitting, by the search dashboard and using a query tool, the query to a data catalog, wherein the query tool searches the search field by data structure, datatype, field journey, primary key details, and/or multi-value column detail across layers, data lineage controls in the data catalog; (5) receiving, at the search dashboard, a result of the query from the data catalog; and (6) presenting, by the search dashboard, the results.