Abstract: The disclosure relates to method and system for performing real-time data validation. The method includes fetching a plurality of metadata from a set of external data sources and a set of external file storage systems. The plurality of metadata is fetched along with a set of connection configuration parameters and column mapping information The method further includes generating a set of clusters for performing data validation in an external processing infrastructure based on an analysis of the plurality of metadata and of the external processing infrastructure. The method further includes determining a set of test scripts from a plurality of test scripts based on the column mapping information and the set of connection configuration parameters. The method further includes performing a real-time data validation by executing the set of test scripts in the set of clusters.

Abstract: A data manipulation detection device that includes an alert engine configured to receive data from a data source, apply a set of rules for a threat model to the data using a first machine learning model, and to obtain an alert vector in response to applying the set of rules to the data. The device further includes an alert feedback engine configured to receive alert feedback that includes text comments for the alert vector. The device further includes a natural language processing (NLP) training engine configured to identify the text comments for the alert status and identify keywords within the text comments associated with a rule parameter value for a rule. The NLP training engine is further configured to determine a new rule parameter value based on the identified keywords and modify a rule parameter value for the rule based on the new rule parameter value.

Abstract: The disclosure relates to method and system for performing real-time data validation. The method includes fetching a plurality of metadata from a set of external data sources and a set of external file storage systems. The plurality of metadata is fetched along with a set of connection configuration parameters and column mapping information The method further includes generating a set of clusters for performing data validation in an external processing infrastructure based on an analysis of the plurality of metadata and of the external processing infrastructure. The method further includes determining a set of test scripts from a plurality of test scripts based on the column mapping information and the set of connection configuration parameters. The method further includes performing a real-time data validation by executing the set of test scripts in the set of clusters.

Abstract: A data manipulation detection device that includes an alert engine configured to receive data from a data source, apply a set of rules for a threat model to the data using a first machine learning model, and to obtain an alert vector in response to applying the set of rules to the data. The device further includes an alert feedback engine configured to receive alert feedback that includes text comments for the alert vector. The device further includes a natural language processing (NLP) training engine configured to identify the text comments for the alert status and identify keywords within the text comments associated with a rule parameter value for a rule. The NLP training engine is further configured to determine a new rule parameter value based on the identified keywords and modify a rule parameter value for the rule based on the new rule parameter value.