Abstract: Methods, systems, apparatuses, and computer program products are provided for updating a catalog of assets. A scanning agent may scan for a set of assets in a data store. A scan validator may receive, from the scanning agent, a list of assets scanned in the data store and determine that a summary record is received from the scanning agent. The summary record may include an asset summary generated by the scanning agent corresponding to the list of scanned assets. In response to determining that the summary record is received, the scan validator may determine whether the asset summary in the summary record matches an asset summary generated from the list of assets. If a match is determined between the asset summaries, a match validation may be provided. In response to the match validation being provided, assets absent from the list of assets may be removed from the asset catalog.

Abstract: Described herein is a system and method for utilizing data flow analysis to perform data classification with respect to a source dataset and a generated derived dataset. A flow confidence for a field is calculated using an adaptive algorithm in accordance with the action performed and the derived dataset. An associated derived confidence for a particular tag is calculated in accordance with an associated confidence and the flow confidence. When the associated derived confidence is greater than or equal to a first threshold, the particular tag is copied to the derived dataset. In some embodiments, when the associated derived confidence is less than or equal to a second threshold, the particular tag is not copied to the derived dataset. Otherwise an action to be taken is identified. A response to the action is received and the adaptive algorithm is modified in accordance with the received response.

Abstract: Methods, systems, apparatuses, and computer program products are provided for updating a catalog of assets. A scanning agent may scan for a set of assets in a data store. A scan validator may receive, from the scanning agent, a list of assets scanned in the data store and determine that a summary record is received from the scanning agent. The summary record may include an asset summary generated by the scanning agent corresponding to the list of scanned assets. In response to determining that the summary record is received, the scan validator may determine whether the asset summary in the summary record matches an asset summary generated from the list of assets. If a match is determined between the asset summaries, a match validation may be provided. In response to the match validation being provided, assets absent from the list of assets may be removed from the asset catalog.

Abstract: Described herein is a system and method for utilizing data flow analysis to perform data classification with respect to a source dataset and a generated derived dataset. A flow confidence for a field is calculated using an adaptive algorithm in accordance with the action performed and the derived dataset. An associated derived confidence for a particular tag is calculated in accordance with an associated confidence and the flow confidence. When the associated derived confidence is greater than or equal to a first threshold, the particular tag is copied to the derived dataset. In some embodiments, when the associated derived confidence is less than or equal to a second threshold, the particular tag is not copied to the derived dataset. Otherwise an action to be taken is identified. A response to the action is received and the adaptive algorithm is modified in accordance with the received response.