Abstract: This disclosure describes techniques for managing both batch and streaming data and managing the efficient and timely calculation of features that are based on such data. In one example, this disclosure describes a method that includes receiving, by a computing system, batch and streaming data; generating, by the computing system and based on the batch and streaming data, a preliminary set of calculated features; receiving, by the computing system, a request to score input data; identifying, by the computing system and based on information included in the request, a model and input features for the model; generating, by the computing system and using the preliminary set of calculated features, the input features; applying the model, by the computing system, to the input features to generate model output data; and outputting, by the computing system, the model output data.

Abstract: This disclosure describes techniques that include identifying sensitive information from any appropriate set of data, such as data produced by operations of a business or organization. In one example, this disclosure describes a method that includes receiving text data containing sensitive information, including structured sensitive information and unstructured sensitive information; applying a rule-based model to identify the structured sensitive information in the text data; applying a machine learning model to identify the unstructured sensitive information in the text data, wherein the machine learning model has been trained to identify unstructured sensitive information in text; and generating output text data from the text data by modifying the structured sensitive information identified by the rule-based model and the unstructured sensitive information identified by the machine learning model.