Abstract: Certain aspects of the present disclosure provide techniques for operation of a feature management platform. A feature management platform is an end-to-end platform developed to manage the full lifecycle of data features. For example, to create a stateful feature, the feature management platform can receive a processing artifact from a computing device. The processing artifact defines the stateful feature, including the data source to retrieve event data from, when to retrieve the event data, the type of transform to apply, etc. Based on the processing artifact, the feature management system generates a processing job (e.g., the API defines a pipeline), which when initiated generates a vector that encapsulates the stateful feature. The vector is transmitted to the computing device that locally hosts a model, which generates a prediction that is transmitted to the feature management platform. Subsequently, the predication and stateful feature can be transmitted to other computing devices.

Abstract: A method for generating a synthetic dataset involves generating discretized synthetic data based on driving a model of a cumulative distribution function (CDF) with random numbers. The CDF is based on a source dataset. The method further includes generating the synthetic dataset from the discretized synthetic data by selecting, for inclusion into the synthetic dataset, values from a multitude of entries of the source dataset, based on the discretized synthetic data, and providing the synthetic dataset to a downstream application that is configured to operate on the source dataset.

Abstract: A method including extracting, from an input, supported data. The input includes outputs from machine learning models in different formats. The supported data includes a subset of the input after data normalization. The method also includes inferring, from the supported data, data types to be used with respect to generating metrics for the machine learning models. The method also includes generating, from the supported data and using the data types, a relational event including the supported data. The relational event further includes a first data structure object including the types and having a first data structure different than the different formats. The method also includes calculating, using the supported data in the first data structure, the metrics for the machine learning models. The method also includes generating, from the relational event, a monitoring event. The monitoring event includes a second data structure object segmented into data buckets storing the metrics.

Abstract: Certain aspects of the present disclosure provide techniques for operation of a feature management platform. A feature management platform is an end-to-end platform developed to manage the full lifecycle of data features. For example, to create a stateful feature, the feature management platform can receive a processing artifact from a computing device. The processing artifact defines the stateful feature, including the data source to retrieve event data from, when to retrieve the event data, the type of transform to apply, etc. Based on the processing artifact, the feature management system generates a processing job (e.g., the API defines a pipeline), which when initiated generates a vector that encapsulates the stateful feature. The vector is transmitted to the computing device that locally hosts a model, which generates a prediction that is transmitted to the feature management platform. Subsequently, the predication and stateful feature can be transmitted to other computing devices.

Abstract: Certain aspects of the present disclosure provide techniques for operation of a feature management platform. A feature management platform is an end-to-end platform developed to manage the full lifecycle of data features. For example, to create a stateful feature, the feature management platform can receive a processing artifact from a computing device. The processing artifact defines the stateful feature, including the data source to retrieve event data from, when to retrieve the event data, the type of transform to apply, etc. Based on the processing artifact, the feature management system generates a processing job (e.g., the API defines a pipeline), which when initiated generates a vector that encapsulates the stateful feature. The vector is transmitted to the computing device that locally hosts a model, which generates a prediction that is transmitted to the feature management platform. Subsequently, the predication and stateful feature can be transmitted to other computing devices.

Abstract: Certain aspects of the present disclosure provide techniques for a “hand-off” operation of a feature management platform. A feature management platform can receive a request to generate feature data based on batch and streaming data. To generate such feature data, a “hand-off” occurs between a batch processing job to a stream processing job. The feature management platform can initiate the batch processing job to generate a first set of feature data. Once all of the feature data is generated by the batch processing job, the feature data is saved in an offline database. The feature data with the maximum timestamp is saved in an online database, and the maximum timestamp is saved in a persistent database. With the maximum timestamp, the feature management platform begins the stream processing job. Once feature data is generated by the stream processing job, the feature data is stored in an offline or online database.

Abstract: Certain aspects of the present disclosure provide techniques for operation of a feature management platform. A feature management platform is an end-to-end platform developed to manage the full lifecycle of data features. For example, to create a stateful feature, the feature management platform can receive a processing artifact from a computing device. The processing artifact defines the stateful feature, including the data source to retrieve event data from, when to retrieve the event data, the type of transform to apply, etc. Based on the processing artifact, the feature management system generates a processing job (e.g., the API defines a pipeline), which when initiated generates a vector that encapsulates the stateful feature. The vector is transmitted to the computing device that locally hosts a model, which generates a prediction that is transmitted to the feature management platform. Subsequently, the predication and stateful feature can be transmitted to other computing devices.

Abstract: A method including extracting, from an input, supported data. The input includes outputs from machine learning models in different formats. The supported data includes a subset of the input after data normalization. The method also includes inferring, from the supported data, data types to be used with respect to generating metrics for the machine learning models. The method also includes generating, from the supported data and using the data types, a relational event including the supported data. The relational event further includes a first data structure object including the types and having a first data structure different than the different formats. The method also includes calculating, using the supported data in the first data structure, the metrics for the machine learning models. The method also includes generating, from the relational event, a monitoring event. The monitoring event includes a second data structure object segmented into data buckets storing the metrics.

Abstract: A method for generating a synthetic dataset involves generating discretized synthetic data based on driving a model of a cumulative distribution function (CDF) with random numbers. The CDF is based on a source dataset. The method further includes generating the synthetic dataset from the discretized synthetic data by selecting, for inclusion into the synthetic dataset, values from a multitude of entries of the source dataset, based on the discretized synthetic data, and providing the synthetic dataset to a downstream application that is configured to operate on the source dataset.