Abstract: A predictive model pipeline data store may contain electronic records defining a predictive model pipeline composed of operation nodes. Based on the information in the data store, an execution framework platform may calculate a hash value for each operation node by including all recursive dependencies using ancestor node hash values and current node parameters. The platform may then compare each computed hash value with a previously computed hash value associated with a prior execution of a prior version of the pipeline. Operation nodes that have an unchanged hash value may be tagged “idle.” Operation nodes that have a changed hash value may be tagged “train and apply” or “apply” based on current node parameters (and an “apply” tag may propagate backwards through the pipeline to ancestor nodes). The platform may then ignore the operation nodes tagged “idle” when creating a physical execution plan to be provided to a target platform.

Abstract: A predictive model pipeline data store may contain electronic records defining a predictive model pipeline composed of operation nodes. Based on the information in the data store, an execution framework platform may calculate a hash value for each operation node by including all recursive dependencies using ancestor node hash values and current node parameters. The platform may then compare each computed hash value with a previously computed hash value associated with a prior execution of a prior version of the pipeline. Operation nodes that have an unchanged hash value may be tagged “idle.” Operation nodes that have a changed hash value may be tagged “train and apply” or “apply” based on current node parameters (and an “apply” tag may propagate backwards through the pipeline to ancestor nodes). The platform may then ignore the operation nodes tagged “idle” when creating a physical execution plan to be provided to a target platform.