Abstract: The present disclosure provides methods for reducing prediction latency. The method comprises: (a) receiving, at a first computing system, a service request including feature data for performing a prediction; (b) the first computing system making a first intermediary prediction using a first machine learning model based on a first set of data and the feature data; (c) concurrent with (b) a second computing system making a second intermediary prediction using a second machine learning model in response to a prediction request received from the first computing system, and the second intermediary prediction is generated based on a second set of data and feature data included in the prediction request; (d) making an enhanced prediction by the first computing system based on the first intermediary prediction and the second intermediary prediction, and the second set of data and the second machine learning model are inaccessible to the first computing system.

Abstract: The present disclosure provides methods and systems for providing machine learning model service. The method may comprise: (a) generating, by a first computing system, a first output data using a first machine learning model, wherein the first machine learning model is trained on a first training dataset; (b) transmitting the first output data to a second computing system, wherein the first training dataset and the first machine learning model are inaccessible to the second computing system; (c) creating an input data by joining the first output data with a selected set of input features accessible to the second computing system; and (d) generating a second output data using a second machine learning model to process the input data.