Abstract: The present invention provides a framework for explainability of a machine learning-based decision-making system. The framework calculates the directional contribution and sensitivity of each feature for each prediction. In addition, the framework provides decision rules to explain each prediction made by the decision-making system. Furthermore, the framework displays a readable explanation of the decisions made by the decision-making system via mapping the model explanation to the business context.