Fuzzy Rule-Based Local Surrogate Models for Black-Box Model Explanation

Understanding the rationale behind the predictions produced by machine learning models is a necessary prerequisite for human to build confidence and trust for the intelligent systems. To tackle the problem of interpretability faced by black-box models, a fuzzy local surrogate model is proposed in this study to articulate the rationale for predictions to enhance the interpretability of the results of machine learning models. Fuzzy rule-based model comes with high interpretability since it is composed of a collection of readable rules, and thus is suitable for prediction interpretation. The general scheme of fuzzy local surrogate model is composed of the following phases: i) select data points around the instance of interest, for which we wish to explain the prediction result produced by the predictive model; ii) generate predictions for these newly selected data and weight the selected data based on the distance from the instance of interest; and iii) a fuzzy rule-based model composed a collection of interpretable is constructed to approximate the weighted data and offer meaningful interpretation to the prediction result of the given instance. The proposed fuzzy model for explaining predictions is model-agnostic and could provide high estimation accuracy. The proposed methodology offers a significant original contribution to the interpretation of machine learning models. Experimental studies demonstrate the usefulness of the proposed fuzzy local surrogate model in providing local explanations.