The Importance of Interpretability
As models are deployed in high-stakes environments, understanding why a model made a prediction is crucial.
SHAP vs. LIME
- SHAP (SHapley Additive exPlanations): Game theory-based approach that attributes change in output to each feature.
- LIME (Local Interpretable Model-agnostic Explanations): Approximates the black-box model locally with an interpretable model (like a linear regression).