From anecdotal evidence to quantitative evaluation methods: A systematic review on evaluating explainable ai

M Nauta, J Trienes, S Pathak, E Nguyen… - ACM Computing …, 2023 - dl.acm.org
The rising popularity of explainable artificial intelligence (XAI) to understand high-performing
black boxes raised the question of how to evaluate explanations of machine learning (ML) …

Algorithms to estimate Shapley value feature attributions

H Chen, IC Covert, SM Lundberg, SI Lee - Nature Machine Intelligence, 2023 - nature.com
Feature attributions based on the Shapley value are popular for explaining machine
learning models. However, their estimation is complex from both theoretical and …

A survey on neural network interpretability

Y Zhang, P Tiňo, A Leonardis… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Along with the great success of deep neural networks, there is also growing concern about
their black-box nature. The interpretability issue affects people's trust on deep learning …

The shapley value in machine learning

B Rozemberczki, L Watson, P Bayer, HT Yang… - arXiv preprint arXiv …, 2022 - arxiv.org
Over the last few years, the Shapley value, a solution concept from cooperative game theory,
has found numerous applications in machine learning. In this paper, we first discuss …

Explainable deep learning: A field guide for the uninitiated

G Ras, N Xie, M Van Gerven, D Doran - Journal of Artificial Intelligence …, 2022 - jair.org
Deep neural networks (DNNs) are an indispensable machine learning tool despite the
difficulty of diagnosing what aspects of a model's input drive its decisions. In countless real …

Explaining by removing: A unified framework for model explanation

I Covert, S Lundberg, SI Lee - Journal of Machine Learning Research, 2021 - jmlr.org
Researchers have proposed a wide variety of model explanation approaches, but it remains
unclear how most methods are related or when one method is preferable to another. We …

Causal machine learning: A survey and open problems

J Kaddour, A Lynch, Q Liu, MJ Kusner… - arXiv preprint arXiv …, 2022 - arxiv.org
Causal Machine Learning (CausalML) is an umbrella term for machine learning methods
that formalize the data-generation process as a structural causal model (SCM). This …

[HTML][HTML] Explaining individual predictions when features are dependent: More accurate approximations to Shapley values

K Aas, M Jullum, A Løland - Artificial Intelligence, 2021 - Elsevier
Explaining complex or seemingly simple machine learning models is an important practical
problem. We want to explain individual predictions from such models by learning simple …

How interpretable machine learning can benefit process understanding in the geosciences

S Jiang, L Sweet, G Blougouras, A Brenning… - Earth's …, 2024 - Wiley Online Library
Abstract Interpretable Machine Learning (IML) has rapidly advanced in recent years, offering
new opportunities to improve our understanding of the complex Earth system. IML goes …

SHAP-based explanation methods: a review for NLP interpretability

E Mosca, F Szigeti, S Tragianni… - Proceedings of the …, 2022 - aclanthology.org
Abstract Model explanations are crucial for the transparent, safe, and trustworthy
deployment of machine learning models. The SHapley Additive exPlanations (SHAP) …