The Explainability of Transformers: Current Status and Directions

P Fantozzi, M Naldi - Computers, 2024 - mdpi.com
An increasing demand for model explainability has accompanied the widespread adoption
of transformers in various fields of applications. In this paper, we conduct a survey of the …

Inpainting the Gaps: A Novel Framework for Evaluating Explanation Methods in Vision Transformers

L Badisa, SS Channappayya - arXiv preprint arXiv:2406.11534, 2024 - arxiv.org
The perturbation test remains the go-to evaluation approach for explanation methods in
computer vision. This evaluation method has a major drawback of test-time distribution shift …

A Multi-Modal Explainability Approach for Human-Aware Robots in Multi-Party Conversation

I Bečková, Š Pócoš, G Belgiovine, M Matarese… - arXiv preprint arXiv …, 2024 - arxiv.org
The addressee estimation (understanding to whom somebody is talking) is a fundamental
task for human activity recognition in multi-party conversation scenarios. Specifically, in the …

A Unified Framework for Interpretable Transformers Using PDEs and Information Theory

Y Zhang - arXiv preprint arXiv:2408.09523, 2024 - arxiv.org
This paper presents a novel unified theoretical framework for understanding Transformer
architectures by integrating Partial Differential Equations (PDEs), Neural Information Flow …