Generalized Attention Flow: Feature Attribution for Transformer Models via Maximum Flow

Authors: Behrooz Azarkhalili Aghmiyouni, Maxwell Libbrecht
Primary area: interpretability and explainable AI
Keywords: Attention Flow, Feature Attributions, Transformers, Barrier Regularization, Maximum Flow

Abstract:
This paper introduces Generalized Attention Flow, a novel feature attribution method for Transformer models that addresses the limitations of existing approaches. By generalizing Attention Flow and substituting attention weights with an arbitrary Information Tensor, the method leverages attention weights, their gradients, maximum flow, and the barrier method to generate more accurate feature attributions. The proposed approach demonstrates superior theoretical properties and resolves issues associated with previous methods that rely solely on simple aggregation of attention weights. Comprehensive benchmarking in NLP sequence classification tasks reveals that a specific variant of Generalized Attention Flow consistently outperforms state-of-the-art feature attribution methods across most evaluation scenarios, offering a more accurate explanation of Transformer model outputs.

Decision: desk reject

Reviews and discussion:

Metareview: