Anisotropy Is Inherent to Self-Attention in Transformers
Nathan Godey, Éric Villemonte de la Clergerie, Benoît Sagot
Main: Interpretability and Model Analysis in NLP Poster Paper
Session 4: Interpretability and Model Analysis in NLP (Poster)
Conference Room: Radisson
Conference Time: March 18, 16:00-17:30 (CET) (Europe/Malta)
TLDR:
You can open the
#paper-4
channel in a separate window.
Abstract: