Sinkformers: Transformers with Doubly Stochastic Attention

Published in AISTATS, 2021

Michael E. Sander, Pierre Ablin, Mathieu Blondel, Gabriel Peyré. Paper and GitHub