acl-short.102
Latent Positional Information is in the Self-Attention Variance of Transformer Language Models Without Positional Embeddings
Chi, Ta-Chung Fan, Ting-Han Chen, Li-Wei Rudnicky, Alex er Ramadge, Peter