Selective Attention Improves Transformer
Paper
•
2410.02703
•
Published
•
23
Attention
-
-
Differential Transformer
Paper • 2410.05258 • Published • 169 -
TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
Paper • 2410.05076 • Published • 8 -
SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
Paper • 2410.13276 • Published • 26 -
Star Attention: Efficient LLM Inference over Long Sequences
Paper • 2411.17116 • Published • 48 -
KV Shifting Attention Enhances Language Modeling
Paper • 2411.19574 • Published • 8