Songlin Yang

sonta7's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a paper 26 days ago

Gated Delta Networks: Improving Mamba2 with Delta Rule

Paper • 2412.06464 • Published 28 days ago • 9

upvoted an article 3 months ago

view article

Article

History of State Space Models (SSM) in 2022

By •

Apr 11, 2024

• 15

upvoted 2 papers 4 months ago

A Controlled Study on Long Context Extension and Generalization in LLMs

Paper • 2409.12181 • Published Sep 18, 2024 • 44

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11, 2024 • 19

upvoted a paper 7 months ago

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Paper • 2406.06484 • Published Jun 10, 2024 • 3

upvoted a collection 8 months ago

based

Collection

These language model checkpoints are trained at the 360M and 1.3Bn parameter scales for up to 50Bn tokens on the Pile corpus, for research purposes. • 15 items • Updated Oct 18, 2024 • 9