sonta

sontata's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts

ahatamiz 

authored a paper 15 days ago

ViR: Vision Retention Networks

Paper • 2310.19731 • Published Oct 30, 2023 • 1

ahatamiz 

updated 4 models 4 months ago

sontata/gated_deltanet

Updated Sep 30, 2024 • 3

sontata/mamba1

Text Generation • Updated Sep 30, 2024 • 7

sontata/mamba2

Updated Sep 30, 2024 • 2

sontata/swa_gated_deltanet

Updated Sep 30, 2024 • 7

sonta7 

authored 3 papers 4 months ago

A Controlled Study on Long Context Extension and Generalization in LLMs

Paper • 2409.12181 • Published Sep 18, 2024 • 44

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Paper • 2406.06484 • Published Jun 10, 2024 • 3

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11, 2024 • 20

ahatamiz 

authored 3 papers 6 months ago

MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Paper • 2407.08083 • Published Jul 10, 2024 • 28

An Empirical Study of Mamba-based Language Models

Paper • 2406.07887 • Published Jun 12, 2024 • 1

Global Context Vision Transformers

Paper • 2206.09959 • Published Jun 20, 2022

sonta7 

authored a paper 9 months ago

HGRN2: Gated Linear RNNs with State Expansion

Paper • 2404.07904 • Published Apr 11, 2024 • 18

ahatamiz 

authored a paper about 1 year ago

DiffiT: Diffusion Vision Transformers for Image Generation

Paper • 2312.02139 • Published Dec 4, 2023 • 13

ahatamiz 

authored a paper over 1 year ago

FasterViT: Fast Vision Transformers with Hierarchical Attention

Paper • 2306.06189 • Published Jun 9, 2023 • 30