Sparse Foundational Llama 2 Models
Collection
Sparse pre-trained and fine-tuned Llama models made by Neural Magic + Cerebras
•
27 items
•
Updated
•
9
Eli Chen
elichen3051
AI & ML interests
Learning Algorithm, Reinforcement Learning, Data Synthesize, Benchmarking
Recent Activity
updated
a dataset
3 days ago
skymizer/open-orca-conversations
updated
a dataset
3 days ago
skymizer/slimorca-deduped-cleaned-corrected
updated
a dataset
3 days ago
skymizer/Sonnet3.5-SlimOrcaDedupCleaned
Organizations
elichen3051's activity
upvoted
a
collection
25 days ago
upvoted
an
article
about 2 months ago
Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
By
•
•
10
upvoted
2
collections
7 months ago