DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
Paper
•
2405.04434
•
Published
•
14
LLM
-
-
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
Paper • 2406.17557 • Published • 88 -
DataComp-LM: In search of the next generation of training sets for language models
Paper • 2406.11794 • Published • 50 -
MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases
Paper • 2402.14905 • Published • 126 -
On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
Paper • 2306.13649 • Published • 17 -
Qwen/Qwen2.5-Coder-7B-Instruct
Text Generation • Updated • 108k • 380