text
Small models, BIG impact: SmolLM is here! 🚀🔬
Small models, BIG impact: SmolLM is here! 🚀🔬
new_line
new_line
text
We're launching a series of small but mighty language models:
We're launching a series of small but mighty language models:
new_line
text
🏎️ Super fast - runs on laptops, phones, you name it!
🏎️ Super fast - runs on laptops, phones, you name it!
new_line
text
📏 3 sizes: 130M, 350M, and 1.5B parameters
📏 3 sizes: 130M, 350M, and 1.5B parameters
new_line
text
🥇 Outperforms same size models from Meta, Microsoft, and Qwen
🥇 Outperforms same size models from Meta, Microsoft, and Qwen
new_line
text
🔓 Fully open-source: datasets, training code, models
🔓 Fully open-source: datasets, training code, models
new_line
new_line
text
𝐊𝐞𝐲 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬
𝐊𝐞𝐲 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬
new_line
text
- Trained on FineWeb-Edu and Cosmopedia v2 (largest synthetic pre-training dataset)
- Trained on FineWeb-Edu and Cosmopedia v2 (largest synthetic pre-training dataset)
new_line
text
- No cloud needed - run locally for privacy and energy efficiency
- No cloud needed - run locally for privacy and energy efficiency
new_line
text
- Everything is public, from data curation to training steps
- Everything is public, from data curation to training steps
new_line
new_line
text
𝐏𝐨𝐭𝐞𝐧𝐭𝐢𝐚𝐥 𝐮𝐬𝐞 𝐜𝐚𝐬𝐞𝐬
𝐏𝐨𝐭𝐞𝐧𝐭𝐢𝐚𝐥 𝐮𝐬𝐞 𝐜𝐚𝐬𝐞𝐬
new_line
text
- On-device autocomplete
- On-device autocomplete
new_line
text
- Local request parsing
- Local request parsing
new_line
text
- Custom fine-tuning for specific needs without the need for expensive GPUs
- Custom fine-tuning for specific needs without the need for expensive GPUs
new_line
new_line
text
𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
new_line
text
👉 Check it out: 
👉 Check it out: 
link
https://huggingface.co/collections/HuggingFaceTB/smollm-models-6695016cad7167254ce15966
https://huggingface.co/collections/HuggingFaceTB/smollm-models-6695016cad7167254ce15966
new_line
text
👉 Run the 360M model in your browser, 100 % private: 
👉 Run the 360M model in your browser, 100 % private: 
resource
https://huggingface.co/spaces/HuggingFaceTB/SmolLM-360M-Instruct-WebGPU
space
HuggingFaceTB/SmolLM-360M-Instruct-WebGPU
https://huggingface.co/spaces/HuggingFaceTB/SmolLM-360M-Instruct-WebGPU
new_line
text
👉 Read the blog explaining everything in detail: huggingface.co/blog/smollm
👉 Read the blog explaining everything in detail: huggingface.co/blog/smollm
new_line
new_line
text
Kudos to the stellar team who worked on this project: 
Kudos to the stellar team who worked on this project: 
mention
@loubnabnl
loubnabnl
text
mention
@anton-l
anton-l
text
mention
@eliebak
eliebak
text
mention
@lvwerra
lvwerra
text
Small models, BIG impact: SmolLM is here! 🚀🔬

We're launching a series of small but mighty language models:
🏎️ Super fast - runs on laptops, phones, you name it!
📏 3 sizes: 130M, 350M, and 1.5B parameters
🥇 Outperforms same size models from Meta, Microsoft, and Qwen
🔓 Fully open-source: datasets, training code, models

𝐊𝐞𝐲 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬
- Trained on FineWeb-Edu and Cosmopedia v2 (largest synthetic pre-training dataset)
- No cloud needed - run locally for privacy and energy efficiency
- Everything is public, from data curation to training steps

𝐏𝐨𝐭𝐞𝐧𝐭𝐢𝐚𝐥 𝐮𝐬𝐞 𝐜𝐚𝐬𝐞𝐬
- On-device autocomplete
- Local request parsing
- Custom fine-tuning for specific needs without the need for expensive GPUs

𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
👉 Check it out: https://huggingface.co/collections/HuggingFaceTB/smollm-models-6695016cad7167254ce15966
👉 Run the 360M model in your browser, 100 % private: https://huggingface.co/spaces/HuggingFaceTB/SmolLM-360M-Instruct-WebGPU
👉 Read the blog explaining everything in detail: huggingface.co/blog/smollm

Kudos to the stellar team who worked on this project: @loubnabnl @anton-l @eliebak @lvwerra 
🔥
YaTharThShaRma999 sgarbi sivan22 mdouglas nroggendorff John6666 reach-vb plaguss gabrielmbmb osanseviero jeffboudier AyoubChLin holooo raveninrhythm Ramikan-BR clem yjernite louisbrulenaudet
🤝
surfhb reach-vb osanseviero FaultyEntry ucsahin raveninrhythm Ramikan-BR clem yjernite
🚀
Ramikan-BR clem yjernite
❤️
Ramikan-BR clem yjernite
👀
Ramikan-BR clem
🧠
Ramikan-BR clem