text
𝗔𝗿𝗰𝗲𝗲 𝗿𝗲𝗹𝗲𝗮𝘀𝗲𝘀 𝗦𝘂𝗽𝗲𝗿𝗡𝗼𝘃𝗮, 𝗯𝗲𝘁𝘁𝗲𝗿 𝗳𝗶𝗻𝗲-𝘁𝘂𝗻𝗲 𝗼𝗳 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟭-𝟳𝟬𝗕!
𝗔𝗿𝗰𝗲𝗲 𝗿𝗲𝗹𝗲𝗮𝘀𝗲𝘀 𝗦𝘂𝗽𝗲𝗿𝗡𝗼𝘃𝗮, 𝗯𝗲𝘁𝘁𝗲𝗿 𝗳𝗶𝗻𝗲-𝘁𝘂𝗻𝗲 𝗼𝗳 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟭-𝟳𝟬𝗕!
new_line
new_line
text
2️⃣ versions: 70B and 8B 
2️⃣ versions: 70B and 8B 
new_line
text
🧠 Trained by distilling logits from Llama-3.1-405B
🧠 Trained by distilling logits from Llama-3.1-405B
new_line
text
🐥 Used a clever compression method to reduce dataset weight from 2.9 Petabytes down to 50GB (may share it in a paper)
🐥 Used a clever compression method to reduce dataset weight from 2.9 Petabytes down to 50GB (may share it in a paper)
new_line
text
⚙️ Not all benchmarks are improved: GPQA and MUSR go down a slight bit
⚙️ Not all benchmarks are improved: GPQA and MUSR go down a slight bit
new_line
text
🤗 8B weights are available on HF (not the 70B)
🤗 8B weights are available on HF (not the 70B)
new_line
new_line
text
Read their blog post 👉 
Read their blog post 👉 
link
https://blog.arcee.ai/arcee-supernova-training-pipeline-and-model-composition/
https://blog.arcee.ai/arcee-supernova-training-pipeline-and-model-composition/
new_line
text
Model weights (8B) 👉 
Model weights (8B) 👉 
resource
https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite
model
arcee-ai/Llama-3.1-SuperNova-Lite
https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite
𝗔𝗿𝗰𝗲𝗲 𝗿𝗲𝗹𝗲𝗮𝘀𝗲𝘀 𝗦𝘂𝗽𝗲𝗿𝗡𝗼𝘃𝗮, 𝗯𝗲𝘁𝘁𝗲𝗿 𝗳𝗶𝗻𝗲-𝘁𝘂𝗻𝗲 𝗼𝗳 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟭-𝟳𝟬𝗕!

2️⃣ versions: 70B and 8B 
🧠 Trained by distilling logits from Llama-3.1-405B
🐥 Used a clever compression method to reduce dataset weight from 2.9 Petabytes down to 50GB (may share it in a paper)
⚙️ Not all benchmarks are improved: GPQA and MUSR go down a slight bit
🤗 8B weights are available on HF (not the 70B)

Read their blog post 👉 https://blog.arcee.ai/arcee-supernova-training-pipeline-and-model-composition/
Model weights (8B) 👉 https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite
🔥
osanseviero cfahlgren1 calmodovar23 ucsahin John6666 DiamanteAmarelo mayurninama
🚀
DiamanteAmarelo den0620
🤯
DiamanteAmarelo win10
👍
mayurninama