text
Please... feed this Llama some Sauerkraut! 🍲 
Please... feed this Llama some Sauerkraut! 🍲 
new_line
new_line
text
Said and done. Here it is. Our Sauerkraut Version of the strong Llama3-8b by Meta. Released from HANNOVER MESSE, just in front of meta booth.
Said and done. Here it is. Our Sauerkraut Version of the strong Llama3-8b by Meta. Released from HANNOVER MESSE, just in front of meta booth.
new_line
resource
https://huggingface.co/VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
model
VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
https://huggingface.co/VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
new_line
new_line
text
According to benchmarks (LM-Evaluation-Harness 0.4.2), our #SauerkrautLM Dataset and fine-tuning pipeline improved the Model noticeably (AVG = 74,57), especially Reasoning and Common Sense capabilities.
According to benchmarks (LM-Evaluation-Harness 0.4.2), our #SauerkrautLM Dataset and fine-tuning pipeline improved the Model noticeably (AVG = 74,57), especially Reasoning and Common Sense capabilities.
new_line
new_line
text
Again we provide some more detail on the whole process:
Again we provide some more detail on the whole process:
new_line
text
✅ Original model: Llama-3-8b-Instruct
✅ Original model: Llama-3-8b-Instruct
new_line
text
✅ Training Duration: 12 hours
✅ Training Duration: 12 hours
new_line
text
✅ Training procedure: 2-staged DPO
✅ Training procedure: 2-staged DPO
new_line
text
✅ Trained data: 70k (first stage) and 20k (second stage)
✅ Trained data: 70k (first stage) and 20k (second stage)
new_line
text
✅ GPU: 4x RTX6000 ADA
✅ GPU: 4x RTX6000 ADA
new_line
text
✅ New model: Llama-3-SauerkrautLM-8b-Instruct
✅ New model: Llama-3-SauerkrautLM-8b-Instruct
new_line
text
✅ Total training costs: 54,72 Dollar 💴 - RunPod FTW (excluding synthesizing data, curating data, benchmarks, error handling, testing)
✅ Total training costs: 54,72 Dollar 💴 - RunPod FTW (excluding synthesizing data, curating data, benchmarks, error handling, testing)
new_line
new_line
text
See our model card on Hugging Face for more details: 
See our model card on Hugging Face for more details: 
resource
https://huggingface.co/VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
model
VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
https://huggingface.co/VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
new_line
new_line
text
There will be more details on benchmarks during the next days. 
There will be more details on benchmarks during the next days. 
Please... feed this Llama some Sauerkraut! 🍲 

Said and done. Here it is. Our Sauerkraut Version of the strong Llama3-8b by Meta. Released from HANNOVER MESSE, just in front of meta booth.
https://huggingface.co/VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct

According to benchmarks (LM-Evaluation-Harness 0.4.2), our #SauerkrautLM Dataset and fine-tuning pipeline improved the Model noticeably (AVG = 74,57), especially Reasoning and Common Sense capabilities.

Again we provide some more detail on the whole process:
✅ Original model: Llama-3-8b-Instruct
✅ Training Duration: 12 hours
✅ Training procedure: 2-staged DPO
✅ Trained data: 70k (first stage) and 20k (second stage)
✅ GPU: 4x RTX6000 ADA
✅ New model: Llama-3-SauerkrautLM-8b-Instruct
✅ Total training costs: 54,72 Dollar 💴 - RunPod FTW (excluding synthesizing data, curating data, benchmarks, error handling, testing)

See our model card on Hugging Face for more details: https://huggingface.co/VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct

There will be more details on benchmarks during the next days. 
👍
Xorg2024 clem DaryoushV quyettv fynnkroeger jdjayakaran2410