text
🎉 Celebrating One Year of #SauerkrautLM with Two Groundbreaking Releases! 
🎉 Celebrating One Year of #SauerkrautLM with Two Groundbreaking Releases! 
new_line
new_line
text
We're thrilled to announce the release of SauerkrautLM-v2-14b in two specialized versions: 
We're thrilled to announce the release of SauerkrautLM-v2-14b in two specialized versions: 
resource
https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT
model
VAGOsolutions/SauerkrautLM-v2-14b-SFT
https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT
text
 and 
 and 
resource
https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-DPO
model
VAGOsolutions/SauerkrautLM-v2-14b-DPO
https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-DPO
text
. Built on the robust Qwen2.5-14B foundation, these models represent a significant leap forward in multilingual AI capabilities.
. Built on the robust Qwen2.5-14B foundation, these models represent a significant leap forward in multilingual AI capabilities.
new_line
new_line
text
🔬 Technical Breakthroughs:
🔬 Technical Breakthroughs:
new_line
text
💠 Innovative three-phase Fine-Tuning approach
💠 Innovative three-phase Fine-Tuning approach
new_line
text
💠 Two-step Spectrum SFT + one-step Spectrum DPO optimization phase for enhanced performance
💠 Two-step Spectrum SFT + one-step Spectrum DPO optimization phase for enhanced performance
new_line
text
💠 Balance of German and English language capabilities
💠 Balance of German and English language capabilities
new_line
text
💠 Advanced function calling - almost on par with Claude-3.5-Sonnet-20240620
💠 Advanced function calling - almost on par with Claude-3.5-Sonnet-20240620
new_line
new_line
text
🇩🇪 German Language Excellence:
🇩🇪 German Language Excellence:
new_line
text
What sets this release apart is our unique achievement in simultaneously improving both German and English capabilities. Through our specialized training approach with over 1.2B tokens across two phases, we've managed to:
What sets this release apart is our unique achievement in simultaneously improving both German and English capabilities. Through our specialized training approach with over 1.2B tokens across two phases, we've managed to:
new_line
text
💠 Enhance German language understanding and generation (SFT Version > DPO Version)
💠 Enhance German language understanding and generation (SFT Version > DPO Version)
new_line
text
💠 Maintain authentic German linguistic nuances
💠 Maintain authentic German linguistic nuances
new_line
text
💠 Improve cross-lingual capabilities
💠 Improve cross-lingual capabilities
new_line
text
💠 Preserve cultural context awareness
💠 Preserve cultural context awareness
new_line
new_line
text
📊 Training Innovation:
📊 Training Innovation:
new_line
text
Our three-phase approach targeted specific layer percentages (15%, 20% and 25%) with carefully curated datasets, including:
Our three-phase approach targeted specific layer percentages (15%, 20% and 25%) with carefully curated datasets, including:
new_line
text
💠 Mathematics-focused content (proprietary classifier-selected)
💠 Mathematics-focused content (proprietary classifier-selected)
new_line
text
💠 High-quality German training data
💠 High-quality German training data
new_line
text
💠 Specialized function calling datasets
💠 Specialized function calling datasets
new_line
text
💠 Premium multilingual content
💠 Premium multilingual content
new_line
new_line
text
🎁 Community Contribution:
🎁 Community Contribution:
new_line
text
We're also releasing two new datasets in a few days: 
We're also releasing two new datasets in a few days: 
new_line
text
1️⃣ SauerkrautLM-Fermented-GER-DPO: 3,300 high-quality German training samples
1️⃣ SauerkrautLM-Fermented-GER-DPO: 3,300 high-quality German training samples
new_line
text
2️⃣ SauerkrautLM-Fermented-Irrelevance-GER-DPO: 2,000 specialized samples for optimized function call  irrelevance handling
2️⃣ SauerkrautLM-Fermented-Irrelevance-GER-DPO: 2,000 specialized samples for optimized function call  irrelevance handling
new_line
new_line
text
Thank you to our incredible community and partners who have supported us throughout this journey. Here's to another year of AI innovation! 🚀
Thank you to our incredible community and partners who have supported us throughout this journey. Here's to another year of AI innovation! 🚀
🎉 Celebrating One Year of #SauerkrautLM with Two Groundbreaking Releases! 

We're thrilled to announce the release of SauerkrautLM-v2-14b in two specialized versions: https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT and https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-DPO. Built on the robust Qwen2.5-14B foundation, these models represent a significant leap forward in multilingual AI capabilities.

🔬 Technical Breakthroughs:
💠 Innovative three-phase Fine-Tuning approach
💠 Two-step Spectrum SFT + one-step Spectrum DPO optimization phase for enhanced performance
💠 Balance of German and English language capabilities
💠 Advanced function calling - almost on par with Claude-3.5-Sonnet-20240620

🇩🇪 German Language Excellence:
What sets this release apart is our unique achievement in simultaneously improving both German and English capabilities. Through our specialized training approach with over 1.2B tokens across two phases, we've managed to:
💠 Enhance German language understanding and generation (SFT Version > DPO Version)
💠 Maintain authentic German linguistic nuances
💠 Improve cross-lingual capabilities
💠 Preserve cultural context awareness

📊 Training Innovation:
Our three-phase approach targeted specific layer percentages (15%, 20% and 25%) with carefully curated datasets, including:
💠 Mathematics-focused content (proprietary classifier-selected)
💠 High-quality German training data
💠 Specialized function calling datasets
💠 Premium multilingual content

🎁 Community Contribution:
We're also releasing two new datasets in a few days: 
1️⃣ SauerkrautLM-Fermented-GER-DPO: 3,300 high-quality German training samples
2️⃣ SauerkrautLM-Fermented-Irrelevance-GER-DPO: 2,000 specialized samples for optimized function call  irrelevance handling

Thank you to our incredible community and partners who have supported us throughout this journey. Here's to another year of AI innovation! 🚀
🔥
rizky-gumelar ZeroXClem John6666 foscraft djuna not-lain
👍
flozi00 Jason233