text
📣 DPO Dutch model release + datasets 
📣 DPO Dutch model release + datasets 
new_line
new_line
text
After teasing for a while, I am finally releasing **GEITje 7B Ultra**, building upon the great GEITje 7B by 
After teasing for a while, I am finally releasing **GEITje 7B Ultra**, building upon the great GEITje 7B by 
mention
@Rijgersberg
Rijgersberg
text
. New contributions include: large new datasets for SFT (instruction/chat), two datasets for DPO training (i.e. RLAIF), and an SFT and DPO version of GEITje. The READMEs describe everything well (I hope), and I'll also share more info on social medias tomorrow.  
. New contributions include: large new datasets for SFT (instruction/chat), two datasets for DPO training (i.e. RLAIF), and an SFT and DPO version of GEITje. The READMEs describe everything well (I hope), and I'll also share more info on social medias tomorrow.  
new_line
new_line
text
For me this is a huge release, the datasets more so than the models. I'm especially pleased with UltraChat, which I created with the intent of having a diverse dataset - the model must be able to communicate with different types of users. So the user questions are created as if they were written by different personas, e.g. language learners, young children, experts, critics, etc. The focus with this is "building a good communication bot that is accessible and can handle different kinds of user input".
For me this is a huge release, the datasets more so than the models. I'm especially pleased with UltraChat, which I created with the intent of having a diverse dataset - the model must be able to communicate with different types of users. So the user questions are created as if they were written by different personas, e.g. language learners, young children, experts, critics, etc. The focus with this is "building a good communication bot that is accessible and can handle different kinds of user input".
new_line
new_line
text
I wish I could find the time to also write a paper to get some "academic recognition" but that'll have to wait for now. I just want to bring it to the public so that others can play with it and use it to build new, cool stuff!
I wish I could find the time to also write a paper to get some "academic recognition" but that'll have to wait for now. I just want to bring it to the public so that others can play with it and use it to build new, cool stuff!
new_line
new_line
text
I hope that you can all appreciate the work. Let's build some cool stuff with it!
I hope that you can all appreciate the work. Let's build some cool stuff with it!
new_line
new_line
text
Models:
Models:
new_line
text
- Demo: 
- Demo: 
link
https://huggingface.co/spaces/BramVanroy/GEITje-7B-ultra
https://huggingface.co/spaces/BramVanroy/GEITje-7B-ultra
new_line
text
- DPO Model: 
- DPO Model: 
resource
https://huggingface.co/BramVanroy/GEITje-7B-ultra
model
BramVanroy/GEITje-7B-ultra
https://huggingface.co/BramVanroy/GEITje-7B-ultra
new_line
text
- SFT model (not recommended): 
- SFT model (not recommended): 
resource
https://huggingface.co/BramVanroy/GEITje-7B-ultra-sft
model
BramVanroy/GEITje-7B-ultra-sft
https://huggingface.co/BramVanroy/GEITje-7B-ultra-sft
new_line
new_line
text
Datasets with GPT-4 turbo completions:
Datasets with GPT-4 turbo completions:
new_line
text
  - No robots (~10k instructions): 
  - No robots (~10k instructions): 
resource
https://huggingface.co/datasets/BramVanroy/no_robots_dutch
dataset
BramVanroy/no_robots_dutch
https://huggingface.co/datasets/BramVanroy/no_robots_dutch
new_line
text
  - UltraChat (~200k instructions): 
  - UltraChat (~200k instructions): 
resource
https://huggingface.co/datasets/BramVanroy/ultrachat_200k_dutch
dataset
BramVanroy/ultrachat_200k_dutch
https://huggingface.co/datasets/BramVanroy/ultrachat_200k_dutch
new_line
text
  - UltraFeedback (DPO with GPT4+GEITje chat, ~50k): 
  - UltraFeedback (DPO with GPT4+GEITje chat, ~50k): 
resource
https://huggingface.co/datasets/BramVanroy/ultra_feedback_dutch
dataset
BramVanroy/ultra_feedback_dutch
https://huggingface.co/datasets/BramVanroy/ultra_feedback_dutch
new_line
text
  - Orca DPO Pairs  (DPO with GPT4+GEITje chat, ~10k): 
  - Orca DPO Pairs  (DPO with GPT4+GEITje chat, ~10k): 
resource
https://huggingface.co/datasets/BramVanroy/orca_dpo_pairs_dutch
dataset
BramVanroy/orca_dpo_pairs_dutch
https://huggingface.co/datasets/BramVanroy/orca_dpo_pairs_dutch
📣 DPO Dutch model release + datasets 

After teasing for a while, I am finally releasing **GEITje 7B Ultra**, building upon the great GEITje 7B by @Rijgersberg. New contributions include: large new datasets for SFT (instruction/chat), two datasets for DPO training (i.e. RLAIF), and an SFT and DPO version of GEITje. The READMEs describe everything well (I hope), and I'll also share more info on social medias tomorrow.  

For me this is a huge release, the datasets more so than the models. I'm especially pleased with UltraChat, which I created with the intent of having a diverse dataset - the model must be able to communicate with different types of users. So the user questions are created as if they were written by different personas, e.g. language learners, young children, experts, critics, etc. The focus with this is "building a good communication bot that is accessible and can handle different kinds of user input".

I wish I could find the time to also write a paper to get some "academic recognition" but that'll have to wait for now. I just want to bring it to the public so that others can play with it and use it to build new, cool stuff!

I hope that you can all appreciate the work. Let's build some cool stuff with it!

Models:
- Demo: https://huggingface.co/spaces/BramVanroy/GEITje-7B-ultra
- DPO Model: https://huggingface.co/BramVanroy/GEITje-7B-ultra
- SFT model (not recommended): https://huggingface.co/BramVanroy/GEITje-7B-ultra-sft

Datasets with GPT-4 turbo completions:
  - No robots (~10k instructions): https://huggingface.co/datasets/BramVanroy/no_robots_dutch
  - UltraChat (~200k instructions): https://huggingface.co/datasets/BramVanroy/ultrachat_200k_dutch
  - UltraFeedback (DPO with GPT4+GEITje chat, ~50k): https://huggingface.co/datasets/BramVanroy/ultra_feedback_dutch
  - Orca DPO Pairs  (DPO with GPT4+GEITje chat, ~10k): https://huggingface.co/datasets/BramVanroy/orca_dpo_pairs_dutch
❤️
samusenps osanseviero dragonkue beomi p208p2002 gsarti s3nh taufiqdp victor Stopwolf Robbert jvdgoltz seostar clem cast42 jvh ajrogier
🤝
samusenps osanseviero gsarti HuggyMonkey
https://cdn-avatars.huggingface.co/v1/production/uploads/6319b164bc8f3b313f7a1db0/Hh0kuwsAnD2AOKdL6PpRs.png
Edwin Rijgersberg
Rijgersberg
user
https://cdn-avatars.huggingface.co/v1/production/uploads/61caeda441f9432649f03ab6/0UdRCrzIqhedZblgfpMBk.png
s3nh
s3nh
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1670231290373-5e7749883d77a72421292d07.jpeg
Gabriele Sarti
gsarti
user