text
Only 14 languages have DPO preference style datasets on the Hugging Face Hub (
Only 14 languages have DPO preference style datasets on the Hugging Face Hub (
link
https://huggingface.co/spaces/DIBT/preference_data_by_language
https://huggingface.co/spaces/DIBT/preference_data_by_language
text
) Let's improve that! How?
) Let's improve that! How?
new_line
new_line
text
The Cohere For AI Aya dataset 
The Cohere For AI Aya dataset 
resource
https://huggingface.co/datasets/CohereForAI/aya_dataset
dataset
CohereForAI/aya_dataset
https://huggingface.co/datasets/CohereForAI/aya_dataset
text
 has human-annotated prompt-completion pairs in 71 languages. We can use this to create DPO datasets for more languages!
 has human-annotated prompt-completion pairs in 71 languages. We can use this to create DPO datasets for more languages!
new_line
new_line
text
Using Aya's prompt/response pairs as a starting point we can use an LLM to generate an additional response to each prompt. We then use an LLM Judge to rank each response.
Using Aya's prompt/response pairs as a starting point we can use an LLM to generate an additional response to each prompt. We then use an LLM Judge to rank each response.
new_line
new_line
text
✅ In some/many languages, human responses may be better than LLM ones but we may want to check that assumption for some languages. 
✅ In some/many languages, human responses may be better than LLM ones but we may want to check that assumption for some languages. 
new_line
text
🚀 We use Argilla's distilabel library to push data to Argilla for validation. This also allows us to determine if an LLM judge is effective for different languages.
🚀 We use Argilla's distilabel library to push data to Argilla for validation. This also allows us to determine if an LLM judge is effective for different languages.
new_line
new_line
text
As an example of what this pipeline produces:
As an example of what this pipeline produces:
new_line
text
- 
- 
link
https://huggingface.co/datasets/DIBT/aya_dutch_dpo
https://huggingface.co/datasets/DIBT/aya_dutch_dpo
text
 a DPO style dataset for Dutch using Llama 3 as a generator/judge LM.
 a DPO style dataset for Dutch using Llama 3 as a generator/judge LM.
new_line
text
- An annotation Space that anyone with a HF account can contribute to: 
- An annotation Space that anyone with a HF account can contribute to: 
link
https://dibt-demo-argilla-space.hf.space/dataset/924ef8a8-a447-4563-8806-0e2a668a5314/annotation-mode?page=1&status=pending
https://dibt-demo-argilla-space.hf.space/dataset/924ef8a8-a447-4563-8806-0e2a668a5314/annotation-mode?page=1&status=pending
new_line
new_line
text
As part of Data is Better Together we want to build more DPO datasets. Join us here: 
As part of Data is Better Together we want to build more DPO datasets. Join us here: 
link
https://github.com/huggingface/data-is-better-together#4-dpoorpo-datasets-for-more-languages
https://github.com/huggingface/data-is-better-together#4-dpoorpo-datasets-for-more-languages
text
 🤗
 🤗
Only 14 languages have DPO preference style datasets on the Hugging Face Hub (https://huggingface.co/spaces/DIBT/preference_data_by_language) Let's improve that! How?

The Cohere For AI Aya dataset https://huggingface.co/datasets/CohereForAI/aya_dataset has human-annotated prompt-completion pairs in 71 languages. We can use this to create DPO datasets for more languages!

Using Aya's prompt/response pairs as a starting point we can use an LLM to generate an additional response to each prompt. We then use an LLM Judge to rank each response.

✅ In some/many languages, human responses may be better than LLM ones but we may want to check that assumption for some languages. 
🚀 We use Argilla's distilabel library to push data to Argilla for validation. This also allows us to determine if an LLM judge is effective for different languages.

As an example of what this pipeline produces:
- https://huggingface.co/datasets/DIBT/aya_dutch_dpo a DPO style dataset for Dutch using Llama 3 as a generator/judge LM.
- An annotation Space that anyone with a HF account can contribute to: https://dibt-demo-argilla-space.hf.space/dataset/924ef8a8-a447-4563-8806-0e2a668a5314/annotation-mode?page=1&status=pending

As part of Data is Better Together we want to build more DPO datasets. Join us here: https://github.com/huggingface/data-is-better-together#4-dpoorpo-datasets-for-more-languages 🤗
❤️
librarian-bot fdaudens ShahabVFX comarproject anakin87
🔥
ZennyKenny celsowm