text
🔥 Less is more for DPO, high quality matters!
🔥 Less is more for DPO, high quality matters!
new_line
new_line
text
📢 Dropping our first open dataset and LLM of the year:
📢 Dropping our first open dataset and LLM of the year:
new_line
new_line
text
💾Meet distilabel Orca Pairs DPO, an improved version of the now famous dataset from Intel:
💾Meet distilabel Orca Pairs DPO, an improved version of the now famous dataset from Intel:
new_line
new_line
resource
https://huggingface.co/datasets/argilla/distilabel-intel-orca-dpo-pairs
dataset
argilla/distilabel-intel-orca-dpo-pairs
https://huggingface.co/datasets/argilla/distilabel-intel-orca-dpo-pairs
new_line
text
new_line
new_line
text
🏛️ And a new OpenHermes fine-tune outperforming baselines with 54% less DPO pairs:
🏛️ And a new OpenHermes fine-tune outperforming baselines with 54% less DPO pairs:
new_line
new_line
link
https://huggingface.co/argilla/distilabeled-Hermes-2.5-Mistral-7B
https://huggingface.co/argilla/distilabeled-Hermes-2.5-Mistral-7B
new_line
new_line
text
You can use this new dataset for your DPO tuning, just like this:
You can use this new dataset for your DPO tuning, just like this:
new_line
new_line
new_line
code_fence
```
from datasets import load_dataset

# Instead of this:
# dataset = load_dataset("Intel/orca_dpo_pairs", split="train")

# use this:
dataset = load_dataset("argilla/distilabel-intel-orca-dpo-pairs", split="train")

dataset = dataset.filter(
    lambda r: 
        r["status"] != "tie" and 
        r["chosen_score"] >= 8 and 
        not r["in_gsm8k_train"]
)
```
from datasets import load_dataset

# Instead of this:
# dataset = load_dataset("Intel/orca_dpo_pairs", split="train")

# use this:
dataset = load_dataset("argilla/distilabel-intel-orca-dpo-pairs", split="train")

dataset = dataset.filter(
    lambda r: 
        r["status"] != "tie" and 
        r["chosen_score"] >= 8 and 
        not r["in_gsm8k_train"]
)
new_line
text
This will reduce the size of the original by 54% while giving you better quality preferences!
This will reduce the size of the original by 54% while giving you better quality preferences!
new_line
new_line
text
What should we build next?
What should we build next?
new_line
new_line
new_line
new_line
🔥 Less is more for DPO, high quality matters!

📢 Dropping our first open dataset and LLM of the year:

💾Meet distilabel Orca Pairs DPO, an improved version of the now famous dataset from Intel:

https://huggingface.co/datasets/argilla/distilabel-intel-orca-dpo-pairs
 

🏛️ And a new OpenHermes fine-tune outperforming baselines with 54% less DPO pairs:

https://huggingface.co/argilla/distilabeled-Hermes-2.5-Mistral-7B

You can use this new dataset for your DPO tuning, just like this:


```
from datasets import load_dataset

# Instead of this:
# dataset = load_dataset("Intel/orca_dpo_pairs", split="train")

# use this:
dataset = load_dataset("argilla/distilabel-intel-orca-dpo-pairs", split="train")

dataset = dataset.filter(
    lambda r: 
        r["status"] != "tie" and 
        r["chosen_score"] >= 8 and 
        not r["in_gsm8k_train"]
)
```
This will reduce the size of the original by 54% while giving you better quality preferences!

What should we build next?




❤️
davanstrien osanseviero merve radames tomaarsen mlabonne alielfilali01 clem linoyts KnutJaegersberg Forbu14 lysandre d0rj mammour VictorSanh gblazex sethuiyer eliebak sbrandeis
🤯
davanstrien osanseviero merve radames tomaarsen BramVanroy clem KnutJaegersberg lixin67
👍
hushell
/avatars/41a31c90d737660e8293cb8be98c4d18.svg
Blaze
gblazex
user
https://cdn-avatars.huggingface.co/v1/production/uploads/60420dccc15e823a685f2b03/Dn7QTyy9SZ7jKN6xpufVD.png
Daniel Vila
dvilasuero
user