text
Can you merge models of different sizes? ⚗️
Can you merge models of different sizes? ⚗️
new_line
new_line
text
Well, yes, if the models are somewhat compatible. Here is an experiment I did. I wanted to merge two of the best performing models: 
Well, yes, if the models are somewhat compatible. Here is an experiment I did. I wanted to merge two of the best performing models: 
resource
https://huggingface.co/mlabonne/NeuralBeagle14-7B
model
mlabonne/NeuralBeagle14-7B
https://huggingface.co/mlabonne/NeuralBeagle14-7B
text
 and 
 and 
resource
https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v4
model
jeonsworld/CarbonVillain-en-10.7B-v4
https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v4
new_line
new_line
text
Here is my recipe:
Here is my recipe:
new_line
text
1. Expand the layers of NeuralBeagle to 10.7B ala frankenmerge.
1. Expand the layers of NeuralBeagle to 10.7B ala frankenmerge.
new_line
text
2. DPO-tune the previous model with a high-quality preference dataset, 
2. DPO-tune the previous model with a high-quality preference dataset, 
resource
https://huggingface.co/datasets/argilla/distilabel-intel-orca-dpo-pairs
dataset
argilla/distilabel-intel-orca-dpo-pairs
https://huggingface.co/datasets/argilla/distilabel-intel-orca-dpo-pairs
new_line
text
3. Merge the previous model with CarbonVillain (needs —allow-crimes in mergekit! 🔪)
3. Merge the previous model with CarbonVillain (needs —allow-crimes in mergekit! 🔪)
new_line
new_line
text
And here is the resulting model, CarbonBeagle-11B, which ranked top in the leaderboard for its size class:
And here is the resulting model, CarbonBeagle-11B, which ranked top in the leaderboard for its size class:
new_line
resource
https://huggingface.co/vicgalle/CarbonBeagle-11B
model
vicgalle/CarbonBeagle-11B
https://huggingface.co/vicgalle/CarbonBeagle-11B
new_line
Can you merge models of different sizes? ⚗️

Well, yes, if the models are somewhat compatible. Here is an experiment I did. I wanted to merge two of the best performing models: https://huggingface.co/mlabonne/NeuralBeagle14-7B and https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v4

Here is my recipe:
1. Expand the layers of NeuralBeagle to 10.7B ala frankenmerge.
2. DPO-tune the previous model with a high-quality preference dataset, https://huggingface.co/datasets/argilla/distilabel-intel-orca-dpo-pairs
3. Merge the previous model with CarbonVillain (needs —allow-crimes in mergekit! 🔪)

And here is the resulting model, CarbonBeagle-11B, which ranked top in the leaderboard for its size class:
https://huggingface.co/vicgalle/CarbonBeagle-11B

🤝
vicgalle victor samusenps NeuralNovel itsn78 merve Dlbk clem antiven0m lunarflu Svngoku Makya mlabonne tryumanshow
🤯
osanseviero itsn78 merve clem cbensimon lunarflu luqmanxyz vicgalle Makya roinaveiro
https://cdn-avatars.huggingface.co/v1/production/uploads/6536dba326ec79fe53aee18e/eINj0F5JEYYdCZTrjBvu4.png
limin(gate)
gate369
user
https://cdn-avatars.huggingface.co/v1/production/uploads/5fad8602b8423e1d80b8a965/tRqTwcZmrGka8c1vFq2wX.jpeg
Victor Gallego
vicgalle
user