text
🌳 Model Family Tree
🌳 Model Family Tree
new_line
new_line
text
Merging models has become a powerful way to compress information and build powerful models for cheap. Right now, the process is still quite experimental: which models to merge? which parameters should I use? We have some intuition but no principled approach.
Merging models has become a powerful way to compress information and build powerful models for cheap. Right now, the process is still quite experimental: which models to merge? which parameters should I use? We have some intuition but no principled approach.
new_line
new_line
text
I made a little tool to make things a little clearer. It allows you to visualize the family tree of any model on the Hub. It also displays the type of license they use: permissive (green), noncommercial (red), and unknown (gray). It should help people select the right license based on the parent models.
I made a little tool to make things a little clearer. It allows you to visualize the family tree of any model on the Hub. It also displays the type of license they use: permissive (green), noncommercial (red), and unknown (gray). It should help people select the right license based on the parent models.
new_line
new_line
text
In addition, I hope it can be refined to extract more information about these models: do models from very different branches work better when merged? Can we select them based on the weight difference? There are a lot of questions to explore in this new space. :)
In addition, I hope it can be refined to extract more information about these models: do models from very different branches work better when merged? Can we select them based on the weight difference? There are a lot of questions to explore in this new space. :)
new_line
new_line
text
Here's a link to the colab notebook I made: 
Here's a link to the colab notebook I made: 
link
https://colab.research.google.com/drive/1s2eQlolcI1VGgDhqWIANfkfKvcKrMyNr
https://colab.research.google.com/drive/1s2eQlolcI1VGgDhqWIANfkfKvcKrMyNr
new_line
text
If you want to know more about model merging or build you own merges, here's the article I wrote about this topic: 
If you want to know more about model merging or build you own merges, here's the article I wrote about this topic: 
link
https://huggingface.co/blog/mlabonne/merge-models
https://huggingface.co/blog/mlabonne/merge-models
🌳 Model Family Tree

Merging models has become a powerful way to compress information and build powerful models for cheap. Right now, the process is still quite experimental: which models to merge? which parameters should I use? We have some intuition but no principled approach.

I made a little tool to make things a little clearer. It allows you to visualize the family tree of any model on the Hub. It also displays the type of license they use: permissive (green), noncommercial (red), and unknown (gray). It should help people select the right license based on the parent models.

In addition, I hope it can be refined to extract more information about these models: do models from very different branches work better when merged? Can we select them based on the weight difference? There are a lot of questions to explore in this new space. :)

Here's a link to the colab notebook I made: https://colab.research.google.com/drive/1s2eQlolcI1VGgDhqWIANfkfKvcKrMyNr
If you want to know more about model merging or build you own merges, here's the article I wrote about this topic: https://huggingface.co/blog/mlabonne/merge-models
❤️
afrideva MaziyarPanahi Jofthomas samusenps flemmingmiguel osanseviero vince62s ucalyptus victor mrfakename luqmanxyz Tradingstrategycourses marcel FiditeNemini Dlbk clem netapy Isotonic satyamt merve dvilasuero Epiculous lunarflu CultriX antiven0m rvpierre mishig Locutusque Citaman Humus macadeliccc ivanfioravanti julien-c acertainbru sugatoray ezzaldeen ahmedelsayed
👍
Dlbk osanseviero mrfakename FiditeNemini clem merve PrimeD Epiculous lunarflu rvpierre Q-bert julien-c kgourgou wsuff nbeerbower
🤝
hbzhangvt samusenps osanseviero clem Isotonic merve HuggyMonkey Epiculous lunarflu rvpierre
https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/gZXHW5dd9R86AV9LMZ--y.png
Maziyar Panahi
MaziyarPanahi
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/w6hr-DEQot4VVkoyRIBiy.png
Omar Sanseviero
osanseviero
user
https://cdn-avatars.huggingface.co/v1/production/uploads/62e54f0eae9d3f10acb95cb9/VAyk05hqB3OZWXEZW-B0q.png
mrfakename
mrfakename
user
https://cdn-avatars.huggingface.co/v1/production/uploads/64adfd277b5ff762771e4571/HVmAmGOtBPYd72492XGar.png
Epiculous
Epiculous
user
/avatars/245ec3b183919c079f8c5023b3f7ca9f.svg
CultriX
CultriX
user
https://cdn-avatars.huggingface.co/v1/production/uploads/63a7422854f1d0225b075bfc/XGYAcDPZG5ZEsNBWG6guw.jpeg
lhl
leonardlin
user
https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/JtUGAwVh_4cDEsjNcfpye.png
Maxime Labonne
mlabonne
user