mention
@FinancialSupport
FinancialSupport
text
 and I  just released a new version of the Italian LLMs leaderboard 
 and I  just released a new version of the Italian LLMs leaderboard 
link
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
text
new_line
text
  using the super useful  
  using the super useful  
link
https://huggingface.co/demo-leaderboard
https://huggingface.co/demo-leaderboard
text
 template from 
 template from 
mention
@clefourrier
clefourrier
text
. 
. 
new_line
text
We’ve evaluated over 50 models (base, merged, fine-tuned, etc.) from:
We’ve evaluated over 50 models (base, merged, fine-tuned, etc.) from:
new_line
text
- Major companies like Meta, Mistral, Google ... 
- Major companies like Meta, Mistral, Google ... 
new_line
text
- University groups such as  
- University groups such as  
link
https://huggingface.co/sapienzanlp
https://huggingface.co/sapienzanlp
text
 or 
 or 
link
https://huggingface.co/swap-uniba
https://huggingface.co/swap-uniba
new_line
text
- Italian Companies like  
- Italian Companies like  
link
https://huggingface.co/MoxoffSpA
https://huggingface.co/MoxoffSpA
text
 , 
 , 
link
https://huggingface.co/FairMind
https://huggingface.co/FairMind
text
  or 
  or 
link
https://huggingface.co/raicrits
https://huggingface.co/raicrits
text
new_line
text
- Various communities and individuals 
- Various communities and individuals 
new_line
text
All models were tested on #Italian benchmarks #mmlu #arc-c #hellaswag, which we contributed to the opensource lm-evaluation-harness library from 
All models were tested on #Italian benchmarks #mmlu #arc-c #hellaswag, which we contributed to the opensource lm-evaluation-harness library from 
link
https://huggingface.co/EleutherAI
https://huggingface.co/EleutherAI
text
. 
. 
new_line
text
Plus, you can now submit your model for automatic evaluation, thanks to  to  
Plus, you can now submit your model for automatic evaluation, thanks to  to  
link
https://huggingface.co/seeweb
https://huggingface.co/seeweb
text
  sponsored computation.
  sponsored computation.
new_line
text
Curious about the top Italian models? Check out the leaderboard and submit your model!
Curious about the top Italian models? Check out the leaderboard and submit your model!
new_line
new_line
link
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
new_line
new_line
@FinancialSupport and I  just released a new version of the Italian LLMs leaderboard https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard 
  using the super useful  https://huggingface.co/demo-leaderboard template from @clefourrier. 
We’ve evaluated over 50 models (base, merged, fine-tuned, etc.) from:
- Major companies like Meta, Mistral, Google ... 
- University groups such as  https://huggingface.co/sapienzanlp or https://huggingface.co/swap-uniba
- Italian Companies like  https://huggingface.co/MoxoffSpA , https://huggingface.co/FairMind  or https://huggingface.co/raicrits 
- Various communities and individuals 
All models were tested on #Italian benchmarks #mmlu #arc-c #hellaswag, which we contributed to the opensource lm-evaluation-harness library from https://huggingface.co/EleutherAI. 
Plus, you can now submit your model for automatic evaluation, thanks to  to  https://huggingface.co/seeweb  sponsored computation.
Curious about the top Italian models? Check out the leaderboard and submit your model!

https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard


❤️
PereLluis13 clefourrier dillfrescott giux78 DeepMount00
🚀
victor giux78
/avatars/744eddaa7dfc34a57df9ce32a78059a0.svg
Tyrone Pierce
piercyy
user