text
We 
We 
link
https://mii-llm.ai
https://mii-llm.ai
text
 just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA
 just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA
new_line
new_line
text
Thanks to 
Thanks to 
mention
@efederici
efederici
text
 who released 
 who released 
resource
https://huggingface.co/datasets/efederici/MMLU-Pro-ita
dataset
efederici/MMLU-Pro-ita
https://huggingface.co/datasets/efederici/MMLU-Pro-ita
text
 a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of 
 a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of 
link
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
text
 the results on Italian open source LLMs. 
 the results on Italian open source LLMs. 
new_line
new_line
text
If you want to deepen read the blog article on hf 
If you want to deepen read the blog article on hf 
link
https://huggingface.co/blog/giux78/mmlu-pro-ita
https://huggingface.co/blog/giux78/mmlu-pro-ita
text
We https://mii-llm.ai just released a new LLM Italian benchmark and a set of evaluation: MMLU-PRO-ITA

Thanks to @efederici who released https://huggingface.co/datasets/efederici/MMLU-Pro-ita a machine translated version of MMLU-PRO and thanks to a community shared computational effort we published  in the "Eval Aggiuntive" tab of https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard the results on Italian open source LLMs. 

If you want to deepen read the blog article on hf https://huggingface.co/blog/giux78/mmlu-pro-ita 
🚀
giux78 Ramikan-BR osanseviero
❤️
Ramikan-BR anakin87
🔥
Ramikan-BR
👀
Ramikan-BR
😔
ZeroWw