text
🔥 New LLM leaderboard blog: Open Ko LLM!
🔥 New LLM leaderboard blog: Open Ko LLM!
new_line
new_line
text
One of the oldest leaderboards on the hub, it has already evaluated more than 1000 models! It uses Korean translations of MMLU, ARC, HellaSwag, TruthfulQA, and a new dataset, Korean CommonGen, about specific common sense alignement. 
One of the oldest leaderboards on the hub, it has already evaluated more than 1000 models! It uses Korean translations of MMLU, ARC, HellaSwag, TruthfulQA, and a new dataset, Korean CommonGen, about specific common sense alignement. 
new_line
new_line
resource
https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard
space
upstage/open-ko-llm-leaderboard
https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard
new_line
new_line
text
What's interesting about this leaderboard is how it drove LLM development in Korea, with on average about 4 submissions/models per day since it started! 
What's interesting about this leaderboard is how it drove LLM development in Korea, with on average about 4 submissions/models per day since it started! 
new_line
text
Really looking forward to seeing similar initiatives in other languages, to help qualitative models emerge outside of "just English" (for the other 2/3rds of the world).
Really looking forward to seeing similar initiatives in other languages, to help qualitative models emerge outside of "just English" (for the other 2/3rds of the world).
new_line
new_line
text
Read more about how the leaderboard in the intro blog: 
Read more about how the leaderboard in the intro blog: 
link
https://huggingface.co/blog/leaderboards-on-the-hub-upstage
https://huggingface.co/blog/leaderboards-on-the-hub-upstage
new_line
text
Congrats to 
Congrats to 
mention
@Chanjun
Chanjun
text
 , 
 , 
mention
@hunkim
hunkim
text
 and the Upstage team!
 and the Upstage team!
🔥 New LLM leaderboard blog: Open Ko LLM!

One of the oldest leaderboards on the hub, it has already evaluated more than 1000 models! It uses Korean translations of MMLU, ARC, HellaSwag, TruthfulQA, and a new dataset, Korean CommonGen, about specific common sense alignement. 

https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard

What's interesting about this leaderboard is how it drove LLM development in Korea, with on average about 4 submissions/models per day since it started! 
Really looking forward to seeing similar initiatives in other languages, to help qualitative models emerge outside of "just English" (for the other 2/3rds of the world).

Read more about how the leaderboard in the intro blog: https://huggingface.co/blog/leaderboards-on-the-hub-upstage
Congrats to @Chanjun , @hunkim and the Upstage team!
❤️
Chanjun kramp KnutJaegersberg clem vladbogo jeffboudier sbrandeis