text
🔥 New LLM leaderboard on the hub: an Enterprise Scenarios Leaderboard!
🔥 New LLM leaderboard on the hub: an Enterprise Scenarios Leaderboard!
new_line
new_line
text
This work evaluates LLMs on several real world use cases (Finance documents, Legal confidentiality, Customer support, ...), which makes it grounded, and interesting  for companies! 🏢
This work evaluates LLMs on several real world use cases (Finance documents, Legal confidentiality, Customer support, ...), which makes it grounded, and interesting  for companies! 🏢
new_line
text
Bonus: the test set is private, so it's hard to game 🔥
Bonus: the test set is private, so it's hard to game 🔥
new_line
resource
https://huggingface.co/spaces/PatronusAI/enterprise_scenarios_leaderboard
space
PatronusAI/enterprise_scenarios_leaderboard
https://huggingface.co/spaces/PatronusAI/enterprise_scenarios_leaderboard
new_line
new_line
text
Side note: I discovered through this benchmark that you could evaluate "Engagingness" of an LLM, which could also be interesting for our LLM fine-tuning community out there.
Side note: I discovered through this benchmark that you could evaluate "Engagingness" of an LLM, which could also be interesting for our LLM fine-tuning community out there.
new_line
new_line
text
Read more about their different tasks and metrics in the intro blog: 
Read more about their different tasks and metrics in the intro blog: 
link
https://huggingface.co/blog/leaderboards-on-the-hub-patronus
https://huggingface.co/blog/leaderboards-on-the-hub-patronus
new_line
new_line
text
Congrats to 
Congrats to 
mention
@sunitha98
sunitha98
text
 who led the leaderboard implementation, and to 
 who led the leaderboard implementation, and to 
mention
@rebeccaqian
rebeccaqian
text
 and 
 and 
mention
@anandnk24
anandnk24
text
, all at Patronus AI !
, all at Patronus AI !
🔥 New LLM leaderboard on the hub: an Enterprise Scenarios Leaderboard!

This work evaluates LLMs on several real world use cases (Finance documents, Legal confidentiality, Customer support, ...), which makes it grounded, and interesting  for companies! 🏢
Bonus: the test set is private, so it's hard to game 🔥
https://huggingface.co/spaces/PatronusAI/enterprise_scenarios_leaderboard

Side note: I discovered through this benchmark that you could evaluate "Engagingness" of an LLM, which could also be interesting for our LLM fine-tuning community out there.

Read more about their different tasks and metrics in the intro blog: https://huggingface.co/blog/leaderboards-on-the-hub-patronus

Congrats to @sunitha98 who led the leaderboard implementation, and to @rebeccaqian and @anandnk24, all at Patronus AI !
❤️
osanseviero RebeccaQian1 clem marcsun13 samusenps Pelmeshek alielfilali01 anandnk24 gblazex
https://cdn-avatars.huggingface.co/v1/production/uploads/1583857146757-5e67bdd61009063689407479.jpeg
Clem 🤗
clem
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1644340617257-noauth.png
Clémentine Fourrier
clefourrier
user