text
Hey everyone!
Hey everyone!
new_line
new_line
text
Our team just dropped something cool! 🎉 We've published a new paper on arxiv diving into the foundation model leaderboards across different platforms. We've analyzed the content, operational workflows, and common issues of these leaderboards. From this, we came up with two new concepts: Leaderboard Operations (LBOps) and leaderboard smells.
Our team just dropped something cool! 🎉 We've published a new paper on arxiv diving into the foundation model leaderboards across different platforms. We've analyzed the content, operational workflows, and common issues of these leaderboards. From this, we came up with two new concepts: Leaderboard Operations (LBOps) and leaderboard smells.
new_line
new_line
text
We also put together an awesome list with nearly 300 of the latest leaderboards, development tools, and publishing organizations. You can check it out here: 
We also put together an awesome list with nearly 300 of the latest leaderboards, development tools, and publishing organizations. You can check it out here: 
link
https://github.com/SAILResearch/awesome-foundation-model-leaderboards
https://github.com/SAILResearch/awesome-foundation-model-leaderboards
new_line
new_line
text
If you find it useful or interesting, give us a follow or drop a comment. We'd love to hear your thoughts and get your support! ✨
If you find it useful or interesting, give us a follow or drop a comment. We'd love to hear your thoughts and get your support! ✨
new_line
new_line
text
Link to the paper: 
Link to the paper: 
link
https://arxiv.org/abs/2407.04065
https://arxiv.org/abs/2407.04065
Hey everyone!

Our team just dropped something cool! 🎉 We've published a new paper on arxiv diving into the foundation model leaderboards across different platforms. We've analyzed the content, operational workflows, and common issues of these leaderboards. From this, we came up with two new concepts: Leaderboard Operations (LBOps) and leaderboard smells.

We also put together an awesome list with nearly 300 of the latest leaderboards, development tools, and publishing organizations. You can check it out here: https://github.com/SAILResearch/awesome-foundation-model-leaderboards

If you find it useful or interesting, give us a follow or drop a comment. We'd love to hear your thoughts and get your support! ✨

Link to the paper: https://arxiv.org/abs/2407.04065
👀
zhiminy osanseviero louisbrulenaudet Tonic