text
Contamination free code evaluations with LiveCodeBench! 🖥️
Contamination free code evaluations with LiveCodeBench! 🖥️
new_line
new_line
text
LiveCodeBench is a new leaderboard, which contains: 
LiveCodeBench is a new leaderboard, which contains: 
new_line
text
- complete code evaluations (on code generation, self repair, code execution, tests)
- complete code evaluations (on code generation, self repair, code execution, tests)
new_line
text
- my favorite feature: problem selection by publication date 📅
- my favorite feature: problem selection by publication date 📅
new_line
new_line
text
This feature means that you can get model scores averaged only on new problems out of the training data. This means... contamination free code evals! 🚀
This feature means that you can get model scores averaged only on new problems out of the training data. This means... contamination free code evals! 🚀
new_line
new_line
text
Check it out!
Check it out!
new_line
new_line
text
Blog: 
Blog: 
link
https://huggingface.co/blog/leaderboard-livecodebench
https://huggingface.co/blog/leaderboard-livecodebench
new_line
text
Leaderboard: 
Leaderboard: 
resource
https://huggingface.co/spaces/livecodebench/leaderboard
space
livecodebench/leaderboard
https://huggingface.co/spaces/livecodebench/leaderboard
new_line
new_line
text
Congrats to 
Congrats to 
mention
@StringChaos
StringChaos
text
mention
@minimario
minimario
text
mention
@xu3kev
xu3kev
text
mention
@kingh0730
kingh0730
text
 and 
 and 
mention
@FanjiaYan
FanjiaYan
text
 for the super cool leaderboard! 
 for the super cool leaderboard! 
Contamination free code evaluations with LiveCodeBench! 🖥️

LiveCodeBench is a new leaderboard, which contains: 
- complete code evaluations (on code generation, self repair, code execution, tests)
- my favorite feature: problem selection by publication date 📅

This feature means that you can get model scores averaged only on new problems out of the training data. This means... contamination free code evals! 🚀

Check it out!

Blog: https://huggingface.co/blog/leaderboard-livecodebench
Leaderboard: https://huggingface.co/spaces/livecodebench/leaderboard

Congrats to @StringChaos  @minimario  @xu3kev @kingh0730 and @FanjiaYan for the super cool leaderboard! 
🔥
loubnabnl osanseviero BrigitteTousi lunarflu Dlbk clem mathiasn1 kingh0730 thomwolf dillfrescott
❤️
lunarflu Dlbk clem kingh0730 thomwolf dillfrescott