Post
1784
Discover all the improvements in the new version of Lighteval: https://huggingface.co/docs/lighteval/
Demo leaderboard with an integrated backend
AI & ML interests
None defined yet.
Recent Activity
View all activity
demo-leaderboard-backend's activity
albertvillanova
posted
an
update
12 days ago
Fix wrong instructions and code for custom tasks
#21 opened about 1 month ago
by
albertvillanova
albertvillanova
updated
a
Space
about 1 month ago
Fix HFValidationError caused by wrong repo_id
2
#15 opened about 1 month ago
by
albertvillanova
Fix UnboundLocalError: local variable 'results' referenced before assignment
6
#16 opened about 1 month ago
by
albertvillanova
Fix UnboundLocalError: local variable 'results' referenced before assignment
6
#16 opened about 1 month ago
by
albertvillanova
Fix HFValidationError caused by wrong repo_id
2
#15 opened about 1 month ago
by
albertvillanova
Remove unused no_cache parameter
#20 opened about 1 month ago
by
albertvillanova
Fix different results filenames locally and in the Hub
#19 opened about 1 month ago
by
albertvillanova
Do not pass custom_tasks by default
#18 opened about 1 month ago
by
albertvillanova
Fix ModuleNotFoundError in custom_tasks
#17 opened about 1 month ago
by
albertvillanova
Remove unused no_cache parameter
#20 opened about 1 month ago
by
albertvillanova
Fix different results filenames locally and in the Hub
#19 opened about 1 month ago
by
albertvillanova
Do not pass custom_tasks by default
#18 opened about 1 month ago
by
albertvillanova
Fix ModuleNotFoundError in custom_tasks
#17 opened about 1 month ago
by
albertvillanova
Fix InferenceEndpoint name with / from model_id
#14 opened about 1 month ago
by
albertvillanova
Remove duplicate EvalRequest.model_type
#13 opened about 2 months ago
by
albertvillanova
Fix style
4
#12 opened about 2 months ago
by
albertvillanova
clefourrier
authored
a
paper
about 1 month ago
albertvillanova
posted
an
update
2 months ago
Post
1582
🚨 How green is your model? 🌱 Introducing a new feature in the Comparator tool: Environmental Impact for responsible #LLM research!
👉 open-llm-leaderboard/comparator
Now, you can not only compare models by performance, but also by their environmental footprint!
🌍 The Comparator calculates CO₂ emissions during evaluation and shows key model characteristics: evaluation score, number of parameters, architecture, precision, type... 🛠️
Make informed decisions about your model's impact on the planet and join the movement towards greener AI!
👉 open-llm-leaderboard/comparator
Now, you can not only compare models by performance, but also by their environmental footprint!
🌍 The Comparator calculates CO₂ emissions during evaluation and shows key model characteristics: evaluation score, number of parameters, architecture, precision, type... 🛠️
Make informed decisions about your model's impact on the planet and join the movement towards greener AI!