Spaces:
Running
on
CPU Upgrade
Update leaderboard so can support newer models? (Can't submit newer Qwen2.5, gemma, phi models)
Any plans to update the leaderboard, so that it can support (detect) newer derivative models types such as qwen2, gemma2, & gemma, phi ?
the error message is Model {model name}was not found on the hub!
thx!
examples:
MaziyarPanahi/Qwen2-72B-Instruct-v0.1
pankajmathur/orca_mini_v7_72b
migtissera/Tess-v2.5.2-Qwen2-72B
dfurman/Qwen2-72B-Orpo-v0.1
cognitivecomputations/dolphin-2.9.2-qwen2-72b
cognitivecomputations/dolphin-2.9.2-qwen2-7b
Alibaba-NLP/gte-Qwen2-7B-instruct
Weyaxi/Einstein-v7-Qwen2-7B
BAAI/Infinity-Instruct-3M-0625-Qwen2-7B
macadeliccc/Samantha-Qwen-2-7B
openchat/openchat-3.5-0106-gemma
beomi/gemma-mling-7b
SakanaAI/DiscoPOP-zephyr-7b-gemma
TheDrummer/Big-Tiger-Gemma-27B-v1
TheDrummer/Tiger-Gemma-9B-v1
the error message is Model "{model name}" was not found on hub!
would bumping up the version of transformers in https://huggingface.co/spaces/BAAI/open_cn_llm_leaderboard/blob/main/requirements.txt help?
see https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/859/files
here are some leaderboards that somehow supported those models , what could be updated, what is missing or out-of-date?
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
Open-Arabic-LLM-Leaderboard
open_pt_llm_leaderboard
open-ko-llm-leaderboard