Setting up Custom LLM Leaderboard for other languages
Dear All,I work at a NFPO organization which dedicates itself to developing tools and models for the community, with a focus on the Hebrew language. Hebrew is a low resource language that isn’t well represented in most language models, as well as in any of the regular measures on the leaderboard.We have curated internally a set of three datasets to measure the performance of causal language models in Hebrew.We would like to set up a shared LLM leaderboard with these measures in order to encourage the development of LLMs with Hebrew support. Unfortunately, we don’t have the funds to finance the GPU cost of allowing anyone to submit their models to be evaluated.Are there anygrants available which would enable us to set up this leaderboard for the community?Thank you in advance!