Small Decoder-only model < 1B parameters
Are there any decoder-only llama, mistral, gemma or otherwise that has < 1B parameters?Any recommendations, esp. ones that are good at multilingual tasks?
2024-09-13T22:31:14Z
Also asked onReddit
2024-09-13T22:44:14Z
From the open leaderboard, there’s a few that have relatively low MMLU-PRO scores but interestingly, any model < 1B params didn’t beat theflan-t5-largemodel.image1920×792 89.6 KB