text
Yet another post hailing how good Meta Llama 3.1 is? 🤔 I guess not!
Yet another post hailing how good Meta Llama 3.1 is? 🤔 I guess not!
new_line
new_line
text
While Llama 3.1 is truly impressive, especially 405B (which gives GPT-4o a run for its money! 💪)
While Llama 3.1 is truly impressive, especially 405B (which gives GPT-4o a run for its money! 💪)
new_line
new_line
text
I was surprised to see that on the Open LLM Leaderboard, Llama 3.1 70B was not able to dethrone the current king Qwen2-72B! 👑
I was surprised to see that on the Open LLM Leaderboard, Llama 3.1 70B was not able to dethrone the current king Qwen2-72B! 👑
new_line
new_line
text
Not only that, for a few benchmarks like MATH Lvl 5, it was completely lagging behind Qwen2-72B! 📉
Not only that, for a few benchmarks like MATH Lvl 5, it was completely lagging behind Qwen2-72B! 📉
new_line
new_line
text
Also, the benchmarks are completely off compared to the official numbers from Meta! 🤯
Also, the benchmarks are completely off compared to the official numbers from Meta! 🤯
new_line
new_line
text
Based on the responses, I still believe Llama 3.1 will perform better than Qwen2 on LMSYS Chatbot Arena. 🤖 But it still lags behind on too many benchmarks! 🏃‍♂️
Based on the responses, I still believe Llama 3.1 will perform better than Qwen2 on LMSYS Chatbot Arena. 🤖 But it still lags behind on too many benchmarks! 🏃‍♂️
new_line
new_line
text
Open LLM Leaderboard: 
Open LLM Leaderboard: 
resource
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
space
open-llm-leaderboard/open_llm_leaderboard
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
text
  🌐
  🌐
new_line
new_line
text
Hopefully, this is just an Open LLM Leaderboard error! 
Hopefully, this is just an Open LLM Leaderboard error! 
mention
@open-llm-leaderboard
open-llm-leaderboard
text
 SOS! 🚨
 SOS! 🚨
Yet another post hailing how good Meta Llama 3.1 is? 🤔 I guess not!

While Llama 3.1 is truly impressive, especially 405B (which gives GPT-4o a run for its money! 💪)

I was surprised to see that on the Open LLM Leaderboard, Llama 3.1 70B was not able to dethrone the current king Qwen2-72B! 👑

Not only that, for a few benchmarks like MATH Lvl 5, it was completely lagging behind Qwen2-72B! 📉

Also, the benchmarks are completely off compared to the official numbers from Meta! 🤯

Based on the responses, I still believe Llama 3.1 will perform better than Qwen2 on LMSYS Chatbot Arena. 🤖 But it still lags behind on too many benchmarks! 🏃‍♂️

Open LLM Leaderboard: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard  🌐

Hopefully, this is just an Open LLM Leaderboard error! @open-llm-leaderboard SOS! 🚨
👍
eek osanseviero dillfrescott quyettv d8rt8v
😔
Ruaruaruabick Winnougan
👀
SicariusSicariiStuff
https://cdn-avatars.huggingface.co/v1/production/uploads/662bf5bfe93bb73804ef9344/WXYLnjjJ4SROkoveIi7If.png
Kuldeep Singh Sidhu
singhsidhukuldeep
user
https://cdn-avatars.huggingface.co/v1/production/uploads/65d883893a52cd9bcd8ab7cf/tRsCJlHNZo1D02kBTmfy9.jpeg
leroy Samuel Dyer
LeroyDyer
user
https://cdn-avatars.huggingface.co/v1/production/uploads/64bffde3acf6b898b369355a/htPoH4DFNmbMrlbHgBFpz.png
nlpguy
nlpguy
user
/avatars/d92c459b18a4aa5642e5c4bd3b8e3fe4.svg
Mendonca
Dihelson
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6569216f9c96f1a47bf45788/mCLqmAs4dOjKdxNQVAp1w.png
Sica Rius
SicariusSicariiStuff
user
/avatars/3e9a9c3349e282d72e558febd93d6f12.svg
quyettv
quyettv
user
/avatars/981ae724a0e86c2afbf7fe59d640f39e.svg
none
none344
user