text
Remember when 
Remember when 
mention
@Microsoft
Microsoft
text
  released Phi-3 models... 🤔
  released Phi-3 models... 🤔
new_line
new_line
text
Yup, the ones that had 🦙Llama 3 8B beat on MMLU using 3.8B parameters! 🏆
Yup, the ones that had 🦙Llama 3 8B beat on MMLU using 3.8B parameters! 🏆
new_line
new_line
text
Now they are on the LMSYS Chatbot Arena Leaderboard! 📊📈
Now they are on the LMSYS Chatbot Arena Leaderboard! 📊📈
new_line
new_line
text
Medium(14B) ranks near GPT-3.5-Turbo-0613, but behind Llama 3 8B. 📉
Medium(14B) ranks near GPT-3.5-Turbo-0613, but behind Llama 3 8B. 📉
new_line
new_line
text
Phi-3 Small(7B) is close to Llama-2-70B, and Mistral fine-tunes. 📊
Phi-3 Small(7B) is close to Llama-2-70B, and Mistral fine-tunes. 📊
new_line
new_line
text
What about the Phi-3 Mini(3.8B), that was giving Llama 3 8B a run for its money on MMLU? It gets an arena score of 1037 (#73) against 1153 (#22) of Llama 3 8B 🤼
What about the Phi-3 Mini(3.8B), that was giving Llama 3 8B a run for its money on MMLU? It gets an arena score of 1037 (#73) against 1153 (#22) of Llama 3 8B 🤼
new_line
new_line
text
Looks like there is a struggle here between perplexity and inherent knowledge! 🤔
Looks like there is a struggle here between perplexity and inherent knowledge! 🤔
new_line
new_line
text
And Microsoft picked knowledge with high perplexity 🧠
And Microsoft picked knowledge with high perplexity 🧠
new_line
new_line
text
Now I am even more intrigued: what is 
Now I am even more intrigued: what is 
mention
@Meta
Meta
text
 feeding its 🦙 Llamas?🌾
 feeding its 🦙 Llamas?🌾
new_line
new_line
text
🏆 Leaderboard: 
🏆 Leaderboard: 
link
https://chat.lmsys.org/?leaderboard
https://chat.lmsys.org/?leaderboard
Remember when @Microsoft  released Phi-3 models... 🤔

Yup, the ones that had 🦙Llama 3 8B beat on MMLU using 3.8B parameters! 🏆

Now they are on the LMSYS Chatbot Arena Leaderboard! 📊📈

Medium(14B) ranks near GPT-3.5-Turbo-0613, but behind Llama 3 8B. 📉

Phi-3 Small(7B) is close to Llama-2-70B, and Mistral fine-tunes. 📊

What about the Phi-3 Mini(3.8B), that was giving Llama 3 8B a run for its money on MMLU? It gets an arena score of 1037 (#73) against 1153 (#22) of Llama 3 8B 🤼

Looks like there is a struggle here between perplexity and inherent knowledge! 🤔

And Microsoft picked knowledge with high perplexity 🧠

Now I am even more intrigued: what is @Meta feeding its 🦙 Llamas?🌾

🏆 Leaderboard: https://chat.lmsys.org/?leaderboard
🚀
lunarflu