text
When 
When 
mention
@MistralAI
MistralAI
text
 drops a blog post labelled "Large Enough," it's going to get serious! 🚀💡
 drops a blog post labelled "Large Enough," it's going to get serious! 🚀💡
new_line
new_line
text
- Mistral-Large-Instruct-2407, just call it Mistral-Large2, is a 123B parameters Instruct model with 128k context 🌍📚
- Mistral-Large-Instruct-2407, just call it Mistral-Large2, is a 123B parameters Instruct model with 128k context 🌍📚
new_line
new_line
text
- Multilingual in 11 languages; English 🇬🇧, French 🇫🇷, German 🇩🇪, Spanish 🇪🇸, Italian 🇮🇹, Chinese 🇨🇳, Japanese 🇯🇵, Korean 🇰🇷, Portuguese 🇵🇹, Dutch 🇳🇱, and Polish 🇵🇱. 🗣️🗺️
- Multilingual in 11 languages; English 🇬🇧, French 🇫🇷, German 🇩🇪, Spanish 🇪🇸, Italian 🇮🇹, Chinese 🇨🇳, Japanese 🇯🇵, Korean 🇰🇷, Portuguese 🇵🇹, Dutch 🇳🇱, and Polish 🇵🇱. 🗣️🗺️
new_line
new_line
text
- Also highly focused on programming, trained on 80+ coding languages such as Python, Java, C, C++, Javascript, bash 💻🔧
- Also highly focused on programming, trained on 80+ coding languages such as Python, Java, C, C++, Javascript, bash 💻🔧
new_line
new_line
text
- Supports native function calling and structured output. 🛠️📊
- Supports native function calling and structured output. 🛠️📊
new_line
new_line
text
- Released under Mistral Research License (Non-Commercial License, Research only😔) 
- Released under Mistral Research License (Non-Commercial License, Research only😔) 
new_line
new_line
text
- Open weights only🔓, no data or code released 🔒📁
- Open weights only🔓, no data or code released 🔒📁
new_line
new_line
text
Definitely firing shots at 
Definitely firing shots at 
mention
@Meta
Meta
text
 Llama3.1: 🎯🔥
 Llama3.1: 🎯🔥
new_line
text
MMLU - 84.0% (ML2) vs 79.3% (L3.1-70B) vs 85.2% (L3.1-405B)
MMLU - 84.0% (ML2) vs 79.3% (L3.1-70B) vs 85.2% (L3.1-405B)
new_line
text
GSM8K - 93% (ML2) vs 95.5% (L3.1-70B-Ins) vs 96.8% (L3.1-405B-Ins)
GSM8K - 93% (ML2) vs 95.5% (L3.1-70B-Ins) vs 96.8% (L3.1-405B-Ins)
new_line
new_line
text
Also, it's kinda chunky! 📦💪
Also, it's kinda chunky! 📦💪
new_line
text
fp16/ bf16 - ~250GB VRAM
fp16/ bf16 - ~250GB VRAM
new_line
text
fp8/ int8 - ~125GB VRAM
fp8/ int8 - ~125GB VRAM
new_line
text
int4 - ~60GB VRAM
int4 - ~60GB VRAM
new_line
new_line
text
I tried quantising it to AWQ and GPTQ, but couldn't with 30GB V-RAM. ❌🖥️
I tried quantising it to AWQ and GPTQ, but couldn't with 30GB V-RAM. ❌🖥️
new_line
new_line
text
Also calling out AWQ and GPTQ on not supporting multi-GPU quantisation! 🖥️⚡
Also calling out AWQ and GPTQ on not supporting multi-GPU quantisation! 🖥️⚡
new_line
new_line
text
God sent 
God sent 
mention
@casperhansen
casperhansen
text
 has posted AWQ quantised INT4 model (68.68 GB) with the perplexity of 2.889: 
 has posted AWQ quantised INT4 model (68.68 GB) with the perplexity of 2.889: 
resource
https://huggingface.co/casperhansen/mistral-large-instruct-2407-awq
model
casperhansen/mistral-large-instruct-2407-awq
https://huggingface.co/casperhansen/mistral-large-instruct-2407-awq
text
 🔥👏
 🔥👏
new_line
new_line
text
Looks like open AI is going to beat OpenAI! 🏆🤖
Looks like open AI is going to beat OpenAI! 🏆🤖
new_line
new_line
text
Blog post: 
Blog post: 
link
https://mistral.ai/news/mistral-large-2407/
https://mistral.ai/news/mistral-large-2407/
new_line
new_line
text
Models: 
Models: 
resource
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
model
mistralai/Mistral-Large-Instruct-2407
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
When @MistralAI drops a blog post labelled "Large Enough," it's going to get serious! 🚀💡

- Mistral-Large-Instruct-2407, just call it Mistral-Large2, is a 123B parameters Instruct model with 128k context 🌍📚

- Multilingual in 11 languages; English 🇬🇧, French 🇫🇷, German 🇩🇪, Spanish 🇪🇸, Italian 🇮🇹, Chinese 🇨🇳, Japanese 🇯🇵, Korean 🇰🇷, Portuguese 🇵🇹, Dutch 🇳🇱, and Polish 🇵🇱. 🗣️🗺️

- Also highly focused on programming, trained on 80+ coding languages such as Python, Java, C, C++, Javascript, bash 💻🔧

- Supports native function calling and structured output. 🛠️📊

- Released under Mistral Research License (Non-Commercial License, Research only😔) 

- Open weights only🔓, no data or code released 🔒📁

Definitely firing shots at @Meta Llama3.1: 🎯🔥
MMLU - 84.0% (ML2) vs 79.3% (L3.1-70B) vs 85.2% (L3.1-405B)
GSM8K - 93% (ML2) vs 95.5% (L3.1-70B-Ins) vs 96.8% (L3.1-405B-Ins)

Also, it's kinda chunky! 📦💪
fp16/ bf16 - ~250GB VRAM
fp8/ int8 - ~125GB VRAM
int4 - ~60GB VRAM

I tried quantising it to AWQ and GPTQ, but couldn't with 30GB V-RAM. ❌🖥️

Also calling out AWQ and GPTQ on not supporting multi-GPU quantisation! 🖥️⚡

God sent @casperhansen has posted AWQ quantised INT4 model (68.68 GB) with the perplexity of 2.889: https://huggingface.co/casperhansen/mistral-large-instruct-2407-awq 🔥👏

Looks like open AI is going to beat OpenAI! 🏆🤖

Blog post: https://mistral.ai/news/mistral-large-2407/

Models: https://huggingface.co/mistralai/Mistral-Large-Instruct-2407