text
New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯
New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯
new_line
new_line
text
TL;DR
TL;DR
new_line
text
🧮 132B MoE with 16 experts with 4 active in generation
🧮 132B MoE with 16 experts with 4 active in generation
new_line
text
🪟 32 000 context window
🪟 32 000 context window
new_line
text
📈 Outperforms open LLMs on common benchmarks, including MMLU
📈 Outperforms open LLMs on common benchmarks, including MMLU
new_line
text
🚀 Up to 2x faster inference than Llama 2 70B
🚀 Up to 2x faster inference than Llama 2 70B
new_line
text
💻 Trained on 12T tokens
💻 Trained on 12T tokens
new_line
text
🔡 Uses the GPT-4 tokenizer
🔡 Uses the GPT-4 tokenizer
new_line
text
📜 Custom License, commercially useable
📜 Custom License, commercially useable
new_line
new_line
text
Collection: 
Collection: 
resource
https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
collection
databricks/dbrx-6601c0852a0cdd3c59f71962
https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
new_line
text
Demo: 
Demo: 
resource
https://huggingface.co/spaces/databricks/dbrx-instruct
space
databricks/dbrx-instruct
https://huggingface.co/spaces/databricks/dbrx-instruct
new_line
new_line
text
Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗
Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗
new_line
New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯

TL;DR
🧮 132B MoE with 16 experts with 4 active in generation
🪟 32 000 context window
📈 Outperforms open LLMs on common benchmarks, including MMLU
🚀 Up to 2x faster inference than Llama 2 70B
💻 Trained on 12T tokens
🔡 Uses the GPT-4 tokenizer
📜 Custom License, commercially useable

Collection: https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
Demo: https://huggingface.co/spaces/databricks/dbrx-instruct

Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗

🔥
victor alielfilali01 Shinku osanseviero samusenps giux78 Tom-Neverwinter mmhamdy sepal giulianobr carlos-eduardo eppie2 VictorSanh dalraf lunarflu thomwolf clem KvrParaskevi dagelf flymonk
❤️
clem Tom-Neverwinter mmhamdy eppie2 dalraf lunarflu mohammedbriman matthewgjohnson
👍
liminalism
/avatars/afbc48df2e8c47c35be48168113d83c0.svg
s
Tom-Neverwinter
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1624629516652-5ff5d596f244529b3ec0fb89.png
Philipp Schmid
philschmid
user
/avatars/6529947b6d0274f137c091849a34f3f5.svg
Mohit Khanna
mohitkhannanu
user