text
Rhymes AI drops Aria: small Multimodal MoE that beats GPT-4o and Gemini-1.5-Flash ⚡️
Rhymes AI drops Aria: small Multimodal MoE that beats GPT-4o and Gemini-1.5-Flash ⚡️
new_line
new_line
text
New player entered the game! Rhymes AI has just been announced, and unveiled Aria – a multimodal powerhouse that's punching above its weight.
New player entered the game! Rhymes AI has just been announced, and unveiled Aria – a multimodal powerhouse that's punching above its weight.
new_line
new_line
text
Key insights:
Key insights:
new_line
new_line
text
🧠 Mixture-of-Experts architecture: 25.3B total params, but only 3.9B active.
🧠 Mixture-of-Experts architecture: 25.3B total params, but only 3.9B active.
new_line
new_line
text
🌈 Multimodal: text/image/video → text.
🌈 Multimodal: text/image/video → text.
new_line
new_line
text
📚 Novel training approach: “multimodal-native” where multimodal training starts directly during pre-training, not just tacked on later
📚 Novel training approach: “multimodal-native” where multimodal training starts directly during pre-training, not just tacked on later
new_line
new_line
text
📏 Long 64K token context window
📏 Long 64K token context window
new_line
new_line
text
🔓 Apache 2.0 license, with weights, code, and demos all open
🔓 Apache 2.0 license, with weights, code, and demos all open
new_line
new_line
text
⚡️ On the benchmark side, Aria leaves some big names in the dust.
⚡️ On the benchmark side, Aria leaves some big names in the dust.
new_line
new_line
text
- It beats Pixtral 12B or Llama-3.2-12B on several vision benchmarks like MMMU or MathVista.
- It beats Pixtral 12B or Llama-3.2-12B on several vision benchmarks like MMMU or MathVista.
new_line
text
- It even overcomes the much bigger GPT-4o on long video tasks and even outshines Gemini 1.5 Flash when it comes to parsing lengthy documents.
- It even overcomes the much bigger GPT-4o on long video tasks and even outshines Gemini 1.5 Flash when it comes to parsing lengthy documents.
new_line
new_line
text
But Rhymes AI isn't just showing off benchmarks. They've already got Aria powering a real-world augmented search app called “Beago”. It’s handling even recent events with great accuracy!
But Rhymes AI isn't just showing off benchmarks. They've already got Aria powering a real-world augmented search app called “Beago”. It’s handling even recent events with great accuracy!
new_line
new_line
text
And they partnered with AMD to make it much faster than competitors like Perplexity or Gemini search.
And they partnered with AMD to make it much faster than competitors like Perplexity or Gemini search.
new_line
new_line
text
Read their paper for Aria 👉 
Read their paper for Aria 👉 
resource
https://huggingface.co/papers/2410.05993
paper
2410.05993
https://huggingface.co/papers/2410.05993
Aria: An Open Multimodal Native Mixture-of-Experts Model (2410.05993)
new_line
new_line
text
Try BeaGo 🐶 👉 
Try BeaGo 🐶 👉 
link
https://rhymes.ai/blog-details/introducing-beago-your-smarter-faster-ai-search
https://rhymes.ai/blog-details/introducing-beago-your-smarter-faster-ai-search
Rhymes AI drops Aria: small Multimodal MoE that beats GPT-4o and Gemini-1.5-Flash ⚡️

New player entered the game! Rhymes AI has just been announced, and unveiled Aria – a multimodal powerhouse that's punching above its weight.

Key insights:

🧠 Mixture-of-Experts architecture: 25.3B total params, but only 3.9B active.

🌈 Multimodal: text/image/video → text.

📚 Novel training approach: “multimodal-native” where multimodal training starts directly during pre-training, not just tacked on later

📏 Long 64K token context window

🔓 Apache 2.0 license, with weights, code, and demos all open

⚡️ On the benchmark side, Aria leaves some big names in the dust.

- It beats Pixtral 12B or Llama-3.2-12B on several vision benchmarks like MMMU or MathVista.
- It even overcomes the much bigger GPT-4o on long video tasks and even outshines Gemini 1.5 Flash when it comes to parsing lengthy documents.

But Rhymes AI isn't just showing off benchmarks. They've already got Aria powering a real-world augmented search app called “Beago”. It’s handling even recent events with great accuracy!

And they partnered with AMD to make it much faster than competitors like Perplexity or Gemini search.

Read their paper for Aria 👉 https://huggingface.co/papers/2410.05993

Try BeaGo 🐶 👉 https://rhymes.ai/blog-details/introducing-beago-your-smarter-faster-ai-search
🔥
YaTharThShaRma999 dlflannery jordivcb reach-vb iojvsuynv KingNish victor dishank002 IMFDEtienne nina-summer teowu
👀
John6666 DataSoul reach-vb C0casio45 iojvsuynv victor v000000 louisbrulenaudet
🤝
nina-summer
/avatars/4b3f3b8fe4ab980cbfaab52afe52dfc9.svg
Aleks
aleksfinn23
user