text
Excited to introduce Jamba by AI21
Excited to introduce Jamba by AI21
new_line
resource
https://huggingface.co/ai21labs/Jamba-v0.1
model
ai21labs/Jamba-v0.1
https://huggingface.co/ai21labs/Jamba-v0.1
new_line
new_line
text
We are thrilled to announce Jamba, the world’s first production-grade Mamba based model. 
We are thrilled to announce Jamba, the world’s first production-grade Mamba based model. 
new_line
new_line
text
Key Features: 
Key Features: 
new_line
text
- First production-grade Mamba based model built on a novel SSM-Transformer hybrid architecture
- First production-grade Mamba based model built on a novel SSM-Transformer hybrid architecture
new_line
text
- 3X throughput on long contexts compared to Mixtral 8x7B
- 3X throughput on long contexts compared to Mixtral 8x7B
new_line
text
- Democratizes access to a massive 256K context window
- Democratizes access to a massive 256K context window
new_line
text
- The only model in its size class that fits up to 140K context on a single GPU 
- The only model in its size class that fits up to 140K context on a single GPU 
new_line
new_line
text
Jamba is based on a novel architecture that combines Mamba and Transformer. While our initial results show great efficiency gains, we expect this to be further explored and improved with the help of the community.
Jamba is based on a novel architecture that combines Mamba and Transformer. While our initial results show great efficiency gains, we expect this to be further explored and improved with the help of the community.
new_line
new_line
text
Check out our blog post for more info: 
Check out our blog post for more info: 
link
https://ai21-labs.webflow.io/blog/announcing-jamba
https://ai21-labs.webflow.io/blog/announcing-jamba
new_line
Excited to introduce Jamba by AI21
https://huggingface.co/ai21labs/Jamba-v0.1

We are thrilled to announce Jamba, the world’s first production-grade Mamba based model. 

Key Features: 
- First production-grade Mamba based model built on a novel SSM-Transformer hybrid architecture
- 3X throughput on long contexts compared to Mixtral 8x7B
- Democratizes access to a massive 256K context window
- The only model in its size class that fits up to 140K context on a single GPU 

Jamba is based on a novel architecture that combines Mamba and Transformer. While our initial results show great efficiency gains, we expect this to be further explored and improved with the help of the community.

Check out our blog post for more info: https://ai21-labs.webflow.io/blog/announcing-jamba

🔥
osanseviero nikgr taufiqdp samusenps ajibawa-2023 Srulikbdd theKibster victor VictorSanh reach-vb apollomarv Asaf-Yehudai MaziyarPanahi DataSoul callmeraxz tatakof
🚀
osanseviero samusenps aswathitsme Srulikbdd reach-vb MaziyarPanahi
😎
osanseviero sadafwalliyani reach-vb wenbopan
👍
sadafwalliyani shiv2050 wenbopan DataSoul
🤯
osanseviero reach-vb
❤️
samusenps reach-vb
🤝
shiv2050
➕
wenbopan
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user
https://cdn-avatars.huggingface.co/v1/production/uploads/62cd5057674cdb524450093d/f67rlrdsKPRTLdXCXoa_X.jpeg
Mayank Mishra
mayank-mishra
user