text
When was the last time you looked for a non-English LLM, only to be saddened there is NO good option? 😟
When was the last time you looked for a non-English LLM, only to be saddened there is NO good option? 😟
new_line
new_line
text
For instance, 
For instance, 
mention
@Meta
Meta
text
 's poster child Llama 3 has less than 5% non-English tokens! 🌍
 's poster child Llama 3 has less than 5% non-English tokens! 🌍
new_line
new_line
mention
@cohere
cohere
text
 is here to change that... and change they will. 💪
 is here to change that... and change they will. 💪
new_line
new_line
text
Introducing Aya (this time the name actually makes sense) 🌟
Introducing Aya (this time the name actually makes sense) 🌟
new_line
new_line
text
Aya is an open-weight (CC-BY-NC) model, that comes in 3 flavours:
Aya is an open-weight (CC-BY-NC) model, that comes in 3 flavours:
new_line
new_line
text
1️⃣ Aya 101: 13B parameters, mT5-xxl based model that supports 101 languages 🌐
1️⃣ Aya 101: 13B parameters, mT5-xxl based model that supports 101 languages 🌐
new_line
new_line
text
2️⃣ Aya 23: 8B and  3️⃣35B parameter models, supports 23 languages 📊
2️⃣ Aya 23: 8B and  3️⃣35B parameter models, supports 23 languages 📊
new_line
new_line
text
23 languages covered are: Arabic 🇸🇦, Chinese (simplified & traditional) 🇨🇳, Czech 🇨🇿, Dutch 🇳🇱, English 🇬🇧, French 🇫🇷, German 🇩🇪, Greek 🇬🇷, Hebrew 🇮🇱, Hindi 🇮🇳, Indonesian 🇮🇩, Italian 🇮🇹, Japanese 🇯🇵, Korean 🇰🇷, Persian 🇮🇷, Polish 🇵🇱, Portuguese 🇵🇹, Romanian 🇷🇴, Russian 🇷🇺, Spanish 🇪🇸, Turkish 🇹🇷, Ukrainian 🇺🇦, and Vietnamese 🇻🇳.
23 languages covered are: Arabic 🇸🇦, Chinese (simplified & traditional) 🇨🇳, Czech 🇨🇿, Dutch 🇳🇱, English 🇬🇧, French 🇫🇷, German 🇩🇪, Greek 🇬🇷, Hebrew 🇮🇱, Hindi 🇮🇳, Indonesian 🇮🇩, Italian 🇮🇹, Japanese 🇯🇵, Korean 🇰🇷, Persian 🇮🇷, Polish 🇵🇱, Portuguese 🇵🇹, Romanian 🇷🇴, Russian 🇷🇺, Spanish 🇪🇸, Turkish 🇹🇷, Ukrainian 🇺🇦, and Vietnamese 🇻🇳.
new_line
new_line
text
Not only models, they have open-sourced the dataset: Aya Collection stands as the most extensive assembly of multilingual instruction fine-tuning datasets to date, featuring 513 million prompts and completions across 114 languages. 📚
Not only models, they have open-sourced the dataset: Aya Collection stands as the most extensive assembly of multilingual instruction fine-tuning datasets to date, featuring 513 million prompts and completions across 114 languages. 📚
new_line
new_line
text
These annotations were provided by people across the globe. Not gonna lie, I almost shed a tear reading this... 😢
These annotations were provided by people across the globe. Not gonna lie, I almost shed a tear reading this... 😢
new_line
new_line
text
From Cohere: The word Aya is derived from the Twi language meaning “fern” - a symbol of endurance and resourcefulness. Aya embodies our dedication to advancing multilingual AI. 🌿
From Cohere: The word Aya is derived from the Twi language meaning “fern” - a symbol of endurance and resourcefulness. Aya embodies our dedication to advancing multilingual AI. 🌿
new_line
new_line
text
Looks like the good folks at Cohere did not sleep after the success of command r & command r plus! 😴➡️🚀
Looks like the good folks at Cohere did not sleep after the success of command r & command r plus! 😴➡️🚀
new_line
new_line
text
Models: Aya-101-13B: 
Models: Aya-101-13B: 
resource
https://huggingface.co/CohereForAI/aya-101
model
CohereForAI/aya-101
https://huggingface.co/CohereForAI/aya-101
new_line
text
Aya-23-8B: 
Aya-23-8B: 
resource
https://huggingface.co/CohereForAI/aya-23-8B
model
CohereForAI/aya-23-8B
https://huggingface.co/CohereForAI/aya-23-8B
new_line
text
Aya-23-35B: 
Aya-23-35B: 
resource
https://huggingface.co/CohereForAI/aya-23-35B
model
CohereForAI/aya-23-35B
https://huggingface.co/CohereForAI/aya-23-35B
new_line
new_line
text
Dataset: 
Dataset: 
resource
https://huggingface.co/collections/CohereForAI/aya-datasets-660415741bd4852f01c81c77
collection
CohereForAI/aya-datasets-660415741bd4852f01c81c77
https://huggingface.co/collections/CohereForAI/aya-datasets-660415741bd4852f01c81c77
new_line
new_line
text
Blog: 
Blog: 
link
https://cohere.com/research/aya
https://cohere.com/research/aya
When was the last time you looked for a non-English LLM, only to be saddened there is NO good option? 😟

For instance, @Meta 's poster child Llama 3 has less than 5% non-English tokens! 🌍

@cohere is here to change that... and change they will. 💪

Introducing Aya (this time the name actually makes sense) 🌟

Aya is an open-weight (CC-BY-NC) model, that comes in 3 flavours:

1️⃣ Aya 101: 13B parameters, mT5-xxl based model that supports 101 languages 🌐

2️⃣ Aya 23: 8B and  3️⃣35B parameter models, supports 23 languages 📊

23 languages covered are: Arabic 🇸🇦, Chinese (simplified & traditional) 🇨🇳, Czech 🇨🇿, Dutch 🇳🇱, English 🇬🇧, French 🇫🇷, German 🇩🇪, Greek 🇬🇷, Hebrew 🇮🇱, Hindi 🇮🇳, Indonesian 🇮🇩, Italian 🇮🇹, Japanese 🇯🇵, Korean 🇰🇷, Persian 🇮🇷, Polish 🇵🇱, Portuguese 🇵🇹, Romanian 🇷🇴, Russian 🇷🇺, Spanish 🇪🇸, Turkish 🇹🇷, Ukrainian 🇺🇦, and Vietnamese 🇻🇳.

Not only models, they have open-sourced the dataset: Aya Collection stands as the most extensive assembly of multilingual instruction fine-tuning datasets to date, featuring 513 million prompts and completions across 114 languages. 📚

These annotations were provided by people across the globe. Not gonna lie, I almost shed a tear reading this... 😢

From Cohere: The word Aya is derived from the Twi language meaning “fern” - a symbol of endurance and resourcefulness. Aya embodies our dedication to advancing multilingual AI. 🌿

Looks like the good folks at Cohere did not sleep after the success of command r & command r plus! 😴➡️🚀

Models: Aya-101-13B: https://huggingface.co/CohereForAI/aya-101
Aya-23-8B: https://huggingface.co/CohereForAI/aya-23-8B
Aya-23-35B: https://huggingface.co/CohereForAI/aya-23-35B

Dataset: https://huggingface.co/collections/CohereForAI/aya-datasets-660415741bd4852f01c81c77

Blog: https://cohere.com/research/aya
🚀
liamrickson31 GPT007 MexIvanov