transformers safetensors t5 text2text-generation hu en license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
language:
- hu
- en
---
This is a smaller version of the [google/mt5-large](https://huggingface.co/google/mt5-large) model with only Hungarian and some English embeddings left.

After shrinking the sentencepiece vocabulary from 250K to 50K (top 10K English and top 40K Hungarian tokens) the model size reduced from 4.92GB to 3.28GB.

This model is based on the description of [cointegrated/rut5-base](https://huggingface.co/cointegrated/rut5-base). 
The creation of this model is described in the post [How to adapt a multilingual T5 model for a single language](https://towardsdatascience.com/how-to-adapt-a-multilingual-t5-model-for-a-single-language-b9f94f3d9c90) along with the source code.