Update README.md
Browse files
README.md
CHANGED
@@ -16,5 +16,5 @@ widget:
|
|
16 |
|
17 |
This is a pruned version of the ```google/mt5-large``` model. Here, the input and output embeddings are pruned to support a greatly reduced vocabulary.
|
18 |
The chosen vocabulary has 30K norwegian, english and special tokens, ~12% of the old size. This reduces the model size by roughly 37%.
|
19 |
-
The model is still OK on similar languages, like German and Danish, but very different languages like arabic are
|
20 |
-
This model is intended as starting point for finetuning mt5 for norwegian applications.
|
|
|
16 |
|
17 |
This is a pruned version of the ```google/mt5-large``` model. Here, the input and output embeddings are pruned to support a greatly reduced vocabulary.
|
18 |
The chosen vocabulary has 30K norwegian, english and special tokens, ~12% of the old size. This reduces the model size by roughly 37%.
|
19 |
+
The model is still OK on similar languages, like German and Danish, but very different languages like arabic are not a good fit anymore.
|
20 |
+
This model is intended as a starting point for finetuning mt5 for norwegian applications.
|