Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ The v2 version of SeamlessM4T is a multitask adaptation of our novel *UnitY2* ar
|
|
20 |
*Unity2* with its hierarchical character-to-unit upsampling and non-autoregressive text-to-unit decoding considerably improves over SeamlessM4T v1 in quality and inference speed.
|
21 |
|
22 |
|
23 |
-
![SeamlessM4T architectures](
|
24 |
|
25 |
## SeamlessM4T models
|
26 |
| Model Name | #params | checkpoint | metrics |
|
@@ -35,11 +35,11 @@ The evaluation data ids for FLEURS, CoVoST2 and CVSS-C can be found [here](https
|
|
35 |
|
36 |
|
37 |
## Evaluating SeamlessM4T models
|
38 |
-
To reproduce our results or to evaluate using the same metrics over your own test sets, please check out the [Evaluation README here](
|
39 |
|
40 |
|
41 |
## Finetuning SeamlessM4T models
|
42 |
-
Please check out the [Finetuning README here](
|
43 |
|
44 |
## Supported Languages:
|
45 |
|
@@ -156,7 +156,7 @@ The `target` column specifies whether a language is supported as target speech (
|
|
156 |
| zul | Zulu | Latn | Sp, Tx | Tx |
|
157 |
|
158 |
|
159 |
-
Note that seamlessM4T-medium supports 200 languages in the text modality, and is based on NLLB-200 (see full list in [asset card](src/seamless_communication/cards/unity_nllb-200.yaml))
|
160 |
|
161 |
## Citation
|
162 |
For SeamlessM4T v2, please cite :
|
|
|
20 |
*Unity2* with its hierarchical character-to-unit upsampling and non-autoregressive text-to-unit decoding considerably improves over SeamlessM4T v1 in quality and inference speed.
|
21 |
|
22 |
|
23 |
+
![SeamlessM4T architectures](seamlessm4t_arch.svg)
|
24 |
|
25 |
## SeamlessM4T models
|
26 |
| Model Name | #params | checkpoint | metrics |
|
|
|
35 |
|
36 |
|
37 |
## Evaluating SeamlessM4T models
|
38 |
+
To reproduce our results or to evaluate using the same metrics over your own test sets, please check out the [Evaluation README here](https://github.com/facebookresearch/seamless_communication/src/seamless_communication/cli/m4t/evaluate/README.md).
|
39 |
|
40 |
|
41 |
## Finetuning SeamlessM4T models
|
42 |
+
Please check out the [Finetuning README here](https://github.com/facebookresearch/seamless_communication/src/seamless_communication/cli/m4t/finetune/README.md).
|
43 |
|
44 |
## Supported Languages:
|
45 |
|
|
|
156 |
| zul | Zulu | Latn | Sp, Tx | Tx |
|
157 |
|
158 |
|
159 |
+
Note that seamlessM4T-medium supports 200 languages in the text modality, and is based on NLLB-200 (see full list in [asset card](https://github.com/facebookresearch/seamless_communication/src/seamless_communication/cards/unity_nllb-200.yaml))
|
160 |
|
161 |
## Citation
|
162 |
For SeamlessM4T v2, please cite :
|