Update README.md

README.md

@@ -604,6 +604,57 @@ Below are the evaluation results on Flores-200 dev and devtest compared to NLLB-
 
 </details>
 
+## Evaluation Aranese, Aragonese, Asturian
+
+Using [MT Lens](https://github.com/langtech-bsc/mt-evaluation) we evaluate Spanish-Asturian, Spanish-Aragonese and Spanish-Aranese on BLEU and ChrF scores on the [Flores+ dev](https://github.com/openlanguagedata/flores) evaluation dataset. We also report BLEU and ChrF scores for catalan directions.
+
+### Asturian Flores+ dev
+
+Below are the evaluation results compared to [Apertium](https://www.apertium.org/), [Eslema](https://eslema.it.uniovi.es/) and NLLB ([Costa-jussà et al., 2022](https://arxiv.org/abs/2207.04672)).
+
+|             | source   | target   |   Bleu |  ChrF |
+|:-----------------------|:---------|:---------|------:|-------:|
+| nllb 3.3B              | es       | ast      |  **18.78** |  50.5  |
+| Eslema | es       | ast      |  17.30 |  **50.77** |
+| nllb 600M | es       | ast      |  17.23 |  49.72 |
+| SalamandraTA-2B | es       | ast      |  17.11 |  49.49 |
+| Apertium | es       | ast      |  16.66 |  50.57 |
+|  | | | | | | | | |
+|  | | | | | | | | |
+| nllb 3.3B              | ca       | ast      |  **25.87** |  54.9  |
+| SalamandraTA-2B | ca       | ast      |  25.17 |  **55.17** |
+
+
+### Aragonese Flores+ dev
+
+Below are the evaluation results on compared to [Apertium](https://www.apertium.org/), [Softcatala](https://www.softcatala.org/traductor/) and [Traduze](https://traduze.aragon.es).
+
+|             | source   | target   |   Bleu |    ChrF |
+|:-----------------------|:---------|:---------|-------:|-------:|
+| Apertium | es       | an      |  **65.34** |  **82.00** |
+| Softcatala | es       | an      |  50.21 |  73.97 |
+| SalamandraTA-2B | es       | an      |  49.13 |  74.22 |
+| Traduze | es       | an      |  37.43 |  69.51 |
+|  | | | | | | | | |
+|  | | | | | | | | |
+| SalamandraTA-2B | ca       | an      |  17.06 |  49.12 |
+
+
+### Aranese Flores+ dev
+
+Below are the evaluation results on compared to [Apertium](https://www.apertium.org/) and [Softcatala](https://www.softcatala.org/traductor/).
+
+
+|             | source   | target   |   Bleu |    ChrF |
+|:-----------------------|:---------|:---------|-------:|-------:|
+| Apertium | es       | arn      |  **48.96** |  **72.63** |
+| Softcatala | es       | arn      |  34.43 |  58.61 |
+| SalamandraTA-2B | es       | arn      |  34.35 |  57.78 |
+|  | | | | | | | | |
+|  | | | | | | | | |
+| SalamandraTA-2B | ca       | arn      |  21.95 |  48.67 |
+
+