
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec2-large-xlsr-mecita-coraa-portuguese-2-all-10

This model is a fine-tuned version of [Edresson/wav2vec2-large-xlsr-coraa-portuguese](https://huggingface.co/Edresson/wav2vec2-large-xlsr-coraa-portuguese) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1751
- Wer: 0.0933
- Cer: 0.0340

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 32
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step | Validation Loss | Wer    | Cer    |
|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
| 27.4198       | 1.0   | 86   | 3.2592          | 1.0    | 1.0    |
| 7.6792        | 2.0   | 172  | 2.9548          | 1.0    | 1.0    |
| 3.034         | 3.0   | 258  | 2.9137          | 1.0    | 1.0    |
| 2.9217        | 4.0   | 344  | 2.8343          | 1.0    | 1.0    |
| 2.7561        | 5.0   | 430  | 1.2620          | 0.9995 | 0.2851 |
| 1.4605        | 6.0   | 516  | 0.5529          | 0.3291 | 0.0821 |
| 0.8248        | 7.0   | 602  | 0.4035          | 0.2048 | 0.0619 |
| 0.8248        | 8.0   | 688  | 0.3370          | 0.1874 | 0.0565 |
| 0.6273        | 9.0   | 774  | 0.3113          | 0.1685 | 0.0538 |
| 0.5041        | 10.0  | 860  | 0.2780          | 0.1575 | 0.0502 |
| 0.4543        | 11.0  | 946  | 0.2624          | 0.1415 | 0.0462 |
| 0.433         | 12.0  | 1032 | 0.2463          | 0.1294 | 0.0438 |
| 0.3614        | 13.0  | 1118 | 0.2333          | 0.1186 | 0.0413 |
| 0.3358        | 14.0  | 1204 | 0.2352          | 0.1134 | 0.0415 |
| 0.3358        | 15.0  | 1290 | 0.2206          | 0.1136 | 0.0409 |
| 0.3095        | 16.0  | 1376 | 0.2166          | 0.1134 | 0.0401 |
| 0.2981        | 17.0  | 1462 | 0.2156          | 0.1105 | 0.0396 |
| 0.2845        | 18.0  | 1548 | 0.2075          | 0.1091 | 0.0388 |
| 0.2747        | 19.0  | 1634 | 0.2088          | 0.1074 | 0.0385 |
| 0.2536        | 20.0  | 1720 | 0.2028          | 0.1021 | 0.0382 |
| 0.2501        | 21.0  | 1806 | 0.2000          | 0.1043 | 0.0381 |
| 0.2501        | 22.0  | 1892 | 0.2025          | 0.1100 | 0.0395 |
| 0.22          | 23.0  | 1978 | 0.2014          | 0.1038 | 0.0373 |
| 0.2253        | 24.0  | 2064 | 0.1894          | 0.1060 | 0.0378 |
| 0.2418        | 25.0  | 2150 | 0.1919          | 0.1010 | 0.0362 |
| 0.2246        | 26.0  | 2236 | 0.1898          | 0.1045 | 0.0375 |
| 0.1991        | 27.0  | 2322 | 0.1899          | 0.0990 | 0.0358 |
| 0.2075        | 28.0  | 2408 | 0.1887          | 0.0983 | 0.0359 |
| 0.2075        | 29.0  | 2494 | 0.1917          | 0.0981 | 0.0356 |
| 0.2061        | 30.0  | 2580 | 0.1926          | 0.0995 | 0.0363 |
| 0.1995        | 31.0  | 2666 | 0.1921          | 0.1041 | 0.0367 |
| 0.1796        | 32.0  | 2752 | 0.1859          | 0.0976 | 0.0357 |
| 0.1803        | 33.0  | 2838 | 0.1878          | 0.0957 | 0.0349 |
| 0.1847        | 34.0  | 2924 | 0.1869          | 0.0950 | 0.0341 |
| 0.1689        | 35.0  | 3010 | 0.1840          | 0.0964 | 0.0340 |
| 0.1689        | 36.0  | 3096 | 0.1828          | 0.0959 | 0.0343 |
| 0.1848        | 37.0  | 3182 | 0.1778          | 0.0967 | 0.0342 |
| 0.1607        | 38.0  | 3268 | 0.1848          | 0.0933 | 0.0340 |
| 0.1793        | 39.0  | 3354 | 0.1792          | 0.0986 | 0.0350 |
| 0.1809        | 40.0  | 3440 | 0.1814          | 0.0971 | 0.0344 |
| 0.1562        | 41.0  | 3526 | 0.1779          | 0.0969 | 0.0342 |
| 0.1579        | 42.0  | 3612 | 0.1823          | 0.0945 | 0.0340 |
| 0.1579        | 43.0  | 3698 | 0.1825          | 0.0976 | 0.0345 |
| 0.1524        | 44.0  | 3784 | 0.1751          | 0.0933 | 0.0340 |
| 0.1621        | 45.0  | 3870 | 0.1769          | 0.0945 | 0.0339 |
| 0.1597        | 46.0  | 3956 | 0.1788          | 0.0957 | 0.0343 |
| 0.1377        | 47.0  | 4042 | 0.1809          | 0.0914 | 0.0330 |
| 0.1513        | 48.0  | 4128 | 0.1770          | 0.0931 | 0.0337 |
| 0.1575        | 49.0  | 4214 | 0.1830          | 0.0943 | 0.0340 |
| 0.1411        | 50.0  | 4300 | 0.1785          | 0.0947 | 0.0339 |
| 0.1411        | 51.0  | 4386 | 0.1821          | 0.0912 | 0.0334 |
| 0.1369        | 52.0  | 4472 | 0.1800          | 0.0885 | 0.0322 |
| 0.142         | 53.0  | 4558 | 0.1837          | 0.0914 | 0.0332 |
| 0.1264        | 54.0  | 4644 | 0.1763          | 0.0921 | 0.0325 |
| 0.1555        | 55.0  | 4730 | 0.1808          | 0.0928 | 0.0323 |
| 0.1358        | 56.0  | 4816 | 0.1834          | 0.0912 | 0.0329 |
| 0.147         | 57.0  | 4902 | 0.1813          | 0.0919 | 0.0328 |
| 0.147         | 58.0  | 4988 | 0.1824          | 0.0890 | 0.0328 |
| 0.1358        | 59.0  | 5074 | 0.1851          | 0.0897 | 0.0328 |
| 0.1372        | 60.0  | 5160 | 0.1784          | 0.0895 | 0.0324 |
| 0.1525        | 61.0  | 5246 | 0.1754          | 0.0881 | 0.0323 |
| 0.1276        | 62.0  | 5332 | 0.1772          | 0.0914 | 0.0332 |
| 0.1273        | 63.0  | 5418 | 0.1760          | 0.0897 | 0.0330 |
| 0.1213        | 64.0  | 5504 | 0.1782          | 0.0905 | 0.0322 |


### Framework versions

- Transformers 4.28.0
- Pytorch 2.1.1+cu121
- Datasets 2.15.0
- Tokenizers 0.13.3

{"license": "apache-2.0", "tags": ["generated_from_trainer"], "metrics": ["wer"], "model-index": [{"name": "wav2vec2-large-xlsr-mecita-coraa-portuguese-2-all-10", "results": []}]}
transformers pytorch wav2vec2 automatic-speech-recognition generated_from_trainer license:apache-2.0 endpoints_compatible region:us