transformers tensorboard safetensors wav2vec2 automatic-speech-recognition generated_from_trainer dataset:common_voice_16_0 base_model:facebook/wav2vec2-large-xlsr-53 license:apache-2.0 model-index endpoints_compatible region:us
---
license: apache-2.0
base_model: facebook/wav2vec2-large-xlsr-53
tags:
- generated_from_trainer
datasets:
- common_voice_16_0
metrics:
- wer
model-index:
- name: wav2vec2-large-xlsr-sw-common-voice-16
  results:
  - task:
      name: Automatic Speech Recognition
      type: automatic-speech-recognition
    dataset:
      name: common_voice_16_0
      type: common_voice_16_0
      config: sw
      split: test
      args: sw
    metrics:
    - name: Wer
      type: wer
      value: 0.3082326604654753
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec2-large-xlsr-sw-common-voice-16

This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on the common_voice_16_0 dataset.
It achieves the following results on the evaluation set:
- Loss: inf
- Wer: 0.3082

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- num_epochs: 30
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step   | Validation Loss | Wer    |
|:-------------:|:-----:|:------:|:---------------:|:------:|
| 5.8691        | 0.11  | 400    | inf             | 1.0    |
| 1.673         | 0.22  | 800    | inf             | 0.7178 |
| 0.6454        | 0.33  | 1200   | inf             | 0.6274 |
| 0.5527        | 0.44  | 1600   | inf             | 0.5747 |
| 0.4989        | 0.55  | 2000   | inf             | 0.5174 |
| 0.4827        | 0.66  | 2400   | inf             | 0.5302 |
| 0.4462        | 0.77  | 2800   | inf             | 0.4916 |
| 0.4374        | 0.88  | 3200   | inf             | 0.4769 |
| 0.4183        | 0.99  | 3600   | inf             | 0.4687 |
| 0.3854        | 1.1   | 4000   | inf             | 0.4669 |
| 0.3802        | 1.2   | 4400   | inf             | 0.4513 |
| 0.3727        | 1.31  | 4800   | inf             | 0.4505 |
| 0.3694        | 1.42  | 5200   | inf             | 0.4405 |
| 0.3709        | 1.53  | 5600   | inf             | 0.4364 |
| 0.363         | 1.64  | 6000   | inf             | 0.4318 |
| 0.3669        | 1.75  | 6400   | inf             | 0.4398 |
| 0.3597        | 1.86  | 6800   | inf             | 0.4353 |
| 0.3541        | 1.97  | 7200   | inf             | 0.4251 |
| 0.3277        | 2.08  | 7600   | inf             | 0.4153 |
| 0.3211        | 2.19  | 8000   | inf             | 0.4178 |
| 0.3225        | 2.3   | 8400   | inf             | 0.4267 |
| 0.3215        | 2.41  | 8800   | inf             | 0.4139 |
| 0.3224        | 2.52  | 9200   | inf             | 0.4054 |
| 0.3106        | 2.63  | 9600   | inf             | 0.4155 |
| 0.3141        | 2.74  | 10000  | inf             | 0.4188 |
| 0.3189        | 2.85  | 10400  | inf             | 0.4036 |
| 0.3213        | 2.96  | 10800  | inf             | 0.4071 |
| 0.3005        | 3.07  | 11200  | inf             | 0.3954 |
| 0.2872        | 3.18  | 11600  | inf             | 0.3974 |
| 0.2855        | 3.29  | 12000  | inf             | 0.3982 |
| 0.2898        | 3.39  | 12400  | inf             | 0.3987 |
| 0.288         | 3.5   | 12800  | inf             | 0.4021 |
| 0.2941        | 3.61  | 13200  | inf             | 0.3955 |
| 0.2951        | 3.72  | 13600  | inf             | 0.4022 |
| 0.2916        | 3.83  | 14000  | inf             | 0.3960 |
| 0.2896        | 3.94  | 14400  | inf             | 0.3903 |
| 0.2794        | 4.05  | 14800  | inf             | 0.3918 |
| 0.2707        | 4.16  | 15200  | inf             | 0.3873 |
| 0.2682        | 4.27  | 15600  | inf             | 0.3927 |
| 0.2654        | 4.38  | 16000  | inf             | 0.3844 |
| 0.2699        | 4.49  | 16400  | inf             | 0.3909 |
| 0.2723        | 4.6   | 16800  | inf             | 0.3904 |
| 0.2762        | 4.71  | 17200  | inf             | 0.3857 |
| 0.2621        | 4.82  | 17600  | inf             | 0.3795 |
| 0.26          | 4.93  | 18000  | inf             | 0.3764 |
| 0.2659        | 5.04  | 18400  | inf             | 0.3842 |
| 0.2479        | 5.15  | 18800  | inf             | 0.3719 |
| 0.2518        | 5.26  | 19200  | inf             | 0.3822 |
| 0.2591        | 5.37  | 19600  | inf             | 0.3837 |
| 0.2491        | 5.48  | 20000  | inf             | 0.3871 |
| 0.2466        | 5.59  | 20400  | inf             | 0.3747 |
| 0.2519        | 5.69  | 20800  | inf             | 0.3788 |
| 0.2516        | 5.8   | 21200  | inf             | 0.3781 |
| 0.2422        | 5.91  | 21600  | inf             | 0.3751 |
| 0.2439        | 6.02  | 22000  | inf             | 0.3693 |
| 0.2327        | 6.13  | 22400  | inf             | 0.3752 |
| 0.2327        | 6.24  | 22800  | inf             | 0.3706 |
| 0.2302        | 6.35  | 23200  | inf             | 0.3687 |
| 0.2313        | 6.46  | 23600  | inf             | 0.3690 |
| 0.2363        | 6.57  | 24000  | inf             | 0.3686 |
| 0.2329        | 6.68  | 24400  | inf             | 0.3681 |
| 0.2328        | 6.79  | 24800  | inf             | 0.3626 |
| 0.2329        | 6.9   | 25200  | inf             | 0.3652 |
| 0.2254        | 7.01  | 25600  | inf             | 0.3606 |
| 0.2124        | 7.12  | 26000  | inf             | 0.3648 |
| 0.2206        | 7.23  | 26400  | inf             | 0.3686 |
| 0.2151        | 7.34  | 26800  | inf             | 0.3646 |
| 0.2167        | 7.45  | 27200  | inf             | 0.3630 |
| 0.2196        | 7.56  | 27600  | inf             | 0.3597 |
| 0.2089        | 7.67  | 28000  | inf             | 0.3561 |
| 0.2183        | 7.78  | 28400  | inf             | 0.3593 |
| 0.2148        | 7.89  | 28800  | inf             | 0.3580 |
| 0.2232        | 7.99  | 29200  | inf             | 0.3597 |
| 0.2002        | 8.1   | 29600  | inf             | 0.3581 |
| 0.1924        | 8.21  | 30000  | inf             | 0.3585 |
| 0.2046        | 8.32  | 30400  | inf             | 0.3606 |
| 0.2057        | 8.43  | 30800  | inf             | 0.3611 |
| 0.2042        | 8.54  | 31200  | inf             | 0.3618 |
| 0.21          | 8.65  | 31600  | inf             | 0.3599 |
| 0.2076        | 8.76  | 32000  | inf             | 0.3568 |
| 0.208         | 8.87  | 32400  | inf             | 0.3564 |
| 0.2154        | 8.98  | 32800  | inf             | 0.3566 |
| 0.1991        | 9.09  | 33200  | inf             | 0.3621 |
| 0.1986        | 9.2   | 33600  | inf             | 0.3571 |
| 0.1898        | 9.31  | 34000  | inf             | 0.3515 |
| 0.1961        | 9.42  | 34400  | inf             | 0.3559 |
| 0.1947        | 9.53  | 34800  | inf             | 0.3521 |
| 0.1886        | 9.64  | 35200  | inf             | 0.3500 |
| 0.1901        | 9.75  | 35600  | inf             | 0.3557 |
| 0.1998        | 9.86  | 36000  | inf             | 0.3547 |
| 0.1873        | 9.97  | 36400  | inf             | 0.3498 |
| 0.1858        | 10.08 | 36800  | inf             | 0.3552 |
| 0.1804        | 10.18 | 37200  | inf             | 0.3518 |
| 0.18          | 10.29 | 37600  | inf             | 0.3504 |
| 0.1777        | 10.4  | 38000  | inf             | 0.3532 |
| 0.1777        | 10.51 | 38400  | inf             | 0.3530 |
| 0.1801        | 10.62 | 38800  | inf             | 0.3515 |
| 0.1839        | 10.73 | 39200  | inf             | 0.3538 |
| 0.1913        | 10.84 | 39600  | inf             | 0.3554 |
| 0.1909        | 10.95 | 40000  | inf             | 0.3479 |
| 0.1812        | 11.06 | 40400  | inf             | 0.3467 |
| 0.1664        | 11.17 | 40800  | inf             | 0.3491 |
| 0.175         | 11.28 | 41200  | inf             | 0.3446 |
| 0.1733        | 11.39 | 41600  | inf             | 0.3464 |
| 0.1709        | 11.5  | 42000  | inf             | 0.3467 |
| 0.1777        | 11.61 | 42400  | inf             | 0.3469 |
| 0.1735        | 11.72 | 42800  | inf             | 0.3452 |
| 0.1765        | 11.83 | 43200  | inf             | 0.3471 |
| 0.1738        | 11.94 | 43600  | inf             | 0.3496 |
| 0.1649        | 12.05 | 44000  | inf             | 0.3445 |
| 0.1601        | 12.16 | 44400  | inf             | 0.3464 |
| 0.1603        | 12.27 | 44800  | inf             | 0.3416 |
| 0.1634        | 12.38 | 45200  | inf             | 0.3445 |
| 0.1628        | 12.48 | 45600  | inf             | 0.3452 |
| 0.1621        | 12.59 | 46000  | inf             | 0.3403 |
| 0.1596        | 12.7  | 46400  | inf             | 0.3394 |
| 0.1589        | 12.81 | 46800  | inf             | 0.3401 |
| 0.1632        | 12.92 | 47200  | inf             | 0.3403 |
| 0.163         | 13.03 | 47600  | inf             | 0.3429 |
| 0.1516        | 13.14 | 48000  | inf             | 0.3417 |
| 0.1506        | 13.25 | 48400  | inf             | 0.3417 |
| 0.1568        | 13.36 | 48800  | inf             | 0.3410 |
| 0.1543        | 13.47 | 49200  | inf             | 0.3409 |
| 0.1574        | 13.58 | 49600  | inf             | 0.3408 |
| 0.1555        | 13.69 | 50000  | inf             | 0.3424 |
| 0.1535        | 13.8  | 50400  | inf             | 0.3395 |
| 0.1539        | 13.91 | 50800  | inf             | 0.3409 |
| 0.1528        | 14.02 | 51200  | inf             | 0.3406 |
| 0.1411        | 14.13 | 51600  | inf             | 0.3366 |
| 0.1413        | 14.24 | 52000  | inf             | 0.3402 |
| 0.1477        | 14.35 | 52400  | inf             | 0.3386 |
| 0.1433        | 14.46 | 52800  | inf             | 0.3356 |
| 0.1446        | 14.57 | 53200  | inf             | 0.3357 |
| 0.1427        | 14.67 | 53600  | inf             | 0.3378 |
| 0.1462        | 14.78 | 54000  | inf             | 0.3328 |
| 0.1436        | 14.89 | 54400  | inf             | 0.3358 |
| 0.1434        | 15.0  | 54800  | inf             | 0.3366 |
| 0.135         | 15.11 | 55200  | inf             | 0.3354 |
| 0.1375        | 15.22 | 55600  | inf             | 0.3355 |
| 0.1366        | 15.33 | 56000  | inf             | 0.3356 |
| 0.1389        | 15.44 | 56400  | inf             | 0.3336 |
| 0.1378        | 15.55 | 56800  | inf             | 0.3364 |
| 0.1362        | 15.66 | 57200  | inf             | 0.3325 |
| 0.1376        | 15.77 | 57600  | inf             | 0.3361 |
| 0.1323        | 15.88 | 58000  | inf             | 0.3364 |
| 0.1343        | 15.99 | 58400  | inf             | 0.3332 |
| 0.1257        | 16.1  | 58800  | inf             | 0.3339 |
| 0.1239        | 16.21 | 59200  | inf             | 0.3316 |
| 0.1292        | 16.32 | 59600  | inf             | 0.3313 |
| 0.1297        | 16.43 | 60000  | inf             | 0.3332 |
| 0.1265        | 16.54 | 60400  | inf             | 0.3313 |
| 0.1271        | 16.65 | 60800  | inf             | 0.3310 |
| 0.1315        | 16.76 | 61200  | inf             | 0.3307 |
| 0.1271        | 16.87 | 61600  | inf             | 0.3337 |
| 0.1298        | 16.97 | 62000  | inf             | 0.3318 |
| 0.1211        | 17.08 | 62400  | inf             | 0.3326 |
| 0.1192        | 17.19 | 62800  | inf             | 0.3290 |
| 0.1232        | 17.3  | 63200  | inf             | 0.3291 |
| 0.1229        | 17.41 | 63600  | inf             | 0.3349 |
| 0.1162        | 17.52 | 64000  | inf             | 0.3281 |
| 0.1207        | 17.63 | 64400  | inf             | 0.3308 |
| 0.1179        | 17.74 | 64800  | inf             | 0.3257 |
| 0.1207        | 17.85 | 65200  | inf             | 0.3290 |
| 0.1256        | 17.96 | 65600  | inf             | 0.3297 |
| 0.119         | 18.07 | 66000  | inf             | 0.3279 |
| 0.1111        | 18.18 | 66400  | inf             | 0.3302 |
| 0.1086        | 18.29 | 66800  | inf             | 0.3285 |
| 0.1179        | 18.4  | 67200  | inf             | 0.3274 |
| 0.1099        | 18.51 | 67600  | inf             | 0.3281 |
| 0.1141        | 18.62 | 68000  | inf             | 0.3281 |
| 0.1091        | 18.73 | 68400  | inf             | 0.3301 |
| 0.1147        | 18.84 | 68800  | inf             | 0.3270 |
| 0.1158        | 18.95 | 69200  | inf             | 0.3246 |
| 0.1111        | 19.06 | 69600  | inf             | 0.3227 |
| 0.1075        | 19.16 | 70000  | inf             | 0.3249 |
| 0.1051        | 19.27 | 70400  | inf             | 0.3253 |
| 0.1029        | 19.38 | 70800  | inf             | 0.3252 |
| 0.1039        | 19.49 | 71200  | inf             | 0.3264 |
| 0.1063        | 19.6  | 71600  | inf             | 0.3242 |
| 0.1071        | 19.71 | 72000  | inf             | 0.3250 |
| 0.1063        | 19.82 | 72400  | inf             | 0.3248 |
| 0.1085        | 19.93 | 72800  | inf             | 0.3247 |
| 0.1038        | 20.04 | 73200  | inf             | 0.3242 |
| 0.1017        | 20.15 | 73600  | inf             | 0.3255 |
| 0.099         | 20.26 | 74000  | inf             | 0.3247 |
| 0.0971        | 20.37 | 74400  | inf             | 0.3258 |
| 0.1002        | 20.48 | 74800  | inf             | 0.3223 |
| 0.1013        | 20.59 | 75200  | inf             | 0.3230 |
| 0.1018        | 20.7  | 75600  | inf             | 0.3232 |
| 0.0967        | 20.81 | 76000  | inf             | 0.3215 |
| 0.1008        | 20.92 | 76400  | inf             | 0.3212 |
| 0.0975        | 21.03 | 76800  | inf             | 0.3191 |
| 0.0893        | 21.14 | 77200  | inf             | 0.3210 |
| 0.0911        | 21.25 | 77600  | inf             | 0.3206 |
| 0.0959        | 21.36 | 78000  | inf             | 0.3211 |
| 0.094         | 21.46 | 78400  | inf             | 0.3198 |
| 0.0939        | 21.57 | 78800  | inf             | 0.3202 |
| 0.0936        | 21.68 | 79200  | inf             | 0.3202 |
| 0.0938        | 21.79 | 79600  | inf             | 0.3195 |
| 0.0938        | 21.9  | 80000  | inf             | 0.3184 |
| 0.0916        | 22.01 | 80400  | inf             | 0.3185 |
| 0.0858        | 22.12 | 80800  | inf             | 0.3177 |
| 0.0909        | 22.23 | 81200  | inf             | 0.3211 |
| 0.0915        | 22.34 | 81600  | inf             | 0.3222 |
| 0.088         | 22.45 | 82000  | inf             | 0.3194 |
| 0.0902        | 22.56 | 82400  | inf             | 0.3199 |
| 0.0868        | 22.67 | 82800  | inf             | 0.3174 |
| 0.0871        | 22.78 | 83200  | inf             | 0.3201 |
| 0.0908        | 22.89 | 83600  | inf             | 0.3177 |
| 0.0842        | 23.0  | 84000  | inf             | 0.3187 |
| 0.0842        | 23.11 | 84400  | inf             | 0.3168 |
| 0.0815        | 23.22 | 84800  | inf             | 0.3187 |
| 0.084         | 23.33 | 85200  | inf             | 0.3201 |
| 0.0835        | 23.44 | 85600  | inf             | 0.3185 |
| 0.0821        | 23.55 | 86000  | inf             | 0.3189 |
| 0.0836        | 23.66 | 86400  | inf             | 0.3179 |
| 0.0816        | 23.76 | 86800  | inf             | 0.3174 |
| 0.0847        | 23.87 | 87200  | inf             | 0.3172 |
| 0.0828        | 23.98 | 87600  | inf             | 0.3178 |
| 0.0796        | 24.09 | 88000  | inf             | 0.3144 |
| 0.0793        | 24.2  | 88400  | inf             | 0.3149 |
| 0.0773        | 24.31 | 88800  | inf             | 0.3165 |
| 0.0808        | 24.42 | 89200  | inf             | 0.3154 |
| 0.0743        | 24.53 | 89600  | inf             | 0.3159 |
| 0.078         | 24.64 | 90000  | inf             | 0.3145 |
| 0.0792        | 24.75 | 90400  | inf             | 0.3170 |
| 0.0775        | 24.86 | 90800  | inf             | 0.3134 |
| 0.0763        | 24.97 | 91200  | inf             | 0.3144 |
| 0.0705        | 25.08 | 91600  | inf             | 0.3138 |
| 0.0724        | 25.19 | 92000  | inf             | 0.3156 |
| 0.0732        | 25.3  | 92400  | inf             | 0.3158 |
| 0.0743        | 25.41 | 92800  | inf             | 0.3144 |
| 0.0729        | 25.52 | 93200  | inf             | 0.3133 |
| 0.071         | 25.63 | 93600  | inf             | 0.3139 |
| 0.0764        | 25.74 | 94000  | inf             | 0.3122 |
| 0.0726        | 25.85 | 94400  | inf             | 0.3128 |
| 0.0714        | 25.95 | 94800  | inf             | 0.3135 |
| 0.0725        | 26.06 | 95200  | inf             | 0.3147 |
| 0.0711        | 26.17 | 95600  | inf             | 0.3130 |
| 0.0684        | 26.28 | 96000  | inf             | 0.3125 |
| 0.0683        | 26.39 | 96400  | inf             | 0.3144 |
| 0.0698        | 26.5  | 96800  | inf             | 0.3135 |
| 0.0687        | 26.61 | 97200  | inf             | 0.3131 |
| 0.0675        | 26.72 | 97600  | inf             | 0.3119 |
| 0.0678        | 26.83 | 98000  | inf             | 0.3105 |
| 0.0677        | 26.94 | 98400  | inf             | 0.3102 |
| 0.068         | 27.05 | 98800  | inf             | 0.3128 |
| 0.0694        | 27.16 | 99200  | inf             | 0.3111 |
| 0.0681        | 27.27 | 99600  | inf             | 0.3118 |
| 0.0656        | 27.38 | 100000 | inf             | 0.3110 |
| 0.065         | 27.49 | 100400 | inf             | 0.3113 |
| 0.0649        | 27.6  | 100800 | inf             | 0.3113 |
| 0.0643        | 27.71 | 101200 | inf             | 0.3107 |
| 0.0651        | 27.82 | 101600 | inf             | 0.3102 |
| 0.0643        | 27.93 | 102000 | inf             | 0.3109 |
| 0.063         | 28.04 | 102400 | inf             | 0.3110 |
| 0.0604        | 28.15 | 102800 | inf             | 0.3108 |
| 0.062         | 28.25 | 103200 | inf             | 0.3110 |
| 0.0623        | 28.36 | 103600 | inf             | 0.3106 |
| 0.063         | 28.47 | 104000 | inf             | 0.3102 |
| 0.0619        | 28.58 | 104400 | inf             | 0.3101 |
| 0.0636        | 28.69 | 104800 | inf             | 0.3108 |
| 0.0636        | 28.8  | 105200 | inf             | 0.3099 |
| 0.0643        | 28.91 | 105600 | inf             | 0.3089 |
| 0.0607        | 29.02 | 106000 | inf             | 0.3094 |
| 0.0597        | 29.13 | 106400 | inf             | 0.3091 |
| 0.0616        | 29.24 | 106800 | inf             | 0.3087 |
| 0.0594        | 29.35 | 107200 | inf             | 0.3087 |
| 0.0614        | 29.46 | 107600 | inf             | 0.3087 |
| 0.06          | 29.57 | 108000 | inf             | 0.3082 |
| 0.0617        | 29.68 | 108400 | inf             | 0.3085 |
| 0.0574        | 29.79 | 108800 | inf             | 0.3082 |
| 0.06          | 29.9  | 109200 | inf             | 0.3082 |


### Framework versions

- Transformers 4.37.1
- Pytorch 2.2.0+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
