peft tensorboard safetensors generated_from_trainer base_model:smutuvi/whisper-small-sw-common-voice license:apache-2.0 region:us
---
license: apache-2.0
library_name: peft
tags:
- generated_from_trainer
base_model: smutuvi/whisper-small-sw-common-voice
model-index:
- name: whisper-small-sw-common-voice-ndizi-158-200epochs
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# whisper-small-sw-common-voice-ndizi-158-200epochs

This model is a fine-tuned version of [smutuvi/whisper-small-sw-common-voice](https://huggingface.co/smutuvi/whisper-small-sw-common-voice) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 1.6105

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 50
- num_epochs: 200
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| No log        | 1.0   | 18   | 1.9360          |
| 1.7703        | 2.0   | 36   | 1.9238          |
| 1.7272        | 3.0   | 54   | 1.9020          |
| 1.7272        | 4.0   | 72   | 1.8734          |
| 1.6774        | 5.0   | 90   | 1.8500          |
| 1.6158        | 6.0   | 108  | 1.8275          |
| 1.593         | 7.0   | 126  | 1.8072          |
| 1.593         | 8.0   | 144  | 1.7844          |
| 1.5635        | 9.0   | 162  | 1.7650          |
| 1.4675        | 10.0  | 180  | 1.7491          |
| 1.4675        | 11.0  | 198  | 1.7345          |
| 1.5034        | 12.0  | 216  | 1.7205          |
| 1.5317        | 13.0  | 234  | 1.7083          |
| 1.4329        | 14.0  | 252  | 1.6991          |
| 1.4329        | 15.0  | 270  | 1.6891          |
| 1.38          | 16.0  | 288  | 1.6826          |
| 1.3865        | 17.0  | 306  | 1.6771          |
| 1.3865        | 18.0  | 324  | 1.6673          |
| 1.4132        | 19.0  | 342  | 1.6620          |
| 1.3528        | 20.0  | 360  | 1.6544          |
| 1.3223        | 21.0  | 378  | 1.6499          |
| 1.3223        | 22.0  | 396  | 1.6439          |
| 1.3042        | 23.0  | 414  | 1.6376          |
| 1.3851        | 24.0  | 432  | 1.6328          |
| 1.2761        | 25.0  | 450  | 1.6260          |
| 1.2761        | 26.0  | 468  | 1.6226          |
| 1.2968        | 27.0  | 486  | 1.6194          |
| 1.2563        | 28.0  | 504  | 1.6150          |
| 1.2563        | 29.0  | 522  | 1.6130          |
| 1.3355        | 30.0  | 540  | 1.6058          |
| 1.1684        | 31.0  | 558  | 1.6061          |
| 1.2346        | 32.0  | 576  | 1.6011          |
| 1.2346        | 33.0  | 594  | 1.5993          |
| 1.2771        | 34.0  | 612  | 1.5951          |
| 1.1984        | 35.0  | 630  | 1.5938          |
| 1.1984        | 36.0  | 648  | 1.5895          |
| 1.2108        | 37.0  | 666  | 1.5868          |
| 1.2113        | 38.0  | 684  | 1.5838          |
| 1.1797        | 39.0  | 702  | 1.5824          |
| 1.1797        | 40.0  | 720  | 1.5759          |
| 1.1079        | 41.0  | 738  | 1.5748          |
| 1.239         | 42.0  | 756  | 1.5756          |
| 1.239         | 43.0  | 774  | 1.5734          |
| 1.1676        | 44.0  | 792  | 1.5719          |
| 1.1334        | 45.0  | 810  | 1.5702          |
| 1.103         | 46.0  | 828  | 1.5634          |
| 1.103         | 47.0  | 846  | 1.5628          |
| 1.1201        | 48.0  | 864  | 1.5641          |
| 1.1103        | 49.0  | 882  | 1.5609          |
| 1.1624        | 50.0  | 900  | 1.5596          |
| 1.1624        | 51.0  | 918  | 1.5615          |
| 1.1292        | 52.0  | 936  | 1.5585          |
| 1.0579        | 53.0  | 954  | 1.5563          |
| 1.0579        | 54.0  | 972  | 1.5585          |
| 1.1412        | 55.0  | 990  | 1.5578          |
| 1.0949        | 56.0  | 1008 | 1.5545          |
| 1.0209        | 57.0  | 1026 | 1.5543          |
| 1.0209        | 58.0  | 1044 | 1.5567          |
| 1.0801        | 59.0  | 1062 | 1.5539          |
| 1.1108        | 60.0  | 1080 | 1.5555          |
| 1.1108        | 61.0  | 1098 | 1.5540          |
| 1.0092        | 62.0  | 1116 | 1.5528          |
| 1.0998        | 63.0  | 1134 | 1.5565          |
| 1.065         | 64.0  | 1152 | 1.5534          |
| 1.065         | 65.0  | 1170 | 1.5555          |
| 0.9916        | 66.0  | 1188 | 1.5548          |
| 1.0833        | 67.0  | 1206 | 1.5531          |
| 1.0833        | 68.0  | 1224 | 1.5530          |
| 0.9678        | 69.0  | 1242 | 1.5562          |
| 0.994         | 70.0  | 1260 | 1.5542          |
| 1.0578        | 71.0  | 1278 | 1.5545          |
| 1.0578        | 72.0  | 1296 | 1.5522          |
| 1.0325        | 73.0  | 1314 | 1.5535          |
| 0.9367        | 74.0  | 1332 | 1.5554          |
| 0.9867        | 75.0  | 1350 | 1.5534          |
| 0.9867        | 76.0  | 1368 | 1.5580          |
| 0.9753        | 77.0  | 1386 | 1.5568          |
| 0.9434        | 78.0  | 1404 | 1.5543          |
| 0.9434        | 79.0  | 1422 | 1.5538          |
| 1.0323        | 80.0  | 1440 | 1.5552          |
| 0.895         | 81.0  | 1458 | 1.5559          |
| 1.0086        | 82.0  | 1476 | 1.5570          |
| 1.0086        | 83.0  | 1494 | 1.5557          |
| 0.9415        | 84.0  | 1512 | 1.5578          |
| 0.9351        | 85.0  | 1530 | 1.5552          |
| 0.9351        | 86.0  | 1548 | 1.5559          |
| 0.9734        | 87.0  | 1566 | 1.5591          |
| 0.9218        | 88.0  | 1584 | 1.5602          |
| 0.9361        | 89.0  | 1602 | 1.5611          |
| 0.9361        | 90.0  | 1620 | 1.5608          |
| 0.9255        | 91.0  | 1638 | 1.5651          |
| 0.8865        | 92.0  | 1656 | 1.5620          |
| 0.8865        | 93.0  | 1674 | 1.5626          |
| 0.9224        | 94.0  | 1692 | 1.5625          |
| 0.9447        | 95.0  | 1710 | 1.5614          |
| 0.9318        | 96.0  | 1728 | 1.5591          |
| 0.9318        | 97.0  | 1746 | 1.5643          |
| 0.9399        | 98.0  | 1764 | 1.5648          |
| 0.8648        | 99.0  | 1782 | 1.5636          |
| 0.9009        | 100.0 | 1800 | 1.5696          |
| 0.9009        | 101.0 | 1818 | 1.5682          |
| 0.9023        | 102.0 | 1836 | 1.5678          |
| 0.8346        | 103.0 | 1854 | 1.5738          |
| 0.8346        | 104.0 | 1872 | 1.5652          |
| 0.8902        | 105.0 | 1890 | 1.5680          |
| 0.9123        | 106.0 | 1908 | 1.5709          |
| 0.8684        | 107.0 | 1926 | 1.5722          |
| 0.8684        | 108.0 | 1944 | 1.5717          |
| 0.8147        | 109.0 | 1962 | 1.5727          |
| 0.905         | 110.0 | 1980 | 1.5713          |
| 0.905         | 111.0 | 1998 | 1.5752          |
| 0.9051        | 112.0 | 2016 | 1.5753          |
| 0.7903        | 113.0 | 2034 | 1.5753          |
| 0.8993        | 114.0 | 2052 | 1.5771          |
| 0.8993        | 115.0 | 2070 | 1.5771          |
| 0.8289        | 116.0 | 2088 | 1.5804          |
| 0.8691        | 117.0 | 2106 | 1.5787          |
| 0.8691        | 118.0 | 2124 | 1.5773          |
| 0.8526        | 119.0 | 2142 | 1.5785          |
| 0.8238        | 120.0 | 2160 | 1.5804          |
| 0.8299        | 121.0 | 2178 | 1.5828          |
| 0.8299        | 122.0 | 2196 | 1.5851          |
| 0.9001        | 123.0 | 2214 | 1.5810          |
| 0.7701        | 124.0 | 2232 | 1.5843          |
| 0.8467        | 125.0 | 2250 | 1.5810          |
| 0.8467        | 126.0 | 2268 | 1.5834          |
| 0.7867        | 127.0 | 2286 | 1.5882          |
| 0.8984        | 128.0 | 2304 | 1.5898          |
| 0.8984        | 129.0 | 2322 | 1.5899          |
| 0.7879        | 130.0 | 2340 | 1.5878          |
| 0.833         | 131.0 | 2358 | 1.5934          |
| 0.8257        | 132.0 | 2376 | 1.5930          |
| 0.8257        | 133.0 | 2394 | 1.5927          |
| 0.8139        | 134.0 | 2412 | 1.5919          |
| 0.8014        | 135.0 | 2430 | 1.5940          |
| 0.8014        | 136.0 | 2448 | 1.5953          |
| 0.8397        | 137.0 | 2466 | 1.5967          |
| 0.8293        | 138.0 | 2484 | 1.5941          |
| 0.7821        | 139.0 | 2502 | 1.6005          |
| 0.7821        | 140.0 | 2520 | 1.6016          |
| 0.7746        | 141.0 | 2538 | 1.5951          |
| 0.8059        | 142.0 | 2556 | 1.5967          |
| 0.8059        | 143.0 | 2574 | 1.5974          |
| 0.7862        | 144.0 | 2592 | 1.6043          |
| 0.8253        | 145.0 | 2610 | 1.6015          |
| 0.7718        | 146.0 | 2628 | 1.6018          |
| 0.7718        | 147.0 | 2646 | 1.6005          |
| 0.7898        | 148.0 | 2664 | 1.6014          |
| 0.813         | 149.0 | 2682 | 1.5998          |
| 0.792         | 150.0 | 2700 | 1.6023          |
| 0.792         | 151.0 | 2718 | 1.6019          |
| 0.8097        | 152.0 | 2736 | 1.6022          |
| 0.7703        | 153.0 | 2754 | 1.6063          |
| 0.7703        | 154.0 | 2772 | 1.6023          |
| 0.7731        | 155.0 | 2790 | 1.6082          |
| 0.789         | 156.0 | 2808 | 1.6057          |
| 0.7733        | 157.0 | 2826 | 1.6040          |
| 0.7733        | 158.0 | 2844 | 1.6003          |
| 0.7945        | 159.0 | 2862 | 1.6086          |
| 0.7177        | 160.0 | 2880 | 1.6056          |
| 0.7177        | 161.0 | 2898 | 1.6068          |
| 0.7887        | 162.0 | 2916 | 1.6069          |
| 0.7331        | 163.0 | 2934 | 1.6074          |
| 0.8337        | 164.0 | 2952 | 1.6048          |
| 0.8337        | 165.0 | 2970 | 1.6052          |
| 0.7903        | 166.0 | 2988 | 1.6082          |
| 0.7811        | 167.0 | 3006 | 1.6050          |
| 0.7811        | 168.0 | 3024 | 1.6128          |
| 0.7264        | 169.0 | 3042 | 1.6079          |
| 0.769         | 170.0 | 3060 | 1.6052          |
| 0.7689        | 171.0 | 3078 | 1.6091          |
| 0.7689        | 172.0 | 3096 | 1.6099          |
| 0.7977        | 173.0 | 3114 | 1.6084          |
| 0.7253        | 174.0 | 3132 | 1.6123          |
| 0.7912        | 175.0 | 3150 | 1.6114          |
| 0.7912        | 176.0 | 3168 | 1.6092          |
| 0.748         | 177.0 | 3186 | 1.6146          |
| 0.7707        | 178.0 | 3204 | 1.6138          |
| 0.7707        | 179.0 | 3222 | 1.6135          |
| 0.7506        | 180.0 | 3240 | 1.6119          |
| 0.7549        | 181.0 | 3258 | 1.6137          |
| 0.7793        | 182.0 | 3276 | 1.6084          |
| 0.7793        | 183.0 | 3294 | 1.6095          |
| 0.7709        | 184.0 | 3312 | 1.6115          |
| 0.7416        | 185.0 | 3330 | 1.6108          |
| 0.7416        | 186.0 | 3348 | 1.6140          |
| 0.7727        | 187.0 | 3366 | 1.6131          |
| 0.7674        | 188.0 | 3384 | 1.6146          |
| 0.731         | 189.0 | 3402 | 1.6146          |
| 0.731         | 190.0 | 3420 | 1.6133          |
| 0.8103        | 191.0 | 3438 | 1.6113          |
| 0.7121        | 192.0 | 3456 | 1.6127          |
| 0.7121        | 193.0 | 3474 | 1.6130          |
| 0.738         | 194.0 | 3492 | 1.6096          |
| 0.7967        | 195.0 | 3510 | 1.6137          |
| 0.7543        | 196.0 | 3528 | 1.6149          |
| 0.7543        | 197.0 | 3546 | 1.6149          |
| 0.7389        | 198.0 | 3564 | 1.6128          |
| 0.7658        | 199.0 | 3582 | 1.6142          |
| 0.7161        | 200.0 | 3600 | 1.6105          |


### Framework versions

- PEFT 0.7.2.dev0
- Transformers 4.37.0.dev0
- Pytorch 2.0.0
- Datasets 2.16.1
- Tokenizers 0.15.0