transformers pytorch wav2vec2 audio-classification generated_from_trainer dataset:minds14 base_model:facebook/wav2vec2-base-960h license:apache-2.0 model-index endpoints_compatible region:us
---
license: apache-2.0
base_model: facebook/wav2vec2-base-960h
tags:
- generated_from_trainer
datasets:
- minds14
metrics:
- accuracy
model-index:
- name: intent_classify
  results:
  - task:
      name: Audio Classification
      type: audio-classification
    dataset:
      name: minds14
      type: minds14
      config: en-US
      split: train
      args: en-US
    metrics:
    - name: Accuracy
      type: accuracy
      value: 0.08849557522123894
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# intent_classify

This model is a fine-tuned version of [facebook/wav2vec2-base-960h](https://huggingface.co/facebook/wav2vec2-base-960h) on the minds14 dataset.
It achieves the following results on the evaluation set:
- Loss: 3.1513
- Accuracy: 0.0885

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 64
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 200

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
| No log        | 1.0   | 8    | 2.6393          | 0.1239   |
| 2.6231        | 2.0   | 16   | 2.6391          | 0.1239   |
| 2.6382        | 3.0   | 24   | 2.6394          | 0.1239   |
| 2.6373        | 4.0   | 32   | 2.6409          | 0.0796   |
| 2.6421        | 5.0   | 40   | 2.6438          | 0.0619   |
| 2.6421        | 6.0   | 48   | 2.6447          | 0.0442   |
| 2.6388        | 7.0   | 56   | 2.6447          | 0.0265   |
| 2.6228        | 8.0   | 64   | 2.6457          | 0.0531   |
| 2.6305        | 9.0   | 72   | 2.6459          | 0.0442   |
| 2.6417        | 10.0  | 80   | 2.6500          | 0.0177   |
| 2.6417        | 11.0  | 88   | 2.6496          | 0.0354   |
| 2.6399        | 12.0  | 96   | 2.6453          | 0.0708   |
| 2.6355        | 13.0  | 104  | 2.6516          | 0.0354   |
| 2.652         | 14.0  | 112  | 2.6526          | 0.0796   |
| 2.6323        | 15.0  | 120  | 2.6592          | 0.0619   |
| 2.6323        | 16.0  | 128  | 2.6540          | 0.0619   |
| 2.6254        | 17.0  | 136  | 2.6519          | 0.0619   |
| 2.6377        | 18.0  | 144  | 2.6567          | 0.1150   |
| 2.6283        | 19.0  | 152  | 2.6649          | 0.0796   |
| 2.6192        | 20.0  | 160  | 2.6708          | 0.0796   |
| 2.6192        | 21.0  | 168  | 2.6700          | 0.0265   |
| 2.6289        | 22.0  | 176  | 2.6723          | 0.0177   |
| 2.6487        | 23.0  | 184  | 2.6700          | 0.0442   |
| 2.6324        | 24.0  | 192  | 2.6723          | 0.0265   |
| 2.6376        | 25.0  | 200  | 2.6639          | 0.0708   |
| 2.6376        | 26.0  | 208  | 2.6750          | 0.0177   |
| 2.6223        | 27.0  | 216  | 2.6837          | 0.0708   |
| 2.6323        | 28.0  | 224  | 2.6734          | 0.0796   |
| 2.6218        | 29.0  | 232  | 2.6737          | 0.0973   |
| 2.6231        | 30.0  | 240  | 2.6764          | 0.0708   |
| 2.6231        | 31.0  | 248  | 2.6793          | 0.0796   |
| 2.6228        | 32.0  | 256  | 2.6872          | 0.0442   |
| 2.6107        | 33.0  | 264  | 2.6816          | 0.0796   |
| 2.6078        | 34.0  | 272  | 2.6828          | 0.0796   |
| 2.6453        | 35.0  | 280  | 2.6746          | 0.0885   |
| 2.6453        | 36.0  | 288  | 2.6760          | 0.0885   |
| 2.6027        | 37.0  | 296  | 2.6885          | 0.0708   |
| 2.6179        | 38.0  | 304  | 2.6784          | 0.0973   |
| 2.5933        | 39.0  | 312  | 2.6808          | 0.0708   |
| 2.5909        | 40.0  | 320  | 2.6947          | 0.0796   |
| 2.5909        | 41.0  | 328  | 2.7123          | 0.0619   |
| 2.6179        | 42.0  | 336  | 2.7139          | 0.0619   |
| 2.5969        | 43.0  | 344  | 2.7160          | 0.0973   |
| 2.5966        | 44.0  | 352  | 2.7054          | 0.1062   |
| 2.6293        | 45.0  | 360  | 2.7260          | 0.0796   |
| 2.6293        | 46.0  | 368  | 2.6994          | 0.0973   |
| 2.6023        | 47.0  | 376  | 2.7039          | 0.0885   |
| 2.605         | 48.0  | 384  | 2.6680          | 0.0885   |
| 2.597         | 49.0  | 392  | 2.7001          | 0.0796   |
| 2.5936        | 50.0  | 400  | 2.7036          | 0.0796   |
| 2.5936        | 51.0  | 408  | 2.6866          | 0.0973   |
| 2.5823        | 52.0  | 416  | 2.7055          | 0.0973   |
| 2.5902        | 53.0  | 424  | 2.7130          | 0.0885   |
| 2.5793        | 54.0  | 432  | 2.7249          | 0.1062   |
| 2.5972        | 55.0  | 440  | 2.7253          | 0.1062   |
| 2.5972        | 56.0  | 448  | 2.6929          | 0.0885   |
| 2.5913        | 57.0  | 456  | 2.7252          | 0.0973   |
| 2.5937        | 58.0  | 464  | 2.7137          | 0.0796   |
| 2.5435        | 59.0  | 472  | 2.7252          | 0.0885   |
| 2.5475        | 60.0  | 480  | 2.7306          | 0.0708   |
| 2.5475        | 61.0  | 488  | 2.7158          | 0.0885   |
| 2.5591        | 62.0  | 496  | 2.7398          | 0.0531   |
| 2.6105        | 63.0  | 504  | 2.7323          | 0.0885   |
| 2.5593        | 64.0  | 512  | 2.7302          | 0.0885   |
| 2.574         | 65.0  | 520  | 2.7228          | 0.0973   |
| 2.574         | 66.0  | 528  | 2.7453          | 0.0885   |
| 2.549         | 67.0  | 536  | 2.7483          | 0.0796   |
| 2.543         | 68.0  | 544  | 2.7298          | 0.0531   |
| 2.5406        | 69.0  | 552  | 2.7341          | 0.0442   |
| 2.5245        | 70.0  | 560  | 2.7785          | 0.0708   |
| 2.5245        | 71.0  | 568  | 2.8005          | 0.0796   |
| 2.5764        | 72.0  | 576  | 2.7709          | 0.0708   |
| 2.529         | 73.0  | 584  | 2.7896          | 0.0796   |
| 2.5398        | 74.0  | 592  | 2.7806          | 0.0708   |
| 2.5436        | 75.0  | 600  | 2.7939          | 0.0796   |
| 2.5436        | 76.0  | 608  | 2.8015          | 0.0708   |
| 2.505         | 77.0  | 616  | 2.7643          | 0.0885   |
| 2.495         | 78.0  | 624  | 2.7971          | 0.0973   |
| 2.5473        | 79.0  | 632  | 2.8064          | 0.0796   |
| 2.5033        | 80.0  | 640  | 2.7837          | 0.0973   |
| 2.5033        | 81.0  | 648  | 2.7731          | 0.0885   |
| 2.5207        | 82.0  | 656  | 2.8325          | 0.0796   |
| 2.4956        | 83.0  | 664  | 2.7837          | 0.0885   |
| 2.494         | 84.0  | 672  | 2.8120          | 0.1150   |
| 2.4778        | 85.0  | 680  | 2.8099          | 0.0885   |
| 2.4778        | 86.0  | 688  | 2.7721          | 0.0885   |
| 2.4767        | 87.0  | 696  | 2.7981          | 0.1062   |
| 2.5287        | 88.0  | 704  | 2.8048          | 0.0531   |
| 2.4601        | 89.0  | 712  | 2.8174          | 0.0531   |
| 2.4073        | 90.0  | 720  | 2.8352          | 0.0708   |
| 2.4073        | 91.0  | 728  | 2.8099          | 0.0708   |
| 2.4156        | 92.0  | 736  | 2.8100          | 0.0973   |
| 2.4669        | 93.0  | 744  | 2.8282          | 0.0796   |
| 2.486         | 94.0  | 752  | 2.8443          | 0.0708   |
| 2.4439        | 95.0  | 760  | 2.8270          | 0.0796   |
| 2.4439        | 96.0  | 768  | 2.8432          | 0.0531   |
| 2.4477        | 97.0  | 776  | 2.8190          | 0.0885   |
| 2.4279        | 98.0  | 784  | 2.8173          | 0.0885   |
| 2.4116        | 99.0  | 792  | 2.8400          | 0.1150   |
| 2.3758        | 100.0 | 800  | 2.8620          | 0.0619   |
| 2.3758        | 101.0 | 808  | 2.8632          | 0.0442   |
| 2.4604        | 102.0 | 816  | 2.8518          | 0.0619   |
| 2.3987        | 103.0 | 824  | 2.8547          | 0.0354   |
| 2.3744        | 104.0 | 832  | 2.8221          | 0.0796   |
| 2.3797        | 105.0 | 840  | 2.8379          | 0.0531   |
| 2.3797        | 106.0 | 848  | 2.8498          | 0.0973   |
| 2.3711        | 107.0 | 856  | 2.8532          | 0.0796   |
| 2.3897        | 108.0 | 864  | 2.8078          | 0.1239   |
| 2.3108        | 109.0 | 872  | 2.8513          | 0.0885   |
| 2.2791        | 110.0 | 880  | 2.8794          | 0.1062   |
| 2.2791        | 111.0 | 888  | 2.8573          | 0.1062   |
| 2.3665        | 112.0 | 896  | 2.8454          | 0.1239   |
| 2.2993        | 113.0 | 904  | 2.8753          | 0.1062   |
| 2.3283        | 114.0 | 912  | 2.9077          | 0.1150   |
| 2.3286        | 115.0 | 920  | 2.9115          | 0.1150   |
| 2.3286        | 116.0 | 928  | 2.9227          | 0.0973   |
| 2.2489        | 117.0 | 936  | 2.9066          | 0.1062   |
| 2.2867        | 118.0 | 944  | 2.8912          | 0.0973   |
| 2.2914        | 119.0 | 952  | 2.9061          | 0.1239   |
| 2.2754        | 120.0 | 960  | 2.9024          | 0.1062   |
| 2.2754        | 121.0 | 968  | 2.9197          | 0.1062   |
| 2.2747        | 122.0 | 976  | 2.9232          | 0.0708   |
| 2.2423        | 123.0 | 984  | 2.9418          | 0.0973   |
| 2.2614        | 124.0 | 992  | 2.9615          | 0.0796   |
| 2.2761        | 125.0 | 1000 | 2.9344          | 0.1062   |
| 2.2761        | 126.0 | 1008 | 2.9412          | 0.0796   |
| 2.2377        | 127.0 | 1016 | 2.9950          | 0.1062   |
| 2.2496        | 128.0 | 1024 | 2.9659          | 0.1062   |
| 2.1857        | 129.0 | 1032 | 2.9819          | 0.1062   |
| 2.2464        | 130.0 | 1040 | 2.9840          | 0.1062   |
| 2.2464        | 131.0 | 1048 | 3.0030          | 0.0708   |
| 2.2035        | 132.0 | 1056 | 3.0148          | 0.0885   |
| 2.2497        | 133.0 | 1064 | 2.9930          | 0.0885   |
| 2.2877        | 134.0 | 1072 | 2.9949          | 0.0796   |
| 2.2939        | 135.0 | 1080 | 2.9780          | 0.0708   |
| 2.2939        | 136.0 | 1088 | 2.9763          | 0.0973   |
| 2.1982        | 137.0 | 1096 | 2.9887          | 0.0973   |
| 2.2871        | 138.0 | 1104 | 3.0152          | 0.0619   |
| 2.1358        | 139.0 | 1112 | 2.9990          | 0.0973   |
| 2.2026        | 140.0 | 1120 | 3.0051          | 0.0708   |
| 2.2026        | 141.0 | 1128 | 3.0082          | 0.0885   |
| 2.2605        | 142.0 | 1136 | 3.0037          | 0.0885   |
| 2.2208        | 143.0 | 1144 | 2.9893          | 0.0796   |
| 2.1251        | 144.0 | 1152 | 3.0048          | 0.0796   |
| 2.2273        | 145.0 | 1160 | 3.0431          | 0.0619   |
| 2.2273        | 146.0 | 1168 | 3.0515          | 0.0708   |
| 2.167         | 147.0 | 1176 | 3.0180          | 0.0708   |
| 2.0854        | 148.0 | 1184 | 3.0075          | 0.1062   |
| 2.1752        | 149.0 | 1192 | 3.0240          | 0.0973   |
| 2.0978        | 150.0 | 1200 | 3.0161          | 0.0885   |
| 2.0978        | 151.0 | 1208 | 3.0221          | 0.0885   |
| 2.2208        | 152.0 | 1216 | 3.0202          | 0.0796   |
| 2.0802        | 153.0 | 1224 | 3.0016          | 0.0708   |
| 2.1248        | 154.0 | 1232 | 3.0306          | 0.0796   |
| 2.0654        | 155.0 | 1240 | 3.0219          | 0.0885   |
| 2.0654        | 156.0 | 1248 | 3.0431          | 0.0885   |
| 2.0384        | 157.0 | 1256 | 2.9748          | 0.1062   |
| 2.24          | 158.0 | 1264 | 3.0428          | 0.1062   |
| 2.1095        | 159.0 | 1272 | 3.0469          | 0.0885   |
| 2.0334        | 160.0 | 1280 | 3.0766          | 0.0708   |
| 2.0334        | 161.0 | 1288 | 3.0622          | 0.0796   |
| 2.0276        | 162.0 | 1296 | 3.0810          | 0.0796   |
| 2.1454        | 163.0 | 1304 | 3.0658          | 0.0973   |
| 2.1115        | 164.0 | 1312 | 3.0959          | 0.0973   |
| 1.9748        | 165.0 | 1320 | 3.0532          | 0.1062   |
| 1.9748        | 166.0 | 1328 | 3.0925          | 0.0708   |
| 2.0136        | 167.0 | 1336 | 3.1021          | 0.0796   |
| 2.0998        | 168.0 | 1344 | 3.0993          | 0.0885   |
| 2.1276        | 169.0 | 1352 | 3.1212          | 0.0708   |
| 2.0504        | 170.0 | 1360 | 3.1114          | 0.0708   |
| 2.0504        | 171.0 | 1368 | 3.1104          | 0.0796   |
| 2.0975        | 172.0 | 1376 | 3.1190          | 0.0885   |
| 2.0216        | 173.0 | 1384 | 3.1361          | 0.0796   |
| 2.0501        | 174.0 | 1392 | 3.1312          | 0.0885   |
| 1.9737        | 175.0 | 1400 | 3.1344          | 0.0973   |
| 1.9737        | 176.0 | 1408 | 3.1300          | 0.0973   |
| 1.9742        | 177.0 | 1416 | 3.1306          | 0.0973   |
| 1.9977        | 178.0 | 1424 | 3.1490          | 0.0885   |
| 1.976         | 179.0 | 1432 | 3.1558          | 0.0973   |
| 2.0002        | 180.0 | 1440 | 3.1514          | 0.0973   |
| 2.0002        | 181.0 | 1448 | 3.1465          | 0.1062   |
| 2.004         | 182.0 | 1456 | 3.1450          | 0.1062   |
| 2.0281        | 183.0 | 1464 | 3.1352          | 0.1062   |
| 2.0258        | 184.0 | 1472 | 3.1503          | 0.1062   |
| 2.0263        | 185.0 | 1480 | 3.1394          | 0.0973   |
| 2.0263        | 186.0 | 1488 | 3.1274          | 0.1062   |
| 1.9759        | 187.0 | 1496 | 3.1319          | 0.1062   |
| 1.961         | 188.0 | 1504 | 3.1519          | 0.1062   |
| 2.0122        | 189.0 | 1512 | 3.1557          | 0.0973   |
| 2.0037        | 190.0 | 1520 | 3.1491          | 0.0885   |
| 2.0037        | 191.0 | 1528 | 3.1503          | 0.0885   |
| 1.9606        | 192.0 | 1536 | 3.1489          | 0.0885   |
| 1.9304        | 193.0 | 1544 | 3.1491          | 0.0885   |
| 2.0565        | 194.0 | 1552 | 3.1515          | 0.0973   |
| 2.0293        | 195.0 | 1560 | 3.1481          | 0.0885   |
| 2.0293        | 196.0 | 1568 | 3.1498          | 0.0885   |
| 2.0206        | 197.0 | 1576 | 3.1510          | 0.0885   |
| 1.9536        | 198.0 | 1584 | 3.1517          | 0.0885   |
| 2.0261        | 199.0 | 1592 | 3.1512          | 0.0885   |
| 2.1627        | 200.0 | 1600 | 3.1513          | 0.0885   |


### Framework versions

- Transformers 4.32.1
- Pytorch 2.1.2
- Datasets 2.12.0
- Tokenizers 0.13.2
