
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# distil-ast-audioset-covid-20231105-tb-2968225-tb-2968225c-w-1-2-e-10-bs-8-encoder-frozen-lr-5e-5

This model is a fine-tuned version of [audiblehealthai/distil-ast-audioset-covid-20231105-tb-2968225](https://huggingface.co/audiblehealthai/distil-ast-audioset-covid-20231105-tb-2968225) on the audiblehealthai/tb-2968225 dataset.
It achieves the following results on the evaluation set:
- Loss: 0.6467
- Best F1: 0.4502
- Best Thr: 0.2773
- Ppa: 0.7542
- Npa: 0.4256
- Prob Mean: 0.3630
- Prob Std: 0.2003
- Prob Skewness: 0.2352
- Prob Kurtosis: -0.8658
- Pr Auc: 0.3978
- Roc Auc: 0.6270
- Accuracy: 0.5123
- F1: 0.4492
- Precision: 0.3199
- Recall: 0.7542

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- gradient_accumulation_steps: 8
- total_train_batch_size: 128
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 10
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step | Validation Loss | Best F1 | Best Thr | Ppa    | Npa    | Prob Mean | Prob Std | Prob Skewness | Prob Kurtosis | Pr Auc | Roc Auc | Accuracy | F1     | Precision | Recall |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:--------:|:------:|:------:|:---------:|:--------:|:-------------:|:-------------:|:------:|:-------:|:--------:|:------:|:---------:|:------:|
| 0.5559        | 0.99  | 79   | 0.6440          | 0.4468  | 0.3667   | 0.6653 | 0.5281 | 0.3860    | 0.1864   | 0.0849        | -0.8493       | 0.4007 | 0.6273  | 0.5642   | 0.4460 | 0.3355    | 0.6653 |
| 0.6009        | 1.98  | 158  | 0.6375          | 0.4473  | 0.3115   | 0.6949 | 0.4917 | 0.3569    | 0.1838   | 0.2304        | -0.7896       | 0.3954 | 0.6255  | 0.5453   | 0.4463 | 0.3287    | 0.6949 |
| 0.5863        | 2.96  | 237  | 0.6501          | 0.4495  | 0.3240   | 0.7373 | 0.4446 | 0.3918    | 0.1960   | 0.0918        | -0.8965       | 0.4006 | 0.6282  | 0.5218   | 0.4485 | 0.3222    | 0.7373 |
| 0.5417        | 3.95  | 316  | 0.6481          | 0.4520  | 0.3167   | 0.7309 | 0.4590 | 0.3818    | 0.1996   | 0.1481        | -0.8979       | 0.4016 | 0.6289  | 0.5307   | 0.4510 | 0.3261    | 0.7309 |
| 0.5946        | 4.94  | 395  | 0.6547          | 0.4487  | 0.2837   | 0.7479 | 0.4294 | 0.3743    | 0.2070   | 0.1937        | -0.9169       | 0.3986 | 0.6257  | 0.5134   | 0.4477 | 0.3195    | 0.7479 |
| 0.5303        | 5.92  | 474  | 0.6467          | 0.4502  | 0.2773   | 0.7542 | 0.4256 | 0.3630    | 0.2003   | 0.2352        | -0.8658       | 0.3978 | 0.6270  | 0.5123   | 0.4492 | 0.3199    | 0.7542 |
| 0.5366        | 6.91  | 553  | 0.6499          | 0.4560  | 0.3159   | 0.7331 | 0.4666 | 0.3831    | 0.2047   | 0.1675        | -0.9172       | 0.4000 | 0.6291  | 0.5369   | 0.4550 | 0.3298    | 0.7331 |
| 0.5387        | 7.9   | 632  | 0.6533          | 0.4515  | 0.2859   | 0.7373 | 0.4499 | 0.3696    | 0.2085   | 0.2215        | -0.9154       | 0.3999 | 0.6279  | 0.5257   | 0.4505 | 0.3243    | 0.7373 |
| 0.5195        | 8.89  | 711  | 0.6565          | 0.4532  | 0.2974   | 0.7415 | 0.4492 | 0.3801    | 0.2113   | 0.1905        | -0.9379       | 0.3997 | 0.6280  | 0.5263   | 0.4522 | 0.3253    | 0.7415 |


### Framework versions

- Transformers 4.29.2
- Pytorch 2.0.1+cu117
- Datasets 2.12.0
- Tokenizers 0.13.3

{"license": "apache-2.0", "tags": ["audio-classification", "generated_from_trainer"], "metrics": ["accuracy", "f1", "precision", "recall"], "model-index": [{"name": "distil-ast-audioset-covid-20231105-tb-2968225-tb-2968225c-w-1-2-e-10-bs-8-encoder-frozen-lr-5e-5", "results": []}]}
transformers pytorch audio-spectrogram-transformer audio-classification generated_from_trainer license:apache-2.0 endpoints_compatible region:us