justanotherinternetguy
commited on
End of training
Browse files
README.md
CHANGED
@@ -6,6 +6,8 @@ license: apache-2.0
|
|
6 |
base_model: openai/whisper-small
|
7 |
tags:
|
8 |
- generated_from_trainer
|
|
|
|
|
9 |
model-index:
|
10 |
- name: Whisper-Small Augmented for SEP-28k
|
11 |
results: []
|
@@ -17,6 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
|
|
17 |
# Whisper-Small Augmented for SEP-28k
|
18 |
|
19 |
This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the SEP-28K dataset.
|
|
|
|
|
|
|
20 |
|
21 |
## Model description
|
22 |
|
@@ -42,9 +47,20 @@ The following hyperparameters were used during training:
|
|
42 |
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
43 |
- lr_scheduler_type: linear
|
44 |
- lr_scheduler_warmup_steps: 500
|
45 |
-
- training_steps:
|
46 |
- mixed_precision_training: Native AMP
|
47 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
48 |
### Framework versions
|
49 |
|
50 |
- Transformers 4.47.1
|
|
|
6 |
base_model: openai/whisper-small
|
7 |
tags:
|
8 |
- generated_from_trainer
|
9 |
+
metrics:
|
10 |
+
- wer
|
11 |
model-index:
|
12 |
- name: Whisper-Small Augmented for SEP-28k
|
13 |
results: []
|
|
|
19 |
# Whisper-Small Augmented for SEP-28k
|
20 |
|
21 |
This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the SEP-28K dataset.
|
22 |
+
It achieves the following results on the evaluation set:
|
23 |
+
- Loss: 0.7265
|
24 |
+
- Wer: 13.7591
|
25 |
|
26 |
## Model description
|
27 |
|
|
|
47 |
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
48 |
- lr_scheduler_type: linear
|
49 |
- lr_scheduler_warmup_steps: 500
|
50 |
+
- training_steps: 5910
|
51 |
- mixed_precision_training: Native AMP
|
52 |
|
53 |
+
### Training results
|
54 |
+
|
55 |
+
| Training Loss | Epoch | Step | Validation Loss | Wer |
|
56 |
+
|:-------------:|:-------:|:----:|:---------------:|:-------:|
|
57 |
+
| 0.0229 | 5.1020 | 1000 | 0.5061 | 13.5547 |
|
58 |
+
| 0.0018 | 10.2041 | 2000 | 0.6259 | 13.6204 |
|
59 |
+
| 0.0006 | 15.3061 | 3000 | 0.6754 | 13.6496 |
|
60 |
+
| 0.0005 | 20.4082 | 4000 | 0.7105 | 13.7007 |
|
61 |
+
| 0.0004 | 25.5102 | 5000 | 0.7265 | 13.7591 |
|
62 |
+
|
63 |
+
|
64 |
### Framework versions
|
65 |
|
66 |
- Transformers 4.47.1
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 966995080
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:643c5dadb80e8a6d6af10a640c3d6528a528792a7590f654b75edfedcfd4f3ad
|
3 |
size 966995080
|
runs/Dec28_15-27-04_alien/events.out.tfevents.1735417625.alien.5308.0
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3dfcd9490257a65baf64474879b52cbd42e9fd605c403f2984652f412a152fb2
|
3 |
+
size 58539
|