rowjak commited on
Commit
341f3f2
·
verified ·
1 Parent(s): f302a2f

End of training

Browse files
Files changed (2) hide show
  1. README.md +99 -0
  2. model.safetensors +1 -1
README.md ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: facebook/wav2vec2-base
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - minds14
9
+ metrics:
10
+ - wer
11
+ model-index:
12
+ - name: wav2vec2-minds14-en
13
+ results:
14
+ - task:
15
+ name: Automatic Speech Recognition
16
+ type: automatic-speech-recognition
17
+ dataset:
18
+ name: minds14
19
+ type: minds14
20
+ config: en-US
21
+ split: None
22
+ args: en-US
23
+ metrics:
24
+ - name: Wer
25
+ type: wer
26
+ value: 1.0
27
+ ---
28
+
29
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
+ should probably proofread and complete it, then remove this comment. -->
31
+
32
+ # wav2vec2-minds14-en
33
+
34
+ This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the minds14 dataset.
35
+ It achieves the following results on the evaluation set:
36
+ - Loss: 5.5729
37
+ - Wer: 1.0
38
+
39
+ ## Model description
40
+
41
+ More information needed
42
+
43
+ ## Intended uses & limitations
44
+
45
+ More information needed
46
+
47
+ ## Training and evaluation data
48
+
49
+ More information needed
50
+
51
+ ## Training procedure
52
+
53
+ ### Training hyperparameters
54
+
55
+ The following hyperparameters were used during training:
56
+ - learning_rate: 1e-05
57
+ - train_batch_size: 8
58
+ - eval_batch_size: 8
59
+ - seed: 42
60
+ - gradient_accumulation_steps: 2
61
+ - total_train_batch_size: 16
62
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
63
+ - lr_scheduler_type: linear
64
+ - lr_scheduler_warmup_steps: 500
65
+ - training_steps: 2000
66
+ - mixed_precision_training: Native AMP
67
+
68
+ ### Training results
69
+
70
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
71
+ |:-------------:|:-------:|:----:|:---------------:|:------:|
72
+ | 5.3811 | 3.5088 | 100 | 6.8598 | 1.0006 |
73
+ | 4.9442 | 7.0175 | 200 | 6.6217 | 1.0018 |
74
+ | 4.6255 | 10.5263 | 300 | 6.2050 | 1.0 |
75
+ | 4.4037 | 14.0351 | 400 | 6.1160 | 1.0 |
76
+ | 4.1672 | 17.5439 | 500 | 5.7863 | 1.0 |
77
+ | 3.8786 | 21.0526 | 600 | 5.6219 | 1.0 |
78
+ | 3.6182 | 24.5614 | 700 | 5.4987 | 1.0 |
79
+ | 3.654 | 28.0702 | 800 | 5.6024 | 1.0 |
80
+ | 3.4135 | 31.5789 | 900 | 5.5648 | 1.0 |
81
+ | 3.3532 | 35.0877 | 1000 | 5.6507 | 1.0 |
82
+ | 3.344 | 38.5965 | 1100 | 5.5189 | 1.0 |
83
+ | 3.3233 | 42.1053 | 1200 | 5.6830 | 1.0 |
84
+ | 3.3983 | 45.6140 | 1300 | 5.5447 | 1.0 |
85
+ | 3.2433 | 49.1228 | 1400 | 5.5065 | 1.0 |
86
+ | 3.2082 | 52.6316 | 1500 | 5.4783 | 1.0 |
87
+ | 3.1958 | 56.1404 | 1600 | 5.5747 | 1.0 |
88
+ | 3.1756 | 59.6491 | 1700 | 5.5580 | 1.0 |
89
+ | 3.1757 | 63.1579 | 1800 | 5.5556 | 1.0 |
90
+ | 3.1758 | 66.6667 | 1900 | 5.6747 | 1.0 |
91
+ | 3.1373 | 70.1754 | 2000 | 5.5729 | 1.0 |
92
+
93
+
94
+ ### Framework versions
95
+
96
+ - Transformers 4.44.2
97
+ - Pytorch 2.5.0+cu121
98
+ - Datasets 3.1.0
99
+ - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bf0b7634712115b2183d18321c3cef78e5b310372097c214a6feb45db9219e05
3
  size 377611120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b48e59c6cc01eb646f897d095a352e172244a44ecd052a42091169ebba720694
3
  size 377611120