Nbeau commited on
Commit
69fe890
·
verified ·
1 Parent(s): 7d93258

End of training

Browse files
Files changed (2) hide show
  1. README.md +8 -8
  2. model.safetensors +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.1254
19
 
20
  ## Model description
21
 
@@ -34,7 +34,7 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 0.0005
38
  - train_batch_size: 8
39
  - eval_batch_size: 8
40
  - seed: 42
@@ -49,12 +49,12 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:-----:|:----:|:---------------:|
52
- | 0.144 | 1.0 | 125 | 0.1199 |
53
- | 0.0896 | 2.0 | 250 | 0.0838 |
54
- | 0.0861 | 3.0 | 375 | 0.0792 |
55
- | 0.0781 | 4.0 | 500 | 0.0739 |
56
- | 0.0772 | 5.0 | 625 | 0.0753 |
57
- | 0.1549 | 6.0 | 750 | 0.1254 |
58
 
59
 
60
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.0721
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 0.0003
38
  - train_batch_size: 8
39
  - eval_batch_size: 8
40
  - seed: 42
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:-----:|:----:|:---------------:|
52
+ | 0.116 | 1.0 | 125 | 0.1085 |
53
+ | 0.0825 | 2.0 | 250 | 0.0801 |
54
+ | 0.0745 | 3.0 | 375 | 0.0740 |
55
+ | 0.0733 | 4.0 | 500 | 0.0724 |
56
+ | 0.7246 | 5.0 | 625 | 0.1426 |
57
+ | 0.0726 | 6.0 | 750 | 0.0721 |
58
 
59
 
60
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dbdb8dc88e0b4caeb48589ba49a29b7cb34d311cca5d8372ddca1d6350a418d4
3
  size 441691776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81963922ff20372b3f0c69b59c353503b37e53e33f4914d294dde8df931ecab2
3
  size 441691776