Nbeau commited on
Commit
d4dd6bf
·
verified ·
1 Parent(s): a831a48

End of training

Browse files
Files changed (3) hide show
  1. README.md +6 -6
  2. generation_config.json +1 -0
  3. model.safetensors +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.0734
19
 
20
  ## Model description
21
 
@@ -49,11 +49,11 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:-----:|:----:|:---------------:|
52
- | 0.4809 | 1.0 | 125 | 0.3920 |
53
- | 0.1042 | 2.0 | 250 | 0.0983 |
54
- | 0.0846 | 3.0 | 375 | 0.0799 |
55
- | 0.0761 | 4.0 | 500 | 0.0739 |
56
- | 0.0763 | 5.0 | 625 | 0.0734 |
57
 
58
 
59
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.0733
19
 
20
  ## Model description
21
 
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:-----:|:----:|:---------------:|
52
+ | 0.415 | 1.0 | 125 | 0.2445 |
53
+ | 0.208 | 2.0 | 250 | 0.1095 |
54
+ | 0.0874 | 3.0 | 375 | 0.0823 |
55
+ | 0.081 | 4.0 | 500 | 0.0763 |
56
+ | 0.0776 | 5.0 | 625 | 0.0733 |
57
 
58
 
59
  ### Framework versions
generation_config.json CHANGED
@@ -2,5 +2,6 @@
2
  "_from_model_config": true,
3
  "bos_token_id": 1,
4
  "eos_token_id": 2,
 
5
  "transformers_version": "4.40.2"
6
  }
 
2
  "_from_model_config": true,
3
  "bos_token_id": 1,
4
  "eos_token_id": 2,
5
+ "pad_token_id": 2,
6
  "transformers_version": "4.40.2"
7
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:14c8259e26908cb180499b9426569f2a8683566f6e0bc6ffd929130c6a29c6a9
3
  size 441688704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f38e91e32aea93395b57345800547828f41753e8a2aa442a956ae7674953cbf
3
  size 441688704