Training in progress epoch 0

README.md

@@ -14,9 +14,9 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [madatnlp/sk-kogptv2-kormath-causal](https://huggingface.co/madatnlp/sk-kogptv2-kormath-causal) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 0.2783
-- Validation Loss: 1.9583
-- Epoch: 24
+- Train Loss: 2.0777
+- Validation Loss: 1.5042
+- Epoch: 0
 
 ## Model description
 
@@ -35,38 +35,14 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- optimizer: {'name': 'Adam', 'learning_rate': 0.0005777778, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
+- optimizer: {'name': 'Adam', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
 - training_precision: float32
 
 ### Training results
 
 | Train Loss | Validation Loss | Epoch |
 |:----------:|:---------------:|:-----:|
-| 3.6295     | 2.2711          | 0     |
-| 1.8784     | 1.7125          | 1     |
-| 1.6000     | 1.6337          | 2     |
-| 1.3763     | 1.3521          | 3     |
-| 1.1877     | 1.2265          | 4     |
-| 1.0326     | 1.2537          | 5     |
-| 0.9588     | 1.3880          | 6     |
-| 0.8697     | 1.4052          | 7     |
-| 0.7819     | 1.2593          | 8     |
-| 0.7058     | 1.4996          | 9     |
-| 0.7005     | 1.5219          | 10    |
-| 0.6360     | 1.3806          | 11    |
-| 0.5840     | 1.3250          | 12    |
-| 0.5214     | 1.4015          | 13    |
-| 0.5336     | 1.4069          | 14    |
-| 0.4560     | 1.4785          | 15    |
-| 0.4384     | 1.5539          | 16    |
-| 0.4137     | 1.3971          | 17    |
-| 0.3985     | 1.6061          | 18    |
-| 0.3874     | 1.5328          | 19    |
-| 0.3389     | 1.5204          | 20    |
-| 0.3212     | 1.6929          | 21    |
-| 0.3282     | 1.4923          | 22    |
-| 0.2956     | 1.5278          | 23    |
-| 0.2783     | 1.9583          | 24    |
+| 2.0777     | 1.5042          | 0     |
 
 
 ### Framework versions

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f7f987fabf1a8153d98a43aa8b032a51f28b3bc7de1629960090e1a8c621369e
+oid sha256:9f13b0f827477903c5e5510d200b2a5347aa55897d12a523771bdfa20764624f
 size 500847720