Ostixe360 commited on
Commit
db809dd
·
verified ·
1 Parent(s): 995dee1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -55,7 +55,7 @@ The following hyperparameters were used during training:
55
  - train_batch_size: 20
56
  - eval_batch_size: 20
57
  - seed: 42
58
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
59
  - lr_scheduler_type: linear
60
  - lr_scheduler_warmup_ratio: 0.1
61
  - num_epochs: 10
 
55
  - train_batch_size: 20
56
  - eval_batch_size: 20
57
  - seed: 42
58
+ - optimizer: Adam-8bits with betas=(0.9,0.999) and epsilon=1e-08
59
  - lr_scheduler_type: linear
60
  - lr_scheduler_warmup_ratio: 0.1
61
  - num_epochs: 10