pytorch gpt2 en license:mit region:us
---
language: en
license: mit
library_name: pytorch
---
# Adversarial Training Through Iterations
Trainer Hyperparameters:
- `lr` = 5e-05
- `per_device_batch_size` = 8
- `gradient_accumulation_steps` = 2
- `weight_decay` = 1e-09
- `seed` = 42

Extended Logs:

|eval_loss|eval_accuracy|epoch|
|--|--|--|
|0.370|0.942|1.0|
|0.375|0.937|2.0|
|0.371|0.942|3.0|
|0.370|0.942|4.0|
|0.367|0.945|5.0|
|0.366|0.946|6.0|
|0.367|0.945|7.0|
|0.367|0.945|8.0|
|0.366|0.947|9.0|
