pytorch gpt2 en license:mit region:us
---
language: en
license: mit
library_name: pytorch
---
# Plainly Optimized Network
Dataset: GLUE

Trainer Hyperparameters:
- `lr` = 5e-05
- `per_device_batch_size` = 8
- `gradient_accumulation_steps` = 2
- `weight_decay` = 0.0
- `seed` = 42

|eval_loss|eval_accuracy|epoch|
|--|--|--|
|0.463|0.854|1.0|
|0.441|0.875|2.0|
