Update README.md
Browse files
README.md
CHANGED
|
@@ -149,7 +149,7 @@ Temperature Sampling to upsample low resource languages. We used a temperature o
|
|
| 149 |
|
| 150 |
#### Training Hyperparameters
|
| 151 |
|
| 152 |
-
|
| 153 |
+ Training steps - 1M steps
|
| 154 |
+ Warm - 10k steps
|
| 155 |
+ Learning Rate - 5e-4
|
|
|
|
| 149 |
|
| 150 |
#### Training Hyperparameters
|
| 151 |
|
| 152 |
+
**Training regime**
|
| 153 |
+ Training steps - 1M steps
|
| 154 |
+ Warm - 10k steps
|
| 155 |
+ Learning Rate - 5e-4
|