Update README.md
Browse files
README.md
CHANGED
|
@@ -44,7 +44,7 @@ For training data, we generate long contexts by augmenting [SlimPajama](https://
|
|
| 44 |
| Steps | 30 | 24 |
|
| 45 |
| Total Tokens | 63 M | 101 M |
|
| 46 |
| Learning Rate | 2.00E-05 | 2.00E-05 |
|
| 47 |
-
| # GPUs |
|
| 48 |
| GPU Type | NVIDIA L40S | NVIDIA L40S|
|
| 49 |
|
| 50 |
## The Gradient AI Team
|
|
|
|
| 44 |
| Steps | 30 | 24 |
|
| 45 |
| Total Tokens | 63 M | 101 M |
|
| 46 |
| Learning Rate | 2.00E-05 | 2.00E-05 |
|
| 47 |
+
| # GPUs | 8 | 32 |
|
| 48 |
| GPU Type | NVIDIA L40S | NVIDIA L40S|
|
| 49 |
|
| 50 |
## The Gradient AI Team
|