instruction-pretrain
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -107,7 +107,7 @@ for index, pair in enumerate(instruction_response_pairs):
|
|
107 |
</details>
|
108 |
|
109 |
### 2. Advanced Usage: Convert Raw Corpora into Instruction-Augmented Corpora at Scale
|
110 |
-
We use vLLM to accelerate the synthesis process. On a single A100-80GB GPU, it takes about
|
111 |
|
112 |
<details>
|
113 |
<summary> Click to expand </summary>
|
|
|
107 |
</details>
|
108 |
|
109 |
### 2. Advanced Usage: Convert Raw Corpora into Instruction-Augmented Corpora at Scale
|
110 |
+
We use vLLM to accelerate the synthesis process. On a single A100-80GB GPU, it takes about 1 day to synthesize instruction-response pairs for 1 billion tokens of raw corpora.
|
111 |
|
112 |
<details>
|
113 |
<summary> Click to expand </summary>
|