Update README.md
Browse files
README.md
CHANGED
@@ -119,7 +119,7 @@ Alternatively, you can use NeMo Megatron training docker container with all depe
|
|
119 |
git clone https://github.com/NVIDIA/NeMo.git
|
120 |
cd NeMo/examples/nlp/language_modeling
|
121 |
git checkout v1.17.0
|
122 |
-
python megatron_gpt_eval.py gpt_model_file=LLAMA2-13B-SteerLM.nemo trainer.precision=
|
123 |
```
|
124 |
|
125 |
3. Send prompts to your model!
|
|
|
119 |
git clone https://github.com/NVIDIA/NeMo.git
|
120 |
cd NeMo/examples/nlp/language_modeling
|
121 |
git checkout v1.17.0
|
122 |
+
python megatron_gpt_eval.py gpt_model_file=LLAMA2-13B-SteerLM.nemo trainer.precision=16 server=True tensor_model_parallel_size=4 trainer.devices=1 pipeline_model_parallel_split_rank=0
|
123 |
```
|
124 |
|
125 |
3. Send prompts to your model!
|