Fix inference command
Browse files
README.md
CHANGED
@@ -37,7 +37,7 @@ accelerate config
|
|
37 |
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml
|
38 |
|
39 |
# inference
|
40 |
-
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml --inference
|
41 |
```
|
42 |
|
43 |
## Installation
|
|
|
37 |
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml
|
38 |
|
39 |
# inference
|
40 |
+
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml --inference --lora_model_dir="./llama-7b-lora-int4"
|
41 |
```
|
42 |
|
43 |
## Installation
|