File size: 312 Bytes
d0d7eaa
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
# openllama-3b

Basic full tune
```shell
accelerate launch scripts/finetune.py examples/qlora-openllama-3b/config.yml
```

LoRA
```shell
accelerate launch scripts/finetune.py examples/qlora-openllama-3b/lora.yml
```

QLoRA
```shell
accelerate launch scripts/finetune.py examples/qlora-openllama-3b/qlora.yml
```