Update README.md
Browse files
README.md
CHANGED
@@ -6,4 +6,8 @@ license: llama2
|
|
6 |
|
7 |
**Finetuned over openhermes-2.5 dataset for 1 epoch**
|
8 |
|
9 |
-
- Follows the llama-3 instruction format described in https://llama.meta.com/docs/model-cards-and-prompt-formats/meta-llama-3
|
|
|
|
|
|
|
|
|
|
6 |
|
7 |
**Finetuned over openhermes-2.5 dataset for 1 epoch**
|
8 |
|
9 |
+
- Follows the llama-3 instruction format described in https://llama.meta.com/docs/model-cards-and-prompt-formats/meta-llama-3
|
10 |
+
|
11 |
+
**Training Details**
|
12 |
+
|
13 |
+
https://medium.com/@sumandas0/fine-tune-llama3-on-million-scale-dataset-in-consumer-gpu-using-qlora-deepspeed-3ae8ad75299a
|