File size: 386 Bytes
30d1ce2 6f4076b 30d1ce2 0d905cc 30d1ce2 41b4c16 |
1 2 3 4 5 6 7 8 9 10 11 12 13 |
---
datasets:
- teknium/OpenHermes-2.5
license: llama2
---
**Finetuned over openhermes-2.5 dataset for 1 epoch**
- Follows the llama-3 instruction format described in https://llama.meta.com/docs/model-cards-and-prompt-formats/meta-llama-3
**Training Details**
https://medium.com/@sumandas0/fine-tune-llama3-on-million-scale-dataset-in-consumer-gpu-using-qlora-deepspeed-3ae8ad75299a |