Update README.md
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ base_model:
|
|
18 |
library_name: transformers
|
19 |
---
|
20 |
|
21 |
-
This model is a fine-tuned version of **Llama-3-8B** using **QLoRA** (Quantized Low-Rank Adaptation) methodology. The training was implemented using DeepSpeed framework enhanced with FlashAttention 2 for optimal performance and memory efficiency.
|
22 |
|
23 |
## Training Details
|
24 |
- Base Model: Llama-3-8B
|
|
|
18 |
library_name: transformers
|
19 |
---
|
20 |
|
21 |
+
This alphaca like model is a fine-tuned version of **Llama-3-8B** using **QLoRA** (Quantized Low-Rank Adaptation) methodology. The training was implemented using DeepSpeed framework enhanced with FlashAttention 2 for optimal performance and memory efficiency.
|
22 |
|
23 |
## Training Details
|
24 |
- Base Model: Llama-3-8B
|