CHIH-HUNG
/

llama-2-13b-dolphin_5w

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

CHIH-HUNG commited on Sep 6, 2023

Commit

67b6a02

·

1 Parent(s): cf1514f

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -14,6 +14,7 @@ datasets:
 - **model:** meta-llama/Llama-2-13b-hf
 - **dataset:** ehartford/dolphin (取前5w筆訓練集)
 - **peft_type:** LoRA
 - **lora_target:** q_proj, v_proj
 - **per_device_train_batch_size:** 8
 - **gradient_accumulation_steps:** 8

 - **model:** meta-llama/Llama-2-13b-hf
 - **dataset:** ehartford/dolphin (取前5w筆訓練集)
 - **peft_type:** LoRA
+- **lora_rank:** 8
 - **lora_target:** q_proj, v_proj
 - **per_device_train_batch_size:** 8
 - **gradient_accumulation_steps:** 8