
# etri-xainlp/llama2-13b-sft-dpo

## Model Details

**Model Developers** ETRI xainlp team

**Input** text only.

**Output** text only.

**Model Architecture**  

**Base Model**  [meta-llama/Llama-13b-hf](https://huggingface.co/meta-llama/Llama-2-13b-hf)  

**Training Dataset**  

 - fully sft: 6500k instruction-following set
   
 - dpo+lora: 90k user preference set

 - We use A100 GPU 80GB * 8, when training.

{"license": "apache-2.0"}
transformers safetensors llama text-generation license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us