
# AIFT-42dot-LLM-PLM-1.3B-ao-instruct-all-v0.3

베이스 모델 : 42dot/42dot_LLM-PLM-1.3B

학습 데이터 : 자체 제작한 Open Orca 스타일 데이터셋 약 29,000건

학습 방법 : Lora

Lora Config
 - lora_alpha: 16
 - lora_dropout: 0.05,
 - r: 8

## ko-lm-evaluation-harness(0-shot)

|kobest_boolq|kobest_copa|kobest_hellaswag|kobest_sentineg|kohatespeech|kohatespeech_apeach|kohatespeech_gen_bias|korunsmile|nsmc|pawsx_ko|
|--|--|--|--|--|--|--|--|--|--|
|0.5021367521367521|0.704|0.438|0.7732997481108312|0.3099787685774947|0.5098143236074271|0.14225053078556263|0.36599467230730043|0.6495|0.529|
{"license": "cc-by-nc-4.0"}
transformers safetensors llama text-generation license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us