Model Card for ME-MOE-7Bx2_test

Developed by : 메가스터디교육, 프리딕션, 마이스

Base Model : megastudyedu/ME-dpo-7B-v1.0

Expert Models : megastudyedu/ME-dpo-7B-v1.1, macadeliccc/WestLake-7B-v2-laser-truthy-dpo

Method : merge-kit을 활용하여 MOE를 구현했습니다.

-----------------------
ME-7B-v1.0 -> ME-dpo-7B-v1.0, ME-7B-v1.1 -> ME-dpo-7B-v1.1 로 수정했습니다.
{"language": ["ko"], "license": "cc-by-nc-nd-4.0", "tags": ["Mixture of experts"], "pipeline_tag": "text-generation"}
transformers safetensors mixtral text-generation Mixture of experts conversational ko license:cc-by-nc-nd-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us