phi-merge-arithmetic

phi-merge-arithmetic is a merge of the following models using mergekit:

• microsoft/Phi-3.5-mini-instruct
• microsoft/Phi-3-mini-4k-instruct
• microsoft/Phi-3-mini-128k-instruct

🧩 Configuration

models:
  - model: microsoft/Phi-3.5-mini-instruct
    parameters:
      weight: 1.0
  - model: microsoft/Phi-3-mini-4k-instruct
    parameters: 
      weight: 0.6
  - model: microsoft/Phi-3-mini-128k-instruct
    parameters: 
      weight: 0.2
base_model: microsoft/Phi-3.5-mini-instruct
merge_method: task_arithmetic
dtype: float16