mergekit-dare_ties-psqsabe / mergekit_config.yml
chargoddard's picture
Upload folder using huggingface_hub
12bee3a verified
raw
history blame contribute delete
451 Bytes
models:
- model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
parameters:
density: [0.00, 0.00, 0.15, 0.75, 1.00]
weight: [0.00, 0.00, 0.15, 0.75, 0.90]
- model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
parameters:
density: [0.00, 0.00, 1.00, 0.50, 0.00]
weight: [0.00, 0.00, 0.75, 0.35, 0.00]
merge_method: dare_ties
base_model: unsloth/Llama-3.3-70B-Instruct
parameters:
normalize: true
int8_mask: true
dtype: float16