Boreas-10.7B-step1 / mergekit_config.yml
yhavinga's picture
Upload folder using huggingface_hub
d8ccede verified
raw
history blame contribute delete
332 Bytes
slices:
- sources:
- model: boreas-7b-0-16
layer_range: [0, 16]
- sources:
- model: boreas-7b-0-8-16-24
layer_range: [0, 8]
- sources:
- model: boreas-7b-8-16-24-32
layer_range: [0, 8]
- sources:
- model: boreas-7b-16-32
layer_range: [0, 16]
merge_method: passthrough
dtype: bfloat16