merge mergekit lazymergekit danish-foundation-models/munin-7b-alpha timpal0l/Mistral-7B-v0.1-flashback-v2 NbAiLab/nb-sau-7b-4k-step100k license:apache-2.0 region:us
---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- danish-foundation-models/munin-7b-alpha
- timpal0l/Mistral-7B-v0.1-flashback-v2
- NbAiLab/nb-sau-7b-4k-step100k
---

# NordicMIS-v1.0-dareties

NordicMIS-v1.0-dareties is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
* [danish-foundation-models/munin-7b-alpha](https://huggingface.co/danish-foundation-models/munin-7b-alpha)
* [timpal0l/Mistral-7B-v0.1-flashback-v2](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2)
* [NbAiLab/nb-sau-7b-4k-step100k](https://huggingface.co/NbAiLab/nb-sau-7b-4k-step100k)

## 🧩 Configuration

\```yaml
models:
  - model: mistralai/Mistral-7B-v0.1
    # No parameters necessary for base model
  - model: danish-foundation-models/munin-7b-alpha
    parameters:
      density: 0.53
      weight: 0.5
  - model: timpal0l/Mistral-7B-v0.1-flashback-v2
    parameters:
      density: 0.53
      weight: 0.3
  - model: NbAiLab/nb-sau-7b-4k-step100k
    parameters:
      density: 0.53
      weight: 0.2
merge_method: dare_ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
  int8_mask: true
dtype: bfloat16
\```