
# llama 13b mega merge

The following were merged with hyperparams `p=0.1` and `lambda=2`.

The first entry is the base model.

```
meta-llama/Llama-2-13b-hf
ajibawa-2023/Code-13B
migtissera/Synthia-13B
meta-math/MetaMath-13B-V1.0
FPHam/Sydney_Overthinker_13b_HF
allenai/tulu-2-dpo-13b
ajibawa-2023/Python-Code-13B
Doctor-Shotgun/cat-v1.0-13b
NeverSleep/Noromaid-13b-v0.1.1
```

Using [https://github.com/martyn/safetensors-merge-supermario](https://github.com/martyn/safetensors-merge-supermario)
{"language": ["en"], "license": "llama2", "tags": ["dare", "super mario merge", "pytorch", "llama", "llama-2", "merge"], "pipeline_tag": "text-generation", "inference": false}
transformers pytorch safetensors llama text-generation dare super mario merge llama-2 merge en license:llama2 autotrain_compatible text-generation-inference region:us