
# codellama 34b mega merge

The following were merged with DARE using [https://github.com/martyn/safetensors-merge-supermario](https://github.com/martyn/safetensors-merge-supermario)

## Mergelist


```
codellama/CodeLlama-34b-hf
codellama/CodeLlama-34b-Instruct-hf
allenai/codetulu-2-34b
Phind/Phind-CodeLlama-34B-v1
Phind/Phind-CodeLlama-34B-Python-v1
uukuguy/speechless-codellama-34b-v2.0
codellama/CodeLlama-34b-Python-hf
Phind/Phind-CodeLlama-34B-v2
```

These models failed to merge:
```
pharaouk/unnatural_codellama_34B
codefuse-ai/CodeFuse-CodeLlama-34B
XAgentTeam/XAgentLLaMa-34B-preview
```

## Merge command

```
python3 hf_merge.py codellama.txt codellama -p 0.16 -lambda 2
```

{"language": ["en"], "license": "llama2", "tags": ["dare", "super mario merge", "pytorch", "llama", "codellama", "merge"], "pipeline_tag": "text-generation", "inference": false}
transformers pytorch safetensors llama text-generation dare super mario merge codellama merge en license:llama2 autotrain_compatible text-generation-inference region:us