# BigLiz 120B

<img src="https://cdn-uploads.huggingface.co/production/uploads/65a6db055c58475cf9e6def1/trbJntEb6rKJacv7XJYDK.png" width=600>

A Goliath-120b style frankenmerge of lzlv-70b and WinterGoddess-1.4x-70b.

# Prompting Format
Vicuna and Alpaca.

# Merge process
The models used in the merge are [lzlv-70b](https://huggingface.co/lizpreciatior/lzlv_70b_fp16_hf) and [WinterGoddess-1.4x-70b](https://huggingface.co/Sao10K/WinterGoddess-1.4x-70B-L2).

The layer mix:
```yaml
- range 0, 16
  lzlv
- range 8, 24
  WinterGoddess
- range 17, 32
  lzlv
- range 25, 40
  WinterGoddess
- range 33, 48
  lzlv
- range 41, 56
  WinterGoddess
- range 49, 64
  lzlv
- range 57, 72
  WinterGoddess
- range 65, 80
  lzlv
```

# Acknowledgements
[@lizpreciatior](https://huggingface.co/lizpreciatior) For creating lzlv

[@Sao10K](https://huggingface.co/Sao10K) For creating WinterGoddess

[@alpindale](https://huggingface.co/alpindale) For creating the original Goliath

[@chargoddard](https://huggingface.co/chargoddard) For developing [mergekit](https://github.com/cg123/mergekit).

{"language": ["en"], "license": "llama2", "tags": ["lzlv", "WinterGoddess", "frankenmerge", "120b"], "pipeline_tag": "conversational"}
transformers safetensors llama text-generation lzlv WinterGoddess frankenmerge 120b conversational en license:llama2 autotrain_compatible endpoints_compatible text-generation-inference region:us