transformers safetensors llama text-generation merge conversational license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
tags:
- merge
license: apache-2.0
---
quant of [TeeZee's](https://huggingface.co/TeeZee) [Kyllene-34B-v1.1](https://huggingface.co/TeeZee/Kyllene-34B-v1.1)

```
python3 convert.py \
    -i /input/TeeZee_Kyllene-34B-v1.1/ \
    -c /input/worldbuild/0000.parquet \
    -o /output/temp/ \
    -cf /output/Kyllene-34B-v1.1-4bpw-h6-exl2/ \
    -l 8192 \
    -ml 8192 \
    -b 4 \
    -hb 6
```