transformers safetensors llama text-generation base_model:Mihaiii/Pallas-0.5-LASER-0.5 license:other autotrain_compatible text-generation-inference region:us
---
base_model: Mihaiii/Pallas-0.5-LASER-0.5
inference: false
license: other
license_name: yi-license
license_link: https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE
metrics:
- accuracy
---
quant of [Mihaiii's](https://huggingface.co/Mihaiii) [Pallas-0.5-LASER-0.6](https://huggingface.co/Mihaiii/Pallas-0.5-LASER-0.6)

```
python3 convert.py \
    -i /input/Mihaiii_Pallas-0.5-LASER-0.6/ \
    -c /input/pippa_cleaned/0000.parquet \
    -o /output/temp/ \
    -cf /output/Pallas-0.5-LASER-0.6-4.65bpw-h6-exl2/ \
    -l 8192 \
    -ml 8192 \
    -b 4.65 \
    -hb 6
```