transformers safetensors llama text-generation 3.5bpw h6 exl2 conversational en license:llama2 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: llama2
language:
- en
pipeline_tag: conversational
tags:
- 3.5bpw
- h6
- exl2
---
Exllamav2 3.5bpw h6 quant for [Midnight-Rose-103B-v2.0.3](https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3).

Default calibration dataset.