Exllamav2 3.5bpw h6 quant for [Midnight-Rose-103B-v2.0.3](https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3).

Default calibration dataset.
{"language": ["en"], "license": "llama2", "tags": ["3.5bpw", "h6", "exl2"], "pipeline_tag": "conversational"}
transformers safetensors llama text-generation 3.5bpw h6 exl2 conversational en license:llama2 autotrain_compatible endpoints_compatible text-generation-inference region:us