transformers safetensors llama text-generation 4.0bpw h8 exl2 conversational en license:llama2 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: llama2
language:
- en
pipeline_tag: conversational
tags:
- 4.0bpw
- h8
- exl2
---
Exllamav2 4.0bpw h8 quant for [BigWeave-v12-90b](https://huggingface.co/llmixer/BigWeave-v12-90b).

Calibration dataset: [llmixer/20k_random_data](https://huggingface.co/datasets/llmixer/20k_random_data)
