---
base_model:
- meta-llama/Llama-3.2-1B-Instruct
---
EXL2 Quantizations of Llama-3.2-1B-Instruct

Using exllamav2 release 0.2.2 for quantization.

Original model: https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct

Bits 8.0, lm_head 6.0