---
license: apache-2.0
base_model:
- meta-llama/Llama-3.1-8B-Instruct
---

LLaMA-3.1-8B Instruct model quantized to INT-4 using AutoGPTQ.