
This is a 4-bit quantization of [Aurelian v0.1alpha 70B 32K](https://huggingface.co/grimulkan/aurelian-alpha0.1-70b-rope8-32K-fp16) for testing & feedback. See that page for more details.

This quantization fits in 2x24GB (19/24) using Exllamav2 @ 16K context.
{"license": "unknown"}
transformers llama text-generation license:unknown autotrain_compatible endpoints_compatible text-generation-inference region:us