GGUFs for Aqueducts 18B - https://huggingface.co/MarsupialAI/Aqueducts-18B

iMatrix generated with Kalomaze's groups_merged.txt

Downloads last month
114
GGUF
Model size
17.7B params
Architecture
llama
Inference API
Unable to determine this model's library. Check the docs .

Model tree for MarsupialAI/Aqueducts-18B_iMatrix_GGUF

Quantized
(24)
this model