Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

9,116

Full-text search

Active filters: imatrix

mradermacher/kainaticulous-rp-7b-i1-GGUF

Updated Sep 8, 2024 • 229 • 2

backyardai/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 30, 2024 • 133 • 2

bartowski/c4ai-command-r-plus-08-2024-GGUF

Text Generation • Updated Aug 30, 2024 • 2.38k • 18

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31, 2024 • 102 • 6

Ffftdtd5dtft/Hermes-3-Llama-3.1-8B-IQ1_S-GGUF

Updated Sep 4, 2024 • 33 • 1

bartowski/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 5.13k • 31

NeoChen1024/dolphin-2.7-mixtral-8x7b-GGUF-IQ3_M

Updated Sep 17, 2024 • 6 • 1

mradermacher/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power-i1-GGUF

Updated Sep 19, 2024 • 15 • 2

v000000/L3.1-Niitorm-8B-DPO-t0.0001-GGUFs-IMATRIX

Updated Oct 6, 2024 • 44 • 4

mradermacher/L3.1-Niitorm-8B-DPO-t0.0001-i1-GGUF

Updated Sep 20, 2024 • 582 • 3

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • Updated Sep 22, 2024 • 31.9k • 31

mradermacher/Llama-3.2-3B-Instruct-uncensored-i1-GGUF

Updated Sep 28, 2024 • 1.12k • 7

mradermacher/L3.1-Aglow-Vulca-v0.1-8B-i1-GGUF

Updated Sep 29, 2024 • 6 • 2

mradermacher/Llama-3.2-1B-Instruct-Uncensored-i1-GGUF

Updated Oct 11, 2024 • 686 • 4

arcee-ai/SuperNova-Medius-GGUF

Updated Oct 17, 2024 • 3.24k • 55

mradermacher/Astral-Fusion-Neural-Happy-L3.1-8B-i1-GGUF

Updated Oct 14, 2024 • 5 • 3

XelotX/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated Oct 16, 2024 • 234 • 2

MarsupialAI/Monstral-123B_iMat_GGUF

Text Generation • Updated Oct 24, 2024 • 918 • 2

mradermacher/Delirium-v1-i1-GGUF

Updated Oct 23, 2024 • 104 • 3

mradermacher/Darkest-muse-v1-i1-GGUF

Updated Oct 24, 2024 • 302 • 4

mradermacher/Llama-3-Yggdrasil-AstralSpice-8B-i1-GGUF

Updated Oct 25, 2024 • 108 • 2

mradermacher/Llama3.1-DarkStorm-Aspire-8B-i1-GGUF

Updated Oct 25, 2024 • 39 • 2

mradermacher/Llama3.1-TheiaFire-DarkFusion-8B-i1-GGUF

Updated Oct 26, 2024 • 62 • 1

mradermacher/MS-Drummer-Sunfall-22b-i1-GGUF

Updated Oct 28, 2024 • 256 • 5

backyardai/Cydonia-22B-v1.2-GGUF

Updated Nov 1, 2024 • 699 • 2

mradermacher/Reyna-RP-Qwen1.5-0.5B-Chat-v0.1-i1-GGUF

Updated Nov 3, 2024 • 44 • 1

benhaotang/Rombos-Coder-V2.5-Qwen-7b-GGUF_cline

Updated Nov 15, 2024 • 563 • 6

mradermacher/Adonalsium-Mistral-7b-v0.1-i1-GGUF

Updated Nov 7, 2024 • 50 • 1

mradermacher/MN-Chunky-Lotus-12B-i1-GGUF

Updated Nov 9, 2024 • 29 • 2

bartowski/Rombos-Coder-V2.5-Qwen-32b-GGUF

Text Generation • Updated Nov 12, 2024 • 803 • 2