Edit Models filters

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,120

Full-text search

Active filters: chat

ggml-org/Qwen2.5-Coder-1.5B-32B-speculative-GGUF

Text Generation • Updated Dec 11, 2024 • 45 • 3

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_S-GGUF

Updated Dec 11, 2024 • 9 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 11, 2024 • 27 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_S-GGUF

Updated Dec 11, 2024 • 13 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_M-GGUF

Updated Dec 12, 2024 • 13 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q6_K-GGUF

Updated Dec 12, 2024 • 16 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 9 • 1

NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 79 • 2

mradermacher/Hermes-3-Llama-3.2-3B-GGUF

Updated Dec 13, 2024 • 159 • 1

mradermacher/Hermes-3-Llama-3.2-3B-i1-GGUF

Updated Dec 13, 2024 • 559 • 1

redrix/patricide-12B-Unslop-Mell-v2

Text Generation • Updated Dec 16, 2024 • 31 • 11

mradermacher/patricide-12B-Unslop-Mell-v2-GGUF

Updated Dec 17, 2024 • 764 • 4

mlx-community/phi-4-bf16

Text Generation • Updated 21 days ago • 41.9k • 2

mlx-community/phi-4-4bit

Text Generation • Updated 21 days ago • 652k • 17

mlx-community/phi-4-8bit

Text Generation • Updated 21 days ago • 45.9k • 10

mlx-community/phi-4-6bit

Text Generation • Updated 21 days ago • 280 • 4

itlwas/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated Dec 17, 2024 • 23 • 1

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v2

Text Generation • Updated Dec 18, 2024 • 1.25k • 16

BigHuggyD/MarsupialAI_Dumbstral-169B-FP8-Dynamic

Text Generation • Updated Dec 19, 2024 • 146 • 1

mradermacher/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v2-GGUF

Updated 11 days ago • 2.48k • 7

mradermacher/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v2-i1-GGUF

Updated 11 days ago • 2.46k • 3

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q4_K_S-GGUF

Updated Dec 19, 2024 • 25 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q4_K_M-GGUF

Updated Dec 19, 2024 • 14 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q5_K_S-GGUF

Updated Dec 19, 2024 • 9 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q5_K_M-GGUF

Updated Dec 19, 2024 • 8 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q6_K-GGUF

Updated Dec 19, 2024 • 17 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q8_0-GGUF

Updated Dec 19, 2024 • 15 • 1

maldv/Qwentile2.5-32B-Instruct

Text Generation • Updated 24 days ago • 1.95k • 31

itlwas/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 19, 2024 • 33 • 1

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v3

Text Generation • Updated Dec 20, 2024 • 622 • 14