Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

72,626

Full-text search

Active filters: gguf

shadicopty/llama3.2-entity

Updated 13 days ago • 129 • 8

bartowski/Eurus-2-7B-PRIME-GGUF

Text Generation • Updated 5 days ago • 1.45k • 5

mmnga/DeepSeek-V3-slice-jp64-gguf

Updated 3 days ago • 347 • 5

bartowski/UwU-7B-Instruct-GGUF

Text Generation • Updated 3 days ago • 1.03k • 5

lmstudio-community/phi-4-GGUF

Text Generation • Updated 10 minutes ago • 5

google/gemma-7b

Text Generation • Updated Jun 27, 2024 • 35.3k • • 3.09k

bartowski/NemoMix-Unleashed-12B-GGUF

Text Generation • Updated Aug 22, 2024 • 17k • 60

martintomov/Hyper-FLUX.1-dev-gguf

Text-to-Image • Updated Oct 23, 2024 • 699 • 9

Lewdiculous/experimental-lwd-Mirau-RP-14B-GGUF-IQ-Imatrix

Updated 8 days ago • 1.48k • 9

mradermacher/WizardLM-2-22b-RP-i1-GGUF

Updated 7 days ago • 565 • 4

mradermacher/SmallThinker-3B-Preview-abliterated-i1-GGUF

Updated 7 days ago • 545 • 4

KnutJaegersberg/phi-4-abliterated-Q8_0-GGUF

Text Generation • Updated 5 days ago • 1.33k • 4

bartowski/Captain-Eris-Diogenes_Twilight-V0.420-12B-GGUF

Text Generation • Updated 4 days ago • 651 • 4

bartowski/miscii-14b-1225-GGUF

Text Generation • Updated 4 days ago • 755 • 4

bartowski/Dolphin3.0-Llama3.1-8B-GGUF

Text Generation • Updated 3 days ago • 941 • 4

bartowski/Dolphin3.0-Llama3.2-3B-GGUF

Text Generation • Updated 3 days ago • 787 • 4

bartowski/Dolphin3.0-Qwen2.5-3b-GGUF

Text Generation • Updated 3 days ago • 1.05k • 4

TheBloke/Tinyllama-2-1b-miniguanaco-GGUF

Updated Oct 14, 2023 • 506 • 15

google/madlad400-10b-mt

Translation • Updated Apr 12, 2024 • 2.92k • 98

google/gemma-2b-it

Text Generation • Updated Sep 27, 2024 • 57.1k • • 690

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Dec 1, 2024 • 91k • 163

cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b-gguf

Updated Aug 3, 2024 • 11k • 47

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 23, 2024 • 490k • 113

Qwen/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 10.1k • 28

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 12.8k • 44

QuantFactory/Llama-3-8B-Instruct-Finance-RAG-GGUF

Text Generation • Updated Oct 20, 2024 • 2.32k • 32

gpustack/jina-reranker-v2-base-multilingual-GGUF

Text Classification • Updated Oct 28, 2024 • 716 • 3

IlyaGusev/saiga_nemo_12b_gguf

Updated Nov 19, 2024 • 39.6k • 27

bartowski/Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

Text Generation • Updated Nov 14, 2024 • 9.25k • 20

bartowski/QwQ-32B-Preview-abliterated-GGUF

Text Generation • Updated Dec 1, 2024 • 6.12k • 21