Edit Models filters

Inference status

Misc

Inference Endpoints

Merge

text-generation-inference

text-embeddings-inference

Misc with no match

gguf

Models

72,367

Full-text search

Active filters: gguf

DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF

Text Generation • Updated 18 days ago • 69.6k • 36

cognitivecomputations/Dolphin3.0-Llama3.1-8B-GGUF

Updated 2 days ago • 1.98k • 16

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • Updated 8 days ago • 71.4k • 22

city96/HunyuanVideo-gguf

Text-to-Video • Updated 21 days ago • 50.7k • 65

bartowski/QVQ-72B-Preview-GGUF

Image-Text-to-Text • Updated 14 days ago • 182k • 51

NexaAIDev/OmniAudio-2.6B

Audio-Text-to-Text • Updated 25 days ago • 10.6k • 216

Lewdiculous/experimental-lwd-Mirau-RP-14B-GGUF-IQ-Imatrix

Updated 7 days ago • 1.48k • 9

city96/t5-v1_1-xxl-encoder-gguf

Updated Aug 20, 2024 • 36.2k • 248

prithivMLmods/SmolLM2-CoT-360M-GGUF

Text Generation • Updated 2 days ago • 95 • 8

calcuis/ltxv-gguf

Text-to-Video • Updated 2 days ago • 46.7k • 22

prithivMLmods/Llama-Deepsync-1B-GGUF

Text Generation • Updated 9 days ago • 511 • 7

prithivMLmods/Triangulum-5B-GGUF

Text Generation • Updated 7 days ago • 205 • 7

prithivMLmods/Triangulum-1B-GGUF

Text Generation • Updated 6 days ago • 181 • 7

prithivMLmods/Llama-Thinker-3B-Preview-GGUF

Text Generation • Updated 3 days ago • 164 • 7

mkurman/llama-3.2-MEDIT-3B-o1

Text Generation • Updated 10 minutes ago • 201 • 7

DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF

Text Generation • Updated 3 days ago • 216 • 7

bartowski/c4ai-command-r7b-12-2024-abliterated-GGUF

Text Generation • Updated 3 days ago • 1.64k • 7

google/gemma-2b

Text Generation • Updated Sep 27, 2024 • 289k • 934

Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 87.3k • 112

Lewdiculous/Nera_Noctis-12B-GGUF-ARM-Imatrix

Updated 3 days ago • 621 • 6

vikhyatk/moondream2

Image-Text-to-Text • Updated Nov 15, 2024 • 151k • 770

mixedbread-ai/mxbai-embed-large-v1

Feature Extraction • Updated Nov 26, 2024 • 1.5M • • 583

NexaAIDev/OmniVLM-968M

Updated 22 days ago • 1.9k • 491

YarvixPA/FLUX.1-Fill-dev-gguf

Updated Nov 22, 2024 • 20.3k • 35

bartowski/QwQ-32B-Preview-GGUF

Text Generation • Updated Nov 27, 2024 • 43.8k • 94

lmstudio-community/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 6, 2024 • 77.8k • 40

shadicopty/llama3.2-entity

Updated 12 days ago • 129 • 8