Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

8-bit precision

Models

10,765

Full-text search

Active filters: llama-cpp

prithivMLmods/Deepthink-Reasoning-7B-GGUF

Text Generation • Updated 6 days ago • 643 • 9

prithivMLmods/OpenMath-8B-GGUF

Text Generation • Updated Nov 30, 2024 • 370 • 7

KnutJaegersberg/phi-4-abliterated-Q8_0-GGUF

Text Generation • Updated about 12 hours ago • 36 • 3

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 24.4k • 43

CronoBJS/LLaMA-Mesh-Q6_K-GGUF

Text Generation • Updated Nov 19, 2024 • 4 • 2

Guilherme34/Samantha-v6-Q4_K_M-GGUF

Updated 4 days ago • 23 • 2

QuantFactory/Codepy-Deepthink-3B-GGUF

Text Generation • Updated 2 days ago • 382 • 2

Aleteian/NeverendingStory-Q8_0-GGUF

Updated 2 days ago • 34 • 2

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

Updated Apr 5, 2024 • 981 • 1

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5, 2024 • 476 • 2

DavidAU/HelpingAI-Lite-4x1b-Q6_K-GGUF

Updated Apr 9, 2024 • 2 • 1

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 544 • 15

DavidAU/BigYi-15.75B-200k-Q6_K-GGUF

Updated Apr 14, 2024 • 13 • 2

gate369/Bitnet-M7-70m-Q8_0-GGUF

Updated Apr 15, 2024 • 20 • 1

DavidAU/UNA-dolphin-2.6-mistral-7b-dpo-laser-Q6_K-GGUF

Updated Apr 19, 2024 • 4 • 1

DavidAU/RedPajama-INCITE-7B-Instruct-Q6_K-GGUF

Updated Apr 20, 2024 • 15 • 2

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q4_K_M-GGUF-PTBR

Text Generation • Updated May 1, 2024 • 15 • 1

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14, 2024 • 923 • 52

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3, 2024 • 680 • 53

TouchNight/Yi-9B-200K-AEZAKMI-RAW-TOXIC-1-Q6_K-GGUF

Updated May 21, 2024 • 3 • 1

NikolayKozloff/Alpha-Orionis-v0.1-Q8_0-GGUF

Updated May 26, 2024 • 1 • 3

YorkieOH10/AlchemistCoder-DS-6.7B-Q4_K_M-GGUF

Updated May 30, 2024 • 3 • 1

zhaijunxiao/omost-llama-3-8b-Q8_0-GGUF

Updated Jun 12, 2024 • 65 • 4

HDiffusion/Llama3-8b-CunnyGPT-16bit-Q4_K_M-GGUF

Updated Jun 13, 2024 • 14 • 2

mobeetle/Saul-7B-Instruct-v1-Q4_K_M-GGUF

Updated Jun 20, 2024 • 3 • 1

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26, 2024 • 4.22k • 45

fishbone64/gte-Qwen2-7B-instruct-Q8_0-GGUF

Sentence Similarity • Updated Jun 26, 2024 • 33 • 2

huggingkot/dolphin-2.9.3-mistral-7B-32k-Q4_K_M-GGUF

Updated Jul 3, 2024 • 12 • 3

zhezhe/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Jul 8, 2024 • 15 • 1

jorismathijssen/t5-base-Q4_K_M-GGUF

Translation • Updated Jul 8, 2024 • 51 • 1