Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,801

Full-text search

Active filters: chat

mradermacher/DarkHermes3-Llama3.2-3B-Instruct-GGUF

Updated 10 days ago • 325 • 1

mradermacher/DarkHermes3-Llama3.2-3B-Instruct-i1-GGUF

Updated 10 days ago • 821 • 1

ogmatrixllm/arcadex-llm

Text Generation • Updated 11 days ago • 1

maldv/Qwenstein2.5-32B-Instruct

Text Generation • Updated 8 days ago • 69 • 2

mradermacher/Dark-Hermes3-Llama3.2-3B-GGUF

Updated 9 days ago • 322 • 1

allura-org/Qwen2.5-72b-RP-Ink

Updated 8 days ago • 174 • 6

jth01/Qwenstein2.5-32B-Instruct-4.2bpw-exl2

Text Generation • Updated 9 days ago • 14 • 1

bartowski/Qwen2.5-72b-RP-Ink-GGUF

Text Generation • Updated 9 days ago • 1.56k • 5

Melvin56/Qwen2.5-Coder-7B-Instruct-abliterated-Q8_0-GGUF

Text Generation • Updated 9 days ago • 27 • 1

mradermacher/Dark-Hermes3-Llama3.2-3B-i1-GGUF

Updated 9 days ago • 553 • 1

mradermacher/RigoChat-7b-v2-GGUF

Updated 8 days ago • 256 • 1

mradermacher/RigoChat-7b-v2-i1-GGUF

Updated 8 days ago • 463 • 1

roleplaiapp/Llama-3.3-70B-Instruct-Q4_0-GGUF

Text Generation • Updated 7 days ago • 266 • 1

itlwas/Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 7 days ago • 23 • 1

DavidCatalano/calme-3.2-instruct-78b-exl2

Text Generation • Updated 1 day ago • 4 • 1

mradermacher/SuperThoughts-CoT-14B-16k-o1-QwQ-PyTorch-GGUF

Updated 2 days ago • 310 • 1

ModelCloud/Qwen2.5-0.5B-Instruct-gptqmodel-4bit

Text Generation • Updated 6 days ago • 40 • 1

bartowski/L3.3-70B-Magnum-v4-SE-GGUF

Text Generation • Updated 6 days ago • 1.55k • 1

jerryzhao173985/Qwen2.5-7B-poem-8bit

Text Generation • Updated 6 days ago • 8 • 1

mradermacher/SuperThoughts-CoT-14B-16k-o1-QwQ-GGUF

Updated 3 days ago • 281 • 1

ezcz/NanoGPT-Chat

Updated about 2 hours ago • 58 • 1

mradermacher/SuperThoughts-CoT-14B-16k-o1-QwQ-i1-GGUF

Updated 2 days ago • 457 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_0-GGUF

Text Generation • Updated 2 days ago • 127 • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Q5_K_M-GGUF

Text Generation • Updated 2 days ago • 37 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

Text Generation • Updated 2 days ago • 180 • 1

neuralmagic-ent/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated about 4 hours ago • 34 • 1

mradermacher/Confucius-o1-14B-GGUF

Updated about 17 hours ago • 264 • 1

mradermacher/Confucius-o1-14B-i1-GGUF

Updated about 17 hours ago • 515 • 1

mradermacher/Dria-Agent-a-3B-abliterated-GGUF

Updated 2 days ago • 241 • 1

mradermacher/Dria-Agent-a-3B-abliterated-i1-GGUF

Updated 1 day ago • 388 • 1