Edit Models filters

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,195

Full-text search

Active filters: 3-bit

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

Text Generation • Updated 12 days ago • 22

roleplaiapp/Wayfarer-12B-Q3_K_L-GGUF

Text Generation • Updated 12 days ago • 26

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • Updated 12 days ago • 22

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • Updated 12 days ago • 22

roleplaiapp/Codestral-22B-v0.1-Q3_K_S-GGUF

Text Generation • Updated 12 days ago • 18

roleplaiapp/Codestral-22B-v0.1-Q3_K_M-GGUF

Text Generation • Updated 12 days ago • 22

roleplaiapp/Codestral-22B-v0.1-Q3_K_L-GGUF

Text Generation • Updated 12 days ago • 16

roleplaiapp/AceInstruct-7B-Q3_K_S-GGUF

Text Generation • Updated 12 days ago • 19

roleplaiapp/AceInstruct-7B-Q3_K_M-GGUF

Text Generation • Updated 12 days ago • 22

roleplaiapp/AceInstruct-1.5B-Q3_K_S-GGUF

Text Generation • Updated 12 days ago • 18

roleplaiapp/AceInstruct-1.5B-Q3_K_M-GGUF

Text Generation • Updated 12 days ago • 23

roleplaiapp/AceInstruct-1.5B-Q3_K_L-GGUF

Text Generation • Updated 12 days ago • 21

roleplaiapp/AceInstruct-7B-Q3_K_L-GGUF

Text Generation • Updated 12 days ago • 23

mlx-community/DeepSeek-R1-Distill-Qwen-7B-3bit

Updated 11 days ago • 2.16k

mlx-community/DeepSeek-R1-Distill-Llama-8B-3bit

Updated 11 days ago • 15.2k

adamo1139/DeepSeek-R1-Distill-Qwen-1.5B-3bpw-exl2

Updated 11 days ago • 3

ubaitur5/DeepSeek-R1-Distill-Qwen-14B-Q3-mlx

Text Generation • Updated 10 days ago • 30

ubaitur5/Qwen2.5-32B-Instruct-Q3-mlx

Text Generation • Updated 10 days ago • 10

mlx-community/DeepSeek-V2.5-1210-3bit-32

Text Generation • Updated 9 days ago • 16

MaziyarPanahi/SuperThoughts-CoT-14B-16k-o1-QwQ-GGUF

Text Generation • Updated 8 days ago • 131

MaziyarPanahi/Phi-4-Empathetic-GGUF

Text Generation • Updated 8 days ago • 142

MaziyarPanahi/Phi-4-QwQ-GGUF

Text Generation • Updated 7 days ago • 376

MaziyarPanahi/Llama-8B-Distill-CoT-GGUF

Text Generation • Updated 7 days ago • 218

MaziyarPanahi/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 7 days ago • 301

MaziyarPanahi/xLAM-7b-fc-r-GGUF

Text Generation • Updated 7 days ago • 147

MaziyarPanahi/xLAM-1b-fc-r-GGUF

Text Generation • Updated 7 days ago • 134

sleepdeprived3/UnslopNemo-12B-v3_3bpw_H8

Text Generation • Updated 5 days ago • 1

mlx-community/Evathene-v1.3-MLX-3Bit

Text Generation • Updated 7 days ago • 7

ReadyArt/creative-writer-32b-preview-01-2025_EXL2_3.0bpw_H8

Text Generation • Updated 6 days ago • 3

mlx-community/Nova-Tempus-70B-v0.1-MLX-3Bit

Text Generation • Updated 5 days ago • 6