Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,912

Full-text search

Active filters: quantized

MaziyarPanahi/Qwen2.5-14B-Unity-GGUF

Text Generation • Updated 2 days ago • 91

MaziyarPanahi/Qwenvergence-14B-v3-Prose-GGUF

Text Generation • Updated 2 days ago • 90

MaziyarPanahi/FuseCyberMix-Qwen-2.5-7B-Instruct-GGUF

Text Generation • Updated 2 days ago • 92

MaziyarPanahi/UwU-14B-Math-v0.2-GGUF

Text Generation • Updated 2 days ago • 124

smokxy/ttttttt-quantized

Updated 2 days ago • 1

smokxy/sss-quantized

Updated 2 days ago • 2

smokxy/sssef-quantized

Updated 2 days ago

smokxy/sas-quantized

Updated 2 days ago • 1

MaziyarPanahi/TQ2.5-14B-Aletheia-v1-GGUF

Text Generation • Updated 2 days ago • 77

smokxy/tes-quantized

Updated 2 days ago • 2

smokxy/qnt-quantized

Updated 2 days ago • 4

MaziyarPanahi/VirtuosoSmall-InstructModelStock-GGUF

Text Generation • Updated 2 days ago • 194

MaziyarPanahi/TQ2.5-14B-Neon-v1-GGUF

Text Generation • Updated 2 days ago • 94

MaziyarPanahi/Qwen2.5-14B-Wernickev5-GGUF

Text Generation • Updated 2 days ago • 91

MaziyarPanahi/WiNGPT-Babel-GGUF

Text Generation • Updated 2 days ago • 85

TheMelonGod/Dolphin3.0-Llama3.1-8B-exl2

Text Generation • Updated about 12 hours ago

MaziyarPanahi/Qwen2.5-14B-Merge-GGUF

Text Generation • Updated 1 day ago

MaziyarPanahi/Qwen-2.5-14B-MINUS-GGUF

Text Generation • Updated 1 day ago

MaziyarPanahi/UwU-7B-Instruct-GGUF

Text Generation • Updated 1 day ago • 1

MaziyarPanahi/light-3B-GGUF

Text Generation • Updated about 13 hours ago

MaziyarPanahi/Qwen2.5-Coder-0.5B-QwQ-draft-GGUF

Text Generation • Updated about 13 hours ago

MaziyarPanahi/Matsu-7B-GGUF

Text Generation • Updated about 13 hours ago