Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

1,362

Full-text search

Active filters: qwen

roleplaiapp/SmallThinker-3B-Preview-Q4_K_M-GGUF

Text Generation • Updated 3 days ago

roleplaiapp/SmallThinker-3B-Preview-Q5_0-GGUF

Text Generation • Updated 3 days ago • 20

roleplaiapp/SmallThinker-3B-Preview-Q5_K_S-GGUF

Text Generation • Updated 3 days ago • 19

roleplaiapp/SmallThinker-3B-Preview-Q5_K_M-GGUF

Text Generation • Updated 3 days ago • 18

roleplaiapp/SmallThinker-3B-Preview-Q6_K-GGUF

Text Generation • Updated 3 days ago • 17

roleplaiapp/SmallThinker-3B-Preview-Q8_0-GGUF

Text Generation • Updated 3 days ago • 21

roleplaiapp/SmallThinker-3B-Preview-IQ3_M-GGUF

Text Generation • Updated 3 days ago • 17

roleplaiapp/SmallThinker-3B-Preview-IQ3_XXS-GGUF

Text Generation • Updated 3 days ago • 17

roleplaiapp/SmallThinker-3B-Preview-IQ4_NL-GGUF

Text Generation • Updated 3 days ago • 18

roleplaiapp/SmallThinker-3B-Preview-IQ4_XS-GGUF

Text Generation • Updated 3 days ago • 19

Cran-May/InternLM3-8B-Instruct-Converted-Qwen2-Q5_K_S-GGUF

Updated 2 days ago • 16

parasail-ai/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8-128k

Text Generation • Updated 1 day ago • 26