Edit Models filters

Model Tree

Qwen/Qwen2.5-32B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

120

Full-text search

Active filters: Qwen/Qwen2.5-32B-Instruct

mradermacher/Qwen2.5-32B-Instruct-i1-GGUF

Updated 21 days ago • 965 • 1

hewengao/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 27, 2024 • 2

jacobcarajo/Qwen2.5-32B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 2, 2024 • 3

VPTQ-community/Qwen2.5-32B-Instruct-v16-k65536-65536-woft

Updated Nov 18, 2024 • 2 • 1

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-0-woft

Updated Nov 18, 2024 • 18

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft

Updated Nov 18, 2024 • 10

VPTQ-community/Qwen2.5-32B-Instruct-v8-k256-256-woft

Updated Nov 18, 2024 • 8

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-256-woft

Updated Nov 18, 2024 • 2 • 2

WPAI-INC/WPAIGPT-fse-patterns-1

Text Generation • Updated Oct 9, 2024 • 149

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Oct 11, 2024 • 1.22k • 11

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-4.65bpw-exl2

Text Generation • Updated Oct 12, 2024 • 9

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-6.5bpw-exl2

Text Generation • Updated Oct 12, 2024 • 17 • 1

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-8.0bpw-exl2

Text Generation • Updated Oct 12, 2024 • 9

cksghl1004/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 14, 2024 • 8

noxinc/Qwen2.5-32B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 15, 2024 • 4

Jellon/Qwen2.5-32B-Instruct-abliterated-exl2-4bpw

Text Generation • Updated Oct 19, 2024 • 20

mav23/Rombos-LLM-V2.5-Qwen-32b-GGUF

Updated Oct 20, 2024 • 146

mav23/Qwen2.5-32B-AGI-GGUF

Updated Oct 23, 2024 • 534

jth01/Rombos-LLM-V2.5-Qwen-32b-4.0bpw-exl2

Text Generation • Updated Oct 24, 2024 • 8

KnutJaegersberg/CompassJudger-1-32B-Instruct-exl2-8.0bpw

Updated Oct 26, 2024 • 5

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_5.0bpw

Text Generation • Updated Oct 27, 2024 • 8

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_4.0bpw

Text Generation • Updated Oct 27, 2024 • 9

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_4.5bpw

Text Generation • Updated Oct 27, 2024 • 7

FelixSAG/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 4, 2024 • 2

lmstudio-community/Qwen2.5-32B-Instruct-MLX-4bit

Text Generation • Updated Nov 13, 2024 • 167 • 1

lmstudio-community/Qwen2.5-32B-Instruct-MLX-8bit

Text Generation • Updated Nov 13, 2024 • 84

cmarkea/Qwen2.5-32B-Instruct-4bit

Text Generation • Updated Nov 14, 2024 • 21 • 2

mav23/CompassJudger-1-32B-Instruct-GGUF

Updated Nov 15, 2024 • 25

nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic

Updated Nov 15, 2024 • 274 • 1

Daemonrat/Qwen2.5-32B-AGI_Q4_K_M

Updated Nov 15, 2024 • 2