Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,262

Full-text search

Active filters: chat

bartowski/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 3.79k • 10

bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 11.7k • 25

lmstudio-community/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 1.62k • 3

bartowski/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 9.18k • 31

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 19, 2024 • 2.16k • 4

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 1.33k • 7

Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 2.17k • 2

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18, 2024 • 27.5k • 12

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 18, 2024 • 9.37k • 10

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 31.3k • 12

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 8.09k • 12

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 15.1k • 22

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 3.35k • 8

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 40.8k • 29

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 7.38k • 15

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 1.66k • 5

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.36k • 4

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 18.1k • 8

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 12.2k • 15

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 26.5k • 13

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 23.6k • 49

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 432k • 52

Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 6.79k • 27

Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 41.1k • 26

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 13k • 42

Qwen/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 4.68k • 22

Qwen/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 17.2k • 24

bartowski/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 17.3k • 49

lmstudio-community/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 560 • 3

bartowski/Qwen2.5-72B-Instruct-exl2

Text Generation • Updated Sep 17, 2024 • 81 • 12