Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,265

Full-text search

Active filters: chat

lmstudio-community/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 12.9k • 6

bartowski/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 1.28k • 6

bartowski/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 1.43k • 4

lmstudio-community/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 10.6k • 7

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 13.6k • 25

bartowski/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 6.11k • 7

lmstudio-community/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 900 • 2

Qwen/Qwen2-7B-Instruct-MLX

Text Generation • Updated Sep 18, 2024 • 231 • 3

Qwen/Qwen2.5-Coder-1.5B-Instruct

Text Generation • Updated Nov 18, 2024 • 13.4k • 51

Qwen/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 36.9k • 74

Qwen/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 5.56k • 17

bartowski/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 845 • 2

lmstudio-community/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 11.7k • 2

mlx-community/Qwen2.5-0.5B-Instruct-4bit

Text Generation • Updated Sep 18, 2024 • 225 • 2

bartowski/Qwen2.5-Math-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 419 • 1

mlx-community/Qwen2.5-14B-Instruct-8bit

Text Generation • Updated Sep 18, 2024 • 68 • 2

mlx-community/Qwen2.5-7B-Instruct-8bit

Text Generation • Updated Sep 18, 2024 • 123 • 3

mlx-community/Qwen2.5-14B-Instruct-4bit

Text Generation • Updated Sep 18, 2024 • 260k • 4

mlx-community/Qwen2.5-7B-Instruct-4bit

Text Generation • Updated Nov 6, 2024 • 155k • 7

mlx-community/Qwen2.5-72B-Instruct-4bit

Text Generation • Updated Sep 18, 2024 • 73.8k • 4

mlx-community/Qwen2.5-Coder-7B-Instruct-bf16

Text Generation • Updated Sep 18, 2024 • 48 • 1

mlx-community/Qwen2.5-Coder-7B-Instruct-4bit

Text Generation • Updated Sep 18, 2024 • 102k • 2

mlx-community/Qwen2.5-32B-Instruct-8bit

Text Generation • Updated Sep 18, 2024 • 58 • 3

mlx-community/Qwen2.5-32B-Instruct-4bit

Text Generation • Updated Sep 18, 2024 • 2.63k • 1

gaianet/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 62 • 1

second-state/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 197 • 2

QuantFactory/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Nov 6, 2024 • 330 • 2

TheRains/Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 19, 2024 • 16 • 1

QuantFactory/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Nov 6, 2024 • 506 • 5

bartowski/Qwen2.5-7B-Instruct-exl2

Text Generation • Updated Sep 19, 2024 • 15 • 4