Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,262

Full-text search

Active filters: chat

tensorblock/Sailor-1.8B-Chat-GGUF

Updated 25 days ago • 281

ericliu2007/Qwen2.5-14B-Instruct-Q2_K-GGUF

Text Generation • Updated 25 days ago • 26

Sg-at-srijan-us-kg/Qwen2.5-Coder-32B-Instruct-128k-yarn-Q4_K_M-GGUF

Text Generation • Updated 24 days ago • 35

tensorblock/Llama-2-7b-ultrachat200k-GGUF

Text Generation • Updated 24 days ago • 179

mradermacher/Hermes-3-Llama-3.2-3B-GGUF

Updated 24 days ago • 505

mradermacher/Hermes-3-Llama-3.2-3B-i1-GGUF

Updated 24 days ago • 723

ericliu2007/Qwen2.5-32B-Instruct-Q2_K-GGUF

Text Generation • Updated 24 days ago • 22

cnfusion/QwQ-32B-Coder-Fusion-8020-Q4-mlx

Text Generation • Updated 24 days ago • 12

cnfusion/QwQ-32B-Coder-Fusion-7030-Q4-mlx

Text Generation • Updated 24 days ago • 12

cnfusion/QwQ-32B-Coder-Fusion-8020-Q8-mlx

Text Generation • Updated 24 days ago • 15

cnfusion/QwQ-32B-Coder-Fusion-7030-Q8-mlx

Text Generation • Updated 24 days ago • 20

yuh0512/QwQ-32B-Preview-Q4_K_M-GGUF

Updated 24 days ago • 5

tensorblock/Sailor-7B-Chat-GGUF

Updated 24 days ago • 254

TheBlueObserver/Qwen2.5-1.5B-Instruct

Text Generation • Updated 23 days ago • 21

mlx-community/Hermes-3-Llama-3.1-8B-3bit

Updated 23 days ago • 154

mlx-community/Qwen2.5-7B-Instruct-3bit

Text Generation • Updated 23 days ago • 102

mlx-community/Qwen2.5-Coder-7B-Instruct-3bit

Text Generation • Updated 23 days ago • 114

Delta-Vector/Control-Nanuq-8B

Updated 6 days ago • 92 • 2

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX

Text Generation • Updated 22 days ago • 37

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-7dd7f

Text Generation • Updated 22 days ago • 35

mlx-community/magnum-v4-72b-4bit

Text Generation • Updated 23 days ago • 30

mradermacher/Experiment27-7B-GGUF

Updated 22 days ago • 177

mradermacher/Experiment27-7B-i1-GGUF

Updated 21 days ago • 367

mlx-community/calme-3.2-instruct-78b-4bit

Text Generation • Updated 22 days ago • 38

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-0cb1b

Text Generation • Updated 22 days ago • 21

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-d5688

Text Generation • Updated 22 days ago • 18

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-c6059

Text Generation • Updated 22 days ago • 14

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-9a5c2

Text Generation • Updated 22 days ago • 16

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-104ce

Text Generation • Updated 22 days ago • 16

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-4c7d1

Text Generation • Updated 22 days ago • 14