Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,785

Full-text search

Active filters: chat

bullerwins/QwQ-32B-Preview-exl2_6.5bpw

Text Generation • Updated Dec 3, 2024 • 5

Apel-sin/qwq-32b-coder-fusion-8020-exl2

Text Generation • Updated Dec 3, 2024

tensorblock/calme-3.3-instruct-3b-GGUF

Text Generation • Updated Dec 3, 2024 • 34

MarsupialAI/Monstral-123B-v2_GGUF

Text Generation • Updated Dec 4, 2024 • 1.61k • 3

AIFunOver/QwQ-32B-Preview-openvino-8bit

Text Generation • Updated Dec 4, 2024 • 7

AIFunOver/QwQ-32B-Preview-openvino-4bit

Text Generation • Updated Dec 4, 2024 • 8

mav23/Mistral-7B-LLM-Fraud-Detection-GGUF

Text Generation • Updated Dec 4, 2024 • 116

cgus/Qwen2.5-1.5B-Instruct-exl2

Text Generation • Updated Dec 4, 2024 • 21

tensorblock/calme-2.2-llama3.1-70b-GGUF

Text Generation • Updated Dec 5, 2024 • 16

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_5.0bpw_h6

Text Generation • Updated Dec 9, 2024 • 220 • 2

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_5.5bpw_h6

Text Generation • Updated Dec 9, 2024 • 36

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_8.0bpw_h8

Text Generation • Updated Dec 9, 2024 • 244 • 2

Triangle104/magnum-v4-22b-Q4_K_S-GGUF

Text Generation • Updated Dec 5, 2024 • 1

Triangle104/magnum-v4-22b-Q4_K_M-GGUF

Text Generation • Updated Dec 5, 2024 • 1

Triangle104/magnum-v4-22b-Q5_K_S-GGUF

Text Generation • Updated Dec 5, 2024 • 4

redrix/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS

Text Generation • Updated Dec 19, 2024 • 175 • 10

Triangle104/magnum-v4-22b-Q5_K_M-GGUF

Text Generation • Updated Dec 5, 2024 • 11

Triangle104/magnum-v4-22b-Q6_K-GGUF

Text Generation • Updated Dec 5, 2024 • 3

Triangle104/magnum-v4-22b-Q8_0-GGUF

Text Generation • Updated Dec 5, 2024 • 12

ggnoy/Qwen2-0.5B-Instruct-Q8_0-GGUF

Text Generation • Updated Dec 5, 2024 • 2

BenevolenceMessiah/QwQ-32B-Preview-Q8_0-GGUF

Updated Dec 6, 2024 • 2

mradermacher/Monstral-123B-v2-i1-GGUF

Updated Dec 6, 2024 • 296 • 1

paultimothymooney/Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

Text Generation • Updated 7 days ago • 19

paultimothymooney/QwQ-32B-Preview-Q8_0-GGUF

Updated Dec 6, 2024 • 1

dnotitia/Llama-DNA-1.0-8B-Instruct

Text Generation • Updated about 9 hours ago • 953 • 50

WangZeJun/my-cool-model

Text Generation • Updated Dec 6, 2024 • 120

Darkhn/Monstral-V2-123B-3.5bpw-h6-exl2

Text Generation • Updated Dec 11, 2024 • 14

zengyuxiang/QwQ-32B-Preview-Q4_K_M-GGUF

Updated Dec 6, 2024 • 3

redrix/matricide-12B-Unslop-Unleashed

Text Generation • Updated Dec 15, 2024 • 7 • 1

bartowski/Sailor2-20B-Chat-GGUF

Text Generation • Updated Dec 6, 2024 • 177