Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

50

Full-text search

Active filters: 3B

prithivMLmods/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 15, 2024 • 611 • 8

bartowski/Llama-Doctor-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 18, 2024 • 222 • 1

prithivMLmods/Llama-Sentient-3.2-3B-Instruct

Text Generation • Updated 24 days ago • 74 • 10

prithivMLmods/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 24, 2024 • 1.6k • 10

QuantFactory/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 25, 2024 • 317 • 2

bartowski/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 26, 2024 • 298 • 3

prithivMLmods/Llama-Magpie-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 30, 2024 • 561 • 8

prithivMLmods/QwQ-LCoT-3B-Instruct

Text Generation • Updated 20 days ago • 258 • 8

prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF

Text Generation • Updated 22 days ago • 649 • 10

prithivMLmods/Llama-Song-Stream-3B-Instruct

Text Generation • Updated 15 days ago • 76 • 10

prithivMLmods/Llama-Song-Stream-3B-Instruct-GGUF

Text Generation • Updated 18 days ago • 324 • 9

prithivMLmods/Llama-Chat-Summary-3.2-3B

Text Generation • Updated 18 days ago • 280 • 8

mradermacher/Llama-Song-Stream-3B-Instruct-GGUF

Updated 17 days ago • 296 • 1

OEvortex/HelpingAI-3B

Text Generation • Updated Mar 25, 2024 • 38 • 4

OEvortex/HelpingAI-3B-v2.1

Text Generation • Updated May 29, 2024 • 12 • 3

OEvortex/HelpingAI-3B-v2.2

Text Generation • Updated May 29, 2024 • 14 • 7

tahsinashrafee/nav_desc_llama3.2-3B-Instruct

Text Generation • Updated Oct 16, 2024 • 35

prithivMLmods/Llama-Doctor-3.2-3B-Instruct

Text Generation • Updated 20 days ago • 295 • 7

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Nov 19, 2024 • 1

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 4

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Nov 19, 2024 • 5

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 2

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Nov 19, 2024 • 8

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 19, 2024 • 5

mradermacher/Llama-Sentient-3.2-3B-Instruct-GGUF

Updated Nov 28, 2024 • 164

mradermacher/Llama-Sentient-3.2-3B-Instruct-i1-GGUF

Updated Nov 28, 2024 • 140

mradermacher/QwQ-LCoT-3B-Instruct-GGUF

Updated 22 days ago • 401

mradermacher/QwQ-LCoT-3B-Instruct-i1-GGUF

Updated 22 days ago • 856

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated 20 days ago • 29

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 20 days ago • 33