Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,912

Full-text search

Active filters: quantized

MaziyarPanahi/Starcannon-Unleashed-12B-v1.0-GGUF

Text Generation • Updated Nov 7, 2024 • 47

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • Updated Nov 7, 2024 • 65 • 1

MaziyarPanahi/magnum-v4-12b-GGUF

Text Generation • Updated Nov 7, 2024 • 68

MaziyarPanahi/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS-GGUF

Text Generation • Updated Nov 7, 2024 • 43

MaziyarPanahi/Mistral-Nemo-Kurdish-Instruct-GGUF

Text Generation • Updated Nov 7, 2024 • 43

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 87 • 1

MaziyarPanahi/calme-3.2-instruct-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 218

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 251 • 2

MaziyarPanahi/calme-3.1-baguette-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 42

MaziyarPanahi/calme-3.2-baguette-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 286

MaziyarPanahi/calme-3.3-baguette-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 195

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 535 • 1

MaziyarPanahi/calme-3.2-qwenloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 59

MaziyarPanahi/calme-3.3-qwenloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 63

MaziyarPanahi/calme-3.1-llamaloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 70

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 73 • 1

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 75

dwikitheduck/gen-try1-Q4_K_M-GGUF

Updated Nov 11, 2024 • 5

fahmizainal17/Meta-Llama-3-8B-Instruct-fine-tuned

Text Generation • Updated Nov 13, 2024 • 15

AstroMLab/AstroSage-8B-GGUF

Text Generation • Updated Nov 16, 2024 • 159 • 2

shreyasmeher/ConflLlama-Alt

Text Classification • Updated Nov 19, 2024 • 12

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15, 2024 • 74 • 7

Guchyos/gemma-2b-elyza-task

Text Generation • Updated Nov 18, 2024 • 7

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated 10 days ago • 18

dwikitheduck/gen-sql-1-Q4_K_M-GGUF

Updated Nov 18, 2024 • 7

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20, 2024 • 978k • 1

jsjeon/SummLlama3.2-3B-Q4_K_M-GGUF

Updated Nov 19, 2024

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated 10 days ago • 13

neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • Updated 19 days ago • 47

TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2

Text Generation • Updated Nov 23, 2024