Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,912

Full-text search

Active filters: quantized

TheMelonGod/NaturalLM-exl2

Text Generation • Updated Nov 24, 2024 • 5

TheMelonGod/dolphin-2.9.3-mistral-7B-32k-exl2

Text Generation • Updated 22 days ago • 6

dwikitheduck/gen-inst-1-Q4_K_M-GGUF

Updated Nov 25, 2024 • 7

namannn/llama2-13b-hyperbolic-cluster-pruned

Text Generation • Updated Dec 2, 2024 • 258

TheMelonGod/MN-12B-Lyra-v4-exl2

Text Generation • Updated Dec 5, 2024 • 10

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated Dec 3, 2024 • 736k • 3

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • Updated Dec 4, 2024 • 57 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • Updated Dec 4, 2024 • 173 • 2

MaziyarPanahi/magnum-twilight-12b-GGUF

Text Generation • Updated Dec 6, 2024 • 32

MaziyarPanahi/patricide-12B-Unslop-Mell-GGUF

Text Generation • Updated Dec 6, 2024 • 20

MaziyarPanahi/Capt-Dark-Science-12B-GGUF

Text Generation • Updated Dec 6, 2024 • 27

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated Dec 6, 2024 • 471 • 1

MaziyarPanahi/Dark-Science-12B-GGUF

Text Generation • Updated Dec 6, 2024 • 16

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • Updated Dec 6, 2024 • 88 • 1

MaziyarPanahi/RP-SAINEMO-GGUF

Text Generation • Updated Dec 6, 2024 • 5

MaziyarPanahi/UnslopNemo-v4.1-Magnum-v4-12B-GGUF

Text Generation • Updated Dec 6, 2024 • 109

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 1.91M • 8

MaziyarPanahi/IceDrunkenCherryRP-7b-GGUF

Text Generation • Updated Dec 6, 2024 • 53

MaziyarPanahi/MN-SlushoMix-GGUF

Text Generation • Updated Dec 6, 2024 • 46

MaziyarPanahi/Chatty-Harry_V3.0-GGUF

Text Generation • Updated Dec 6, 2024 • 45

MaziyarPanahi/MN-Slush-GGUF

Text Generation • Updated Dec 6, 2024 • 127

MaziyarPanahi/AbominationScience-12B-v4-GGUF

Text Generation • Updated Dec 7, 2024 • 85

MaziyarPanahi/NaturalLM-GGUF

Text Generation • Updated Dec 7, 2024 • 13

MaziyarPanahi/MN-Violet-Lotus-12B-GGUF

Text Generation • Updated Dec 7, 2024 • 44

MaziyarPanahi/Prismatic-12b-v0.1-Experimental-1115-GGUF

Text Generation • Updated Dec 7, 2024 • 40

MaziyarPanahi/Mistral-2.5-Prima-Hercules-Fusion-7B-GGUF

Text Generation • Updated Dec 7, 2024 • 62

MaziyarPanahi/Mistral-Nemo-Prism-12B-v7-GGUF

Text Generation • Updated Dec 7, 2024 • 75

MaziyarPanahi/DarkAtom-12B-v3-GGUF

Text Generation • Updated Dec 7, 2024 • 40

MaziyarPanahi/Pleias-Nano-GGUF

Text Generation • Updated Dec 7, 2024 • 418 • 3

MaziyarPanahi/EXAONE-3.5-2.4B-Instruct-GGUF

Text Generation • Updated 30 days ago • 348 • 1