Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

21,473

Full-text search

Active filters: 4-bit

ModelCloud/Falcon3-10B-Instruct-gptqmodel-4bit-vortex-mlx-v1

Updated about 9 hours ago • 4 • 2

TheBloke/stable-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 54 • 219

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 615 • 571

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 707 • 144

TheBloke/Pygmalion-7B-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 78 • 15

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 28.4k • 363

TheBloke/30B-Epsilon-GPTQ

Text Generation • Updated Sep 27, 2023 • 47 • 6

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 57 • 3

Qwen/Qwen-14B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 303 • 101

TheBloke/Mistral-7B-v0.1-GPTQ

Text Generation • Updated Sep 29, 2023 • 566 • 36

TheBloke/Athena-v4-GPTQ

Text Generation • Updated Oct 8, 2023 • 16 • 8

KoboldAI/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • Updated Oct 19, 2023 • 45 • 14

TheBloke/zephyr-7B-beta-GPTQ

Text Generation • Updated Oct 27, 2023 • 2.3k • 56

TheBloke/Athnete-13B-GPTQ

Text Generation • Updated Oct 29, 2023 • 13 • 4

TheBloke/Nethena-20B-GPTQ

Text Generation • Updated Oct 30, 2023 • 15 • 7

MohamedRashad/AceGPT-13B-chat-AWQ

Text Generation • Updated Nov 18, 2023 • 57 • 3

TheBloke/saiga_mistral_7b-GPTQ

Text Generation • Updated Nov 28, 2023 • 95 • 8

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.41k • 9

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 110 • 108

KnutJaegersberg/nllb-moe-54b-4bit

Translation • Updated Dec 16, 2023 • 20 • 5

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 809 • 26

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 266 • 174

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.11M • 74

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 1.72M • 75

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 35.7k • 126

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 12 days ago • 547k • 191

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 10k • 25

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.78M • 74

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10, 2024 • 1.71k • 18

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 690 • 28