Edit Models filters

Inference status

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

21,891

Full-text search

Active filters: bitsandbytes

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 33.1k • 31

prithivMLmods/Blaze.1-7B-Vision

Image-Text-to-Text • Updated 6 days ago • 116 • 7

prithivMLmods/Blazer.1-2B-Vision

Image-Text-to-Text • Updated 6 days ago • 113 • 7

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated 14 days ago • 136k • 28

lumolabs-ai/Lumo-8B-Instruct

Updated 2 days ago • 533 • 4

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Dec 10, 2024 • 13.4k • 67

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 118k • 17

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 118k • 10

John6666/Llama-3.1-8B-Lexi-Uncensored-V2-nf4

Text Generation • Updated Oct 13, 2024 • 1.28k • 9

unsloth/QwQ-32B-Preview-unsloth-bnb-4bit

Text Generation • Updated Dec 6, 2024 • 1.17k • 17

unsloth/DeepSeek-R1-Distill-Qwen-1.5B-unsloth-bnb-4bit

Text Generation • Updated about 18 hours ago • 2

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • Updated about 14 hours ago • 2

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 211 • 26

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.49k • 9

KnutJaegersberg/nllb-moe-54b-4bit

Translation • Updated Dec 16, 2023 • 20 • 5

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 17 • 2

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 830 • 27

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 341 • 174

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 14 days ago • 558k • 191

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 706 • 28

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 590 • 26

unsloth/Qwen2-1.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 746 • 1

nikravan/glm-4vq

Document Question Answering • Updated Jun 16, 2024 • 769 • 28

PrunaAI/GreatCaptainNemo-ProLLaMA-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 58 • 1

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 76k • 21

PrunaAI/apple-OpenELM-270M-bnb-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 18 • 1

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 1.99k • 32

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 263k • 91

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 4.02k • 30

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated 6 days ago • 206k • 70