Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

23,436

Full-text search

Active filters: 4-bit

danny0122/stablelm-base-alpha-3b-gptq-4bitssafe

Text Generation • Updated Dec 11, 2023 • 2

jamesdborin/llama2-13b-chat-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 5 • 1

jamesdborin/llama2-70b-chat-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 9 • 1

jamesdborin/llama2-7b-base-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 14

jamesdborin/llama2-13b-base-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 6

jamesdborin/llama2-70b-base-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 4

Chat-Error/Rose-Kimiko-20B

Updated Dec 12, 2023 • 2 • 2

Weni/ZeroShot-3.1.1-Mistral-7b-Multilanguage-3.0.3-AWQ

Text Generation • Updated Dec 11, 2023 • 4

TheBloke/OpenHermes-2.5-neural-chat-v3-3-Slerp-GPTQ

Text Generation • Updated Dec 11, 2023 • 18 • 3

TheBloke/OpenHermes-2.5-neural-chat-v3-3-Slerp-AWQ

Text Generation • Updated Dec 11, 2023 • 7 • 1

TheBlokeAI/Mixtral-tiny-GPTQ

Text Generation • Updated Dec 12, 2023 • 61 • 3

TheBloke/leo-hessianai-70B-AWQ

Text Generation • Updated Dec 11, 2023 • 8

TheBloke/leo-hessianai-70B-GPTQ

Text Generation • Updated Dec 11, 2023 • 21

bienpr/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Dec 11, 2023 • 4

Chuanming/peft-exercise-1

Updated Dec 11, 2023 • 1

TheBloke/Mixtral-8x7B-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 533 • 127

minhhiepcr/quantizated_Mistral-7B-Instruct-v0.1-awq

Text Generation • Updated Dec 11, 2023 • 6

iproskurina/opt-350m-GPTQ-4bit-g128

Text Generation • Updated Sep 24, 2024 • 4

iproskurina/opt-1.3b-GPTQ-4bit-g128

Text Generation • Updated Sep 24, 2024 • 48

iproskurina/opt-2.7b-GPTQ-4bit-g128

Text Generation • Updated Sep 24, 2024 • 63

iproskurina/opt-6.7b-GPTQ-4bit-g128

Text Generation • Updated Sep 24, 2024 • 49

ybelkada/llava-1.5-7b-hf-awq

Image-Text-to-Text • Updated Dec 11, 2023 • 16 • 2

TheBloke/LlamaGuard-7B-AWQ

Text Generation • Updated Dec 11, 2023 • 5.45k • 4

marcsun13/Mixtral-tiny-GPTQ

Text Generation • Updated Dec 11, 2023 • 19

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 73.5k • 135

TheBloke/LlamaGuard-7B-GPTQ

Text Generation • Updated Dec 11, 2023 • 23 • 2

marcsun13/Mixtral-8x7B-v0.1-GPTQ

Text Generation • Updated Dec 11, 2023 • 5

HydraIndicLM/mistral-MoQlora-punjabi-expert

Text Generation • Updated Dec 12, 2023 • 9

HydraIndicLM/mistral-MoQlora-tamil-expert

Text Generation • Updated Dec 12, 2023 • 4

TheBloke/mixtral-8x7b-v0.1-AWQ

Text Generation • Updated Dec 22, 2023 • 75 • 10