Edit Models filters

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,960

Full-text search

Active filters: quantized

qualcomm/Qwen2-7B-Instruct

Text Generation • Updated 11 days ago

qualcomm/Baichuan2-7B

Text Generation • Updated 11 days ago

qualcomm/Mistral-7B-Instruct-v0.3

Text Generation • Updated 11 days ago

qualcomm/IndusQ-1.1B

Text Generation • Updated 11 days ago

qualcomm/VITQuantized

Image Classification • Updated 11 days ago

qualcomm/Llama-v3.2-3B-Chat

Text Generation • Updated 11 days ago • 2

qualcomm/JAIS-6p7b-Chat

Text Generation • Updated 11 days ago

qualcomm/Mistral-3B

Text Generation • Updated 11 days ago • 2

Omarrran/quantized_english_speecht5_finetune-tts

Text-to-Speech • Updated Oct 22, 2024 • 96 • 1

MaziyarPanahi/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 23, 2024 • 157

MaziyarPanahi/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Oct 24, 2024 • 150 • 1

dhrubasumatary/sarvam-1-quantized

Text Generation • Updated Oct 25, 2024 • 1

MaziyarPanahi/L3-Nymeria-8B-GGUF

Text Generation • Updated Oct 28, 2024 • 44 • 3

MaziyarPanahi/L3-Nymeria-Maid-8B-GGUF

Text Generation • Updated Oct 28, 2024 • 63

MaziyarPanahi/L3-Nymeria-v2-8B-GGUF

Text Generation • Updated Oct 28, 2024 • 64

MaziyarPanahi/L3-Rhaenys-8B-GGUF

Text Generation • Updated Oct 28, 2024 • 60

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • Updated Oct 28, 2024 • 62

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.1-Uncensored-GGUF

Text Generation • Updated Oct 28, 2024 • 78 • 2

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored-GGUF

Text Generation • Updated Oct 29, 2024 • 83

MaziyarPanahi/llama-3-8b-chat-reglamentacion-V1-GGUF

Text Generation • Updated Oct 29, 2024 • 47

MaziyarPanahi/Einstein-v6.1-Llama3-8B-GGUF

Text Generation • Updated Oct 29, 2024 • 43

MaziyarPanahi/llama3-8B-DarkIdol-2.3-Uncensored-32K-GGUF

Text Generation • Updated Oct 29, 2024 • 83 • 1

MaziyarPanahi/badger-mu-llama-3-8b-GGUF

Text Generation • Updated Oct 29, 2024 • 57

MaziyarPanahi/KONI-Llama3-8B-20240630-GGUF

Text Generation • Updated Oct 29, 2024 • 60

MaziyarPanahi/L3-8B-Sunfall-v0.5-Stheno-v3.2-GGUF

Text Generation • Updated Oct 29, 2024 • 79 • 4

MaziyarPanahi/badger-lambda-llama-3-8b-GGUF

Text Generation • Updated Oct 29, 2024 • 84

MaziyarPanahi/L3-8B-Sunfall-v0.4-Lunar-Stheno-GGUF

Text Generation • Updated Oct 29, 2024 • 60 • 1

joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4

Text Generation • Updated Nov 5, 2024 • 363 • 2

MaziyarPanahi/qwen-2.5-7B-DPO-split1-16bit-chunk34-GGUF

Text Generation • Updated Oct 29, 2024 • 8

MaziyarPanahi/cybertron-v4-qw7B-MGS-GGUF

Text Generation • Updated Oct 30, 2024 • 47 • 1