Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,935

Full-text search

Active filters: quantized

TheMelonGod/Dolphin3.0-Qwen2.5-3b-exl2

Text Generation • Updated 9 days ago • 6

MaziyarPanahi/Phi-3-medium-4k-instruct-GGUF

Text Generation • Updated 10 days ago • 84

MaziyarPanahi/JSL-MedPhi2-2.7B-GGUF

Text Generation • Updated 10 days ago • 104

MaziyarPanahi/Phi-3-mini-4k-instruct-GGUF

Text Generation • Updated 10 days ago • 85

MaziyarPanahi/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • Updated 10 days ago • 96

MaziyarPanahi/fietje-2-instruct-GGUF

Text Generation • Updated 10 days ago • 118

smokxy/sadxds-quantized

Updated 9 days ago • 3

smokxy/sas-quantized

Updated 9 days ago • 68

smokxy/sdssd-quantized

Updated 9 days ago • 3

smokxy/sasda-quantized

Updated 9 days ago • 5

smokxy/dascaca-quantized

Updated 8 days ago • 4

smokxy/sadsacsasac-optimized

Updated 8 days ago • 5

Gurubot/TopicalStorm-Llama3.1-8b

Updated 5 days ago • 47

TheMelonGod/Falcon3-1B-Instruct-exl2

Text Generation • Updated 5 days ago • 1

XelotX/WizardLM-2-8x22B-GGUF

Text Generation • Updated 3 days ago