Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

235

Full-text search

Active filters: vllm

mistralai/Pixtral-12B-2409

Image-Text-to-Text • Updated 9 days ago • 560

mistralai/Ministral-8B-Instruct-2410

Updated 28 days ago • 3.5M • 380

mistralai/Mistral-Large-Instruct-2411

Updated Nov 19, 2024 • 3.48M • 180

mistralai/Pixtral-Large-Instruct-2411

Image-Text-to-Text • Updated 9 days ago • 377

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10, 2024 • 7.81k • 18

mistralai/Mistral-Small-Instruct-2409

Updated Oct 16, 2024 • 3.47M • 364

QuantFactory/Ministral-8B-Instruct-2410-GGUF

Updated Oct 22, 2024 • 467 • 2

MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION

Automatic Speech Recognition • Updated 8 days ago • 253 • 2

neuralmagic/Meta-Llama-3-70B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 80.6k • 11

neuralmagic/Qwen2-72B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 660 • 11

neuralmagic/Mixtral-8x22B-Instruct-v0.1-FP8

Text Generation • Updated Aug 12, 2024 • 340 • 2

neuralmagic/gemma-2-9b-it-FP8

Text Generation • Updated Jul 18, 2024 • 537 • 5

neuralmagic/Mistral-Nemo-Instruct-2407-FP8

Text Generation • Updated Jul 19, 2024 • 33k • 17

neuralmagic/DeepSeek-Coder-V2-Instruct-FP8

Text Generation • Updated Jul 22, 2024 • 1.85k • 7

neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 522k • 37

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated Oct 19, 2024 • 672 • 5

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 67.9k • 37

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 3.53k • 31

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • Updated Oct 19, 2024 • 185 • 14

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated Oct 23, 2024 • 7.65k • 9

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 6.1k • 13

mistralai/Mistral-Large-Instruct-2407

Updated Oct 16, 2024 • 3.47M • 813

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 257 • 4

mgoin/Nemotron-4-340B-Instruct-hf

Text Generation • Updated Aug 8, 2024 • 81 • 4

mgoin/Nemotron-4-340B-Instruct-hf-FP8

Text Generation • Updated Aug 8, 2024 • 132 • 3

neuralmagic/Meta-Llama-3.1-70B-FP8

Text Generation • Updated Oct 9, 2024 • 223 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 557 • 2

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10, 2024 • 119k • 28

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10, 2024 • 2.42k • 12

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 22 • 1