Edit Models filters

Inference status

Misc

4-bit precision

arxiv: 2407.10032

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5

Full-text search

Active filters: 2407.10032

xmadai/Llama-3.1-405B-Instruct-xMADai-INT4

Text Generation • Updated Oct 30, 2024 • 215 • 6

xmadai/Mistral-Large-Instruct-2407-xMADai-INT4

Text Generation • Updated Oct 30, 2024 • 64 • 6

xmadai/gemma-2-9b-it-xMADai-INT4

Text Generation • Updated Oct 30, 2024 • 16 • 4

xmadai/Llama-3.1-Nemotron-70B-Instruct-xMADai-INT4

Text Generation • Updated Oct 30, 2024 • 386 • 4

xmadai/Llama-3.1-70B-Instruct-xMADai-INT4

Text Generation • Updated Nov 5, 2024 • 12