Edit Models filters

Model Tree

neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

3

Full-text search

Active filters: neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4

neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic

Text Generation • Updated Dec 19, 2024 • 47 • 1

neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16

Text Generation • Updated Dec 19, 2024 • 134 • 3

DevQuasar/neuralmagic.Sparse-Llama-3.1-8B-ultrachat_200k-2of4-GGUF

Text Generation • Updated Dec 8, 2024 • 9