Edit Models filters

Inference status

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

645

Full-text search

Active filters: compressed-tensors

cortecs/phi-4-FP8-Dynamic

Updated 5 days ago • 10k • 3

cortecs/Llama-3.3-70B-Instruct-FP8-Dynamic

Updated Dec 13, 2024 • 17.7k • 8

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 40.5k • 38

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10, 2024 • 7.3k • 19

neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2, 2024 • 5.67k • 19

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated Oct 16, 2024 • 10.1k • 4

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1, 2024 • 8 • 2

nm-testing/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Updated Nov 15, 2024 • 210 • 3

speakleash/Bielik-11B-v2.3-Instruct-W8A8-fp8

Updated Nov 26, 2024 • 130 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v1.2-FP8-Dynamic

Updated Dec 1, 2024 • 1.31k • 1

BigHuggyD/Monstral-123B-v2-FP8-Dynamic

Text Generation • Updated Dec 12, 2024 • 250 • 1

nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic

Updated Dec 6, 2024 • 19.2k • 9

CalamitousFelicitousness/Llama-3.3-70B-Instruct-W8A8-INT8

Updated Dec 7, 2024 • 376 • 4

Trelis/Microsoft_Phi-4-FP8-Dynamic

Updated Dec 13, 2024 • 151 • 1

alpindale/L3.3-70B-Magnum-v4-SE-FP8

Updated 3 days ago • 26 • 1

BigHuggyD/Steelskill_L3.3-MS-Nevoria-70b-FP8-Dynamic

Text Generation • Updated about 24 hours ago • 51 • 1

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • Updated Oct 9, 2024 • 10

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • Updated Oct 9, 2024 • 23

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • Updated Oct 10, 2024 • 19

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • Updated Oct 9, 2024 • 18

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • Updated Oct 9, 2024 • 17

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • Updated Oct 9, 2024 • 23

nm-testing/tinyllama-one-shot-w4a16-group128-packed

Text Generation • Updated Oct 9, 2024 • 16

nm-testing/llama3-8b-w8_channel-a8_tensor-compressed

Text Generation • Updated Oct 9, 2024 • 23

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24

Text Generation • Updated Jun 4, 2024 • 19

nm-testing/llama7b-one-shot-2_4-w4a16-group128-packed

Text Generation • Updated Jun 4, 2024 • 23

nm-testing/llama1.1b_0.5_sparse_bitmask

Text Generation • Updated Oct 9, 2024 • 20

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t

Text Generation • Updated Oct 9, 2024 • 3.85k • 1

nm-testing/tinyllama-one-shot-w8a8-dynamic-channel

Text Generation • Updated Oct 9, 2024 • 20

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t-alt

Text Generation • Updated Oct 9, 2024 • 18