Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
llmcompressor
8-bit precision
Misc with no match
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
5
Full-text search
Edit filters
Sort: Trending
Active filters:
llmcompressor
Clear all
neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation
•
Updated
Oct 16, 2024
•
3.87k
•
7
neuralmagic/Llama-3.2-1B-Instruct-FP8
Text Generation
•
Updated
Oct 16, 2024
•
6.98k
•
2
neuralmagic/Llama-3.2-3B-Instruct-FP8
Text Generation
•
Updated
Oct 16, 2024
•
16.2k
•
3
neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation
•
Updated
Oct 16, 2024
•
6.41k
•
1
GusPuffy/Llama-3.1-70B-ArliAI-RPMax-v1.3-GPTQ
Updated
Dec 3, 2024
•
34
