Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
arxiv:
2407.11062
AutoTrain Compatible
Inference Endpoints
text-generation-inference
4-bit precision
Misc with no match
Eval Results
Merge
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
99
Full-text search
Edit filters
Sort: Trending
Active filters:
2407.11062
Clear all
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22, 2024
•
4
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22, 2024
•
4
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22, 2024
•
6
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22, 2024
•
4
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128-BitBLAS
Text Generation
•
Updated
Jul 22, 2024
•
6
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64-BitBLAS
Text Generation
•
Updated
Jul 22, 2024
•
6
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128-BitBLAS
Text Generation
•
Updated
Jul 22, 2024
•
6
ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ
Updated
Aug 6, 2024
•
5
•
25
Alignment-Lab-AI/w2g64-mistral-large-intruct-gptq
Updated
Aug 12, 2024
•
3
Previous
1
2
3
4
Next