text
Hello, HuggingFace🤗 community 🌟,
Hello, HuggingFace🤗 community 🌟,
new_line
new_line
text
All the amazing people quantising LLMs to AWQ and GPTQ 🔧🤖
All the amazing people quantising LLMs to AWQ and GPTQ 🔧🤖
new_line
new_line
text
Can you please mention the perplexity you achieved 📉 OR any other metric to measure the quantisation qualitatively? 📊
Can you please mention the perplexity you achieved 📉 OR any other metric to measure the quantisation qualitatively? 📊
new_line
new_line
text
The GGUF community follows this really well! 👍
The GGUF community follows this really well! 👍
new_line
new_line
text
And if it is not too much to ask, the script used for quantisation would be amazing! 📝
And if it is not too much to ask, the script used for quantisation would be amazing! 📝
new_line
new_line
text
Thanks for the quants for the GPU poor! 💻
Thanks for the quants for the GPU poor! 💻
Hello, HuggingFace🤗 community 🌟,

All the amazing people quantising LLMs to AWQ and GPTQ 🔧🤖

Can you please mention the perplexity you achieved 📉 OR any other metric to measure the quantisation qualitatively? 📊

The GGUF community follows this really well! 👍

And if it is not too much to ask, the script used for quantisation would be amazing! 📝

Thanks for the quants for the GPU poor! 💻
👍
MichaelFried John6666 Duttones Nelathan
/avatars/ab4dd498bbc0d5931f733b5a364fa765.svg
Vitor Lima
Duttones
user