text
Dear all,
Dear all,
new_line
new_line
text
We are happy to share that we have just open-sourced over 200 low-bit LLMs. For the MLX community, we have prepared 2-4 bit versions of mainstream LLMs. You can visit the following collection to access them: 
We are happy to share that we have just open-sourced over 200 low-bit LLMs. For the MLX community, we have prepared 2-4 bit versions of mainstream LLMs. You can visit the following collection to access them: 
resource
https://huggingface.co/collections/GreenBitAI/greenbitai-mlx-llm-6614eb6ceb8da657c2b4ed58
collection
GreenBitAI/greenbitai-mlx-llm-6614eb6ceb8da657c2b4ed58
https://huggingface.co/collections/GreenBitAI/greenbitai-mlx-llm-6614eb6ceb8da657c2b4ed58
text
. 
. 
new_line
new_line
text
These low-bit models can be conveniently used through our open-source tool at 
These low-bit models can be conveniently used through our open-source tool at 
link
https://github.com/GreenBitAI/gbx-lm
https://github.com/GreenBitAI/gbx-lm
text
. 
. 
new_line
new_line
text
Compared to other open-source quantization algorithms, these models provide better accuracy retention. We have provided some model evaluation results here: 
Compared to other open-source quantization algorithms, these models provide better accuracy retention. We have provided some model evaluation results here: 
new_line
link
https://github.com/GreenBitAI/green-bit-llm/blob/main/green_bit_llm/evaluation/README.md
https://github.com/GreenBitAI/green-bit-llm/blob/main/green_bit_llm/evaluation/README.md
text
. 
. 
new_line
new_line
text
You can also evaluate the models yourself using the evaluation script we provided.
You can also evaluate the models yourself using the evaluation script we provided.
Dear all,

We are happy to share that we have just open-sourced over 200 low-bit LLMs. For the MLX community, we have prepared 2-4 bit versions of mainstream LLMs. You can visit the following collection to access them: https://huggingface.co/collections/GreenBitAI/greenbitai-mlx-llm-6614eb6ceb8da657c2b4ed58. 

These low-bit models can be conveniently used through our open-source tool at https://github.com/GreenBitAI/gbx-lm. 

Compared to other open-source quantization algorithms, these models provide better accuracy retention. We have provided some model evaluation results here: 
https://github.com/GreenBitAI/green-bit-llm/blob/main/green_bit_llm/evaluation/README.md. 

You can also evaluate the models yourself using the evaluation script we provided.
🔥
YaTharThShaRma999 victor yanghaojin alobnayis NicoNico KingNish adhisetiawan clem
👍
NicoNico adhisetiawan clem
https://cdn-avatars.huggingface.co/v1/production/uploads/64b9f4569d8360edd98a9b62/HsPmCGBbgcrtj0VLVY_ex.png
fhsp
fhsp93
user