text
Try to find a better int4 algorithm for LLAMA3.1?  For the 8B model, AutoRound boasts an average improvement across 10 zero-shot tasks, scoring 63.93 versus 63.15 (AWQ). Notably, on the MMLU task, it achieved 66.72 compared to 65.25, and on the ARC-C task, it scored 52.13 against 50.94. For further details and comparisons, visit the leaderboard at 
Try to find a better int4 algorithm for LLAMA3.1?  For the 8B model, AutoRound boasts an average improvement across 10 zero-shot tasks, scoring 63.93 versus 63.15 (AWQ). Notably, on the MMLU task, it achieved 66.72 compared to 65.25, and on the ARC-C task, it scored 52.13 against 50.94. For further details and comparisons, visit the leaderboard at 
resource
https://huggingface.co/spaces/Intel/low_bit_open_llm_leaderboard
space
Intel/low_bit_open_llm_leaderboard
https://huggingface.co/spaces/Intel/low_bit_open_llm_leaderboard
text
.
.
Try to find a better int4 algorithm for LLAMA3.1?  For the 8B model, AutoRound boasts an average improvement across 10 zero-shot tasks, scoring 63.93 versus 63.15 (AWQ). Notably, on the MMLU task, it achieved 66.72 compared to 65.25, and on the ARC-C task, it scored 52.13 against 50.94. For further details and comparisons, visit the leaderboard at https://huggingface.co/spaces/Intel/low_bit_open_llm_leaderboard.