GGUF Quants with iMatrix for the following model : https://huggingface.co/chargoddard/llama-2-34b-uncode

That model is based on the following dataset : https://huggingface.co/datasets/open-llm-leaderboard/details_chargoddard__llama-2-34b-uncode

It's basically an attempt to un-nerf CodeLlama 34b.

Here are some benchs made with LlamaCPP :

- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag,72.5,,400,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag,72.6,,1000,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag_Bin,70,,400,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag_Bin,72.5,,1000,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Arc-Challenge,38.12709030,,299,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Arc-Easy,64.73684211,,570,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,MMLU,35.14376997,,313,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Thruthful-QA,24.96940024,,817,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Winogrande,68.5872,,1267,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,wikitext,5.7595,512,512,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,wikitext,5.0113,4096,4096,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
{}
gguf region:us