GGUF iMat Quants for : https://huggingface.co/bhenrym14/airophin-v2-13b-PI-8k-fp16

LlamaCPP Benchs :

- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,Hellaswag,79.5,,400,2024-02-05 00:00:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,Hellaswag,79.3,,1000,2024-02-05 00:00:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,Hellaswag_Bin,76.5,,400,2024-02-05 00:00:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,Hellaswag_Bin,79.4,,1000,2024-02-05 00:00:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,Arc-Challenge,45.81939799,,299,2024-02-05 05:40:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,Arc-Easy,73.68421053,,570,2024-02-05 05:40:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,MMLU,44.72843450,,313,2024-02-05 05:40:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,Thruthful-QA,23.50061200,,817,2024-02-05 05:40:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,Winogrande,71.8232,,1267,2024-02-05 05:40:00,PEC2,13b,Llama_2,4096,,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,wikitext,5.5078,512,512,2024-02-05 21:52:00,PEC2,13b,Llama_2,4096,02:45,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,wikitext,4.7064,4096,4196,2024-02-05 22:00:00,PEC2,13b,Llama_2,4096,03:25,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,wikitext,4.7402,8192,8192,2024-02-05 21:56:00,PEC2,13b,Llama_2,4096,03:05,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,wikitext,4.5743,12288,12288,2024-02-05 21:52:00,PEC2-RBF18168,13b,Llama_2,4096,02:45,,GGUF,Bhenrym_14,Nexesenex,
- bhenrym14_airophin-v2-13b-PI-8k-b1924-Q8_0.gguf,-,wikitext,4.6693,14848,14848,2024-02-05 22:00:00,PEC2-RBF22277,13b,Llama_2,4096,03:25,,GGUF,Bhenrym_14,Nexesenex,
{}
gguf region:us