can you upload an exlama quant? thnaks
A friend of mine is quanting the model, 6bpw is up and others are being worked on.
https://huggingface.co/lucyknada/cgato_Nemo-12b-Humanize-KTO-v0.1-exl2
· Sign up or log in to comment
