wzhouad/gemma-2-9b-it-WPO-HB
Text Generation
•
Updated
•
47
•
33
Hello bartowski, have you considered doing q4_1 quants? My testing has consistently found that q4_1 is the best quant for Macs. More info here:
https://huggingface.co/mradermacher/model_requests/discussions/299