May I ask what compiler tool you used to compile it to gguf format?
Sorry, missed this before! I used the convert-hf-to-gguf.py script in the llama.cpp repository.
convert-hf-to-gguf.py
llama.cpp
· Sign up or log in to comment
