Is unsloth fine-tuning is good for the full precision model loading
Hello All,I recently fine-tuned aLlama3model using theunslothscript Here theScript LinkThe model is working fine whileload_in_4bitbecause its taking the unsloth tensor.image1486×676 101 KBWhen I’m doing inference with this model its giving really good response.Note: I used theLlama3 Instruct ModelWhen I’m trying to load the model in theFull PrecisionHere the code I usedCLICK HEREIts getting the model safetensors from themeta-llama/Meta-Llama-3-8B-InstructI can’t add more media as of now you check in the official page you can see the4 safetensorlistMy Issue is While loading the model in 4bit its giving the74%accuracy. the same model load in the full precision its giving the4%accuracy.Please some one help how to resolve please suggest some idea to fine tune a llama3 model without unsloth. thank you.
2024-07-25T07:34:31Z
https://www.reddit.com/r/unsloth/comments/1ea4ep2/comment/leoex4k/?context=3