Defog sqlcoder model download
Hi there,I was trying to download defog/sqlcoder models. I was able to successfully load it:"from transformers import AutoTokenizer, AutoModelForCausalLMtokenizer = AutoTokenizer.from_pretrained(“defog/sqlcoder-7b-2”)model = AutoModelForCausalLM.from_pretrained(“defog/sqlcoder-7b-2”)"But when I try to save the model, it gives errors. I checked with official defog page and got suggestion to raise it here since there seems to be some issue in transformers library. Can you please help. Thanks
2024-09-10T07:35:11Z
Can you please showcase which error you’re getting?
2024-09-10T08:30:01Z
There is no verbose error. I when I execute line “model.save_pretrained()”. it says “killed” on terminal. Thats it
2024-09-10T08:38:30Z
This might be an issue related to your environment, perhaps you’re constrained on memory.Note that callingmodel = AutoModelForCausalLM.from_pretrained(“defog/sqlcoder-7b-2”)requires about 14GB of space on your disk.Could you try this on Google Colab and see if the same error occurs? If not, then it’s related to your machine.
2024-09-10T10:22:17Z
Hi@nielsr.  Yes I do have enough mem space. I did try saving a model of similar size and it did save it successfully. Not sure why this happened. I am using RTX4090 card