PushToHubCallback not uploading the model on huggingface automatically
I followed course onQuestion answering - Hugging Face Courseand even though it creates a folder in huggingface but the upload is not happening. Please not i logged in using “write API token”image894×736 36.3 KB
2022-05-10T04:00:14Z
No update on the huggingface page thoughimage1886×483 44.4 KB
2022-05-10T11:20:49Z
AFAIK this should’ve been fixed. Will try to reproduce your error
2022-05-10T11:24:46Z
its getting stored locally… under the name of the folder supplied in currect directory
2022-05-10T11:41:20Z
It’s normal that it’s stored locally, what callback does is that after every step/epoch it saves and pushes your model asynchronously, the pushing part here is apparently not working. Your internet might be the cause, the model size might be another reason, or something might be up (which I’m currently checking)A temporary fix is that after your model is trained you can just push the model itself with git-lfs.
2022-05-10T13:18:24Z
pls share a link for this… i have tried a few and they dont work on colab
2022-05-11T06:58:56Z
Even local storage seems to have stopped working here… there is no update after epoch 1 even though model is running 4th epochimage1837×818 114 KB
2022-05-11T12:23:22Z
Doingmodel.push_to_hub()should work for any modelIn the link you will find the documentation to this.
2022-05-11T12:53:45Z
I think we’ve seen few times issues with colab and mounted drive causing extremely slow uploadsTrainer.push_to_hub is taking lot of time, is this expected behaviour?
2022-05-11T23:33:20Z
@vanichandnacare to share the colab notebook you’re working out of if you’re still having problems? That way we may be able to assist a bit better.
2022-05-12T10:51:27Z
colab.research.google.comGoogle Colaboratoryhere are all the issues i m facingno auto uploading of models on huggingfacetraining never stops… even after all the epochs complete, training cell doesnt stop running.no intermediate updation of epochs locally