Download count for a model deployed as a serverless endpoint
Hi!A while ago I finetuned a BERT model, pushed it to thehub, and subsequently deployed it as a Sagemaker endpoint with a serverless configuration. I noticed that the download counter on the hub shows quite a lot of downloads (currently around 1600 the last month), even though it’s quite a niche model. So I was wondering: does the serverless endpoint download the model from the hub every time it boots thus increasing the download count substantially?
2022-09-26T08:59:20Z
Did you use thehubconfiguration withmodel_idandtask? If so yes then everytime the Serverless function is started from a cold start it loads the model
2022-09-26T09:00:49Z
I did! And good to know, thanks!