Pinning models doesn't seem to work
We’ve pinned models (both using the API call and using the dashboard atDashboard - Hosted API - HuggingFace), but still get “currently loading” errors when we try to make inference API calls.One example: modelhttps://huggingface.co/redwoodresearch/redwood_deberta-v3-sift_82b19d290a74410caa804fa47e94a80b(private but we can make it public if that would help). It’s currently (supposedly) pinned but still requires a minute of warmup after a period of inactivity.Let me know if there’s anything we should do differently!
2022-01-20T03:56:53Z
@NarsilSeems like you’ve worked on pinned models before - any chance you could take a look?
2022-04-05T17:37:55Z
Were you able to solve this problem?
2022-07-27T08:09:58Z
hey same problem. pinned model always loads up when at rest for some time. any solutions here?
2022-08-05T18:02:33Z
I have the same problem when pinning the modelallenai/tk-instruct-11b-def, never even loaded. However, it is not working in the model’s page at hugging face which may suggest it is a problem on HuggingFace’s side.On the other hand, I tried pinning a smaller model (the 3B) version and it worked like  a charm
2022-08-09T14:17:08Z
@Cbelem,Actually pinning works. It’s just that this model is too big to be loaded by default.What is actually failing is the detection that this model is too big to be loaded by the machines we’re using. In order to run these large models we need to discuss it (Since we need different hardware than the standard one).Hope that answers your questions.Cheers,Nicolas