What is the Quota on ZeroGPU for PRO users?
I am a PRO user and I have a space running on the ZeroGPU. It is pretty neat, but after a few inferences I get an error that says Quota is Exceeded and some numbers like: Requested 42s and 60s…3 questions please:What is the quota and how is it calculated?How do I interpret the numbers/seconds i.e “requested 42s on 60s”?What is the path towards getting to a point with no quota limitations like this?I read another post like:GPU quota exceeded even when using access token from PRObut it is not very helpful to answer my specific questions.
2024-06-26T13:27:29Z
Hi@amaraaThe quota on ZeroGPU for PRO users limits GPU usage to a specified time per session. ‘Requested 42s on 60s’ means your session requested 42 seconds of GPU time but was limited to 60 seconds.
2024-06-26T14:31:08Z
@LLUMOAI- Can you please elaborate?I am still not sure I understand what the quota is based on your answer. Usually, when service providers talk about quota they publish things like: “60 requests per minute” or “3GB per hour”…etc. What is the quota of GPU time here?And “Requested 42s on 60s” → if it means the session requested 42 seconds of GPU time and the limit was 60 seconds doesn’t it mean there is enough? The way I understand it is that there is 60 seconds available and my session requested 42sec?Also, I noticed that when this error happens then the error also shows that I should try again in like 8 minutes and at times even 35 minutes or 40 minutes. So, I am very confused as to how this is calculating.
2024-07-23T14:14:02Z
Hi@amaraaQuota: GPU quota can be complex, often tied to overall resource availability. Check your service plan details for specifics.“Requested 42s on 60s”: It means you requested 42 seconds within a 60-second window, and you were within limits. Issues may be due to the overall resource load.Retry Times: Suggested wait times reflect system load and resource allocation.For detailed info try reaching out to Hugging Face support.
2024-08-10T22:23:00Z
LLUMOAI:Check your service plan details for specifics.These are not answers to the questions…What service plan are you talking about?Clearly this is an error being triggering as a result of the system believing we’re outside of the limit.How are the numbers calculated?My situation: Despite not submitting an inference request on any Space in many hours, my first attempt to do so this evening yields: You have exceeded your GPU quota (58s left vs. 60s requested)In the last 24 hours, I’ve submitted two/three requests (approximately 3-4 hours ago) under another user’s Space relating to auto-captioning a very small number of individual image uploads.
2024-08-29T16:27:59Z
We have the same kind of issue, both on a public and private space in the same organization.We get things like this in the logs:gradio.exceptions.Error: ‘No GPU is currently available for you after 60s’andgradio.exceptions.Error: ‘GPU task aborted’andgradio.exceptions.Error: ‘You have exceeded your GPU quota (33s left vs. 60s requested). Sign-up on Hugging Face to get more quotas or retry in 0:46:09’The latter can even happens when we are signed into an account and use a private space.