Does the token allowance refresh on a monthly basis?
I’ve recently started using the inference API and my dashboard shows that I’ve nearly used up my allowance.Does this allowance refresh on a monthly basis or will I need to purchase a plan in order to keep using it?Please clarify.
2023-01-16T08:32:40Z
cc@michellehbn
2023-01-16T11:16:10Z
Hi@Azuremis! Thanks for reaching out and happy new year! For larger volumes of requests, or if you need guaranteed latency/performance, you can use our new solutionInference Endpointsto easilydeploy your modelson dedicated, fully-managed infrastructure. Inference Endpoints will give you the flexibility to quickly create endpoints on CPU or GPU resources, and is billed by compute uptime vs character usage. Further pricing information can be foundhere. Our PRO subscription will give you higher Inference API rate limits than the free Inference API plan, and the limit allowance is refreshed monthly. Please let us know if there are any other questions! Thanks again!
2023-01-16T16:13:49Z
Thank you for raising@philschmidand@michellehbnfor clarifying how the inference endpoint refresh, rates and performance works. My query has been perfectly answered