Anyone else VERY confused?
Just upgraded to ‘PRO’…I thought that would mean I could get APIs/endpoints to connect my projects to different models…But… Nope.Still will have to purchase at a minimum .60/hr hosted GPU Inference Endpoints…Is that correct?  How are we supposed to be using this platform?  My head is spinning.
2023-12-19T20:59:17Z
hi@squatchydev9000,Apologies for the confusion, as a Pro user you can access Inference for these special large LLM, read morehereas well as higher rate limits for thousands of compatible models on the hub see all taskshereFor custom GPU hardwares and Inference Endpoints follow the pricinghereandhereHugging Face PRO users now have access to exclusive API endpoints for a curated list of powerful models that benefit from ultra-fast inference powered bytext-generation-inference. This is a benefit on top of the free inference API, which is available to all Hugging Face users to facilitate testing and prototyping on 200,000+ models. PRO users enjoy higher rate limits on these models, as well as exclusive access to some of the best models available today.Here are the special list of large language models running with TGIModel IDTaskgoogle/flan-t5-xxltext2text-generationgoogle/flan-ul2text2text-generationbigcode/starcodertext-generationcodellama/CodeLlama-13b-hftext-generationcodellama/CodeLlama-34b-Instruct-hftext-generationHuggingFaceH4/starchat-betatext-generationHuggingFaceH4/zephyr-7b-alphatext-generationHuggingFaceH4/zephyr-7b-betatext-generationHuggingFaceM4/idefics-80b-instructtext-generationmeta-llama/Llama-2-70b-chat-hftext-generationmistralai/Mistral-7B-Instruct-v0.1text-generationmistralai/Mistral-7B-Instruct-v0.2text-generationmistralai/Mistral-7B-v0.1text-generationopenchat/openchat_3.5text-generationtiiuae/falcon-180B-chattext-generationtiiuae/falcon-7b-instructtext-generationbigscience/bloomtext-generation