Problem to deploy endpoint
Hello!So, Im doing everything correct.I used llama3 as base to fine tune the model.But when I deploy to the endpoint it gives me the error:I need to request access to the model.To accept the terms.But I already did that, so my guess is that when I create the endpoint Im not autenticate with my hugging face token.Because even if this pass, using other models, is going to have trouble when access my fine tuned model.So the question is, what I need to do?
2024-05-16T16:55:19Z
@GuilhermeGiolHi! You can now add an env variable for authentication when deploying your fine-tuned model using Inference Endpoints. You’ll see this field under ‘Advanced Configuration’. Please let us know if you have any questions or feedback!env variables1796×488 27.4 KB
2024-07-15T05:51:38Z
@Meganariley. Thanks Megan. Where do you find the information that goes in the key and value fields? I feel like this is a dumb question, but I don’t think it is the access token since the terminology doesn’t align.
2024-07-19T13:59:40Z
Hi@RedFoxPandaWe have some documentation onenv variables- let me know if you have additional questions!