Secrets for custom inference endpoint?
I am in the process of creating an inference endpoint of a gated model.I went through the documentation but could not find a secure way of passing an authentication token to the custom handler.It seems that secrets and environment variables are only available in spaces, but not in inference endpoints.Here isa linkto my custom handler and to thecorresponding spacethat works fine thanks to a secret.I could hard code the token and make the model private to avoid leaking the token but that does not seem right.Any suggestion?
2024-01-08T16:59:12Z
Secrets in Inference Endpoints are not available yet, but they’re on the roadmap
2024-01-09T13:06:40Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.