Stopping criteria
I have a model that I’m using through an inference endpoint. When using it locally, I implemented a stopping criteria.Is there a way to embed the stopping criteria in the model deployed through the inference endpoint ?Thanks
2024-03-11T21:37:24Z
Did you ever get to figure this out? I have a similar situation and would love to know how you handled this.
2024-03-12T04:28:53Z
In case it’s of help for others, the answer is here:Deploy LLMs with Hugging Face Inference Endpoints
2024-06-03T13:29:44Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.