How to quickly change the inferece.py for an endpoint on AWS SagemMaker
I wondered how to change the inference script of a deploy hugging face model.
2022-12-02T18:27:18Z
Unfortunately this is not really possible, at least to my knowledge.What you could do instead is to uselocal modein SageMaker. Instead of deploying the model to a real-time endpoint you can “simulate” the deployment on the local machine (e.g. a Notebook instance). This way you can quickly test the deployment and change it as needed. Once the tests are successful you can deploy to the actual endpoint.Here is anexamplehow to do that with a HF model. More info on theGithub page.Hope that helps.CheersHeiko