Sagemaker multimodel endpoint
Hi team,how to deploy multiple hugging face models for inference on a single aws sagemaker endpoint?Actually I have a AWS lambda from which I’m invoking the endpoints, I’ve 3 endpoints but I want them into single AWS endpoint to save my AWS billing amount, I’m finding article but did not find anyplease help me with how can I get my three models into single endpoint for inference.Thank you
2023-02-02T09:42:17Z
SeeAws sagemaker multimodel endpoint - #2 by crajah