Aws sagemaker multimodel endpoint
Hi team,how to deploy multiple hugging face models for inference on a single aws sagemaker endpoint?Actually I have a AWS lambda from which I’m invoking the endpoints, I’ve 3 endpoints but I want them into single AWS endpoint to save my AWS billing amount, I’m finding article but did not find anyplease help me with how can I get my three models into single endpoint for inference.Thank you
2023-02-02T09:39:19Z
You can find step by step instructions on creating a multi-model endpoint on SageMaker at the following link. The guide has detailed instructions of creating the MME.docs.aws.amazon.comCreate a Multi-Model Endpoint - Amazon SageMakerCreate and deploy a Amazon SageMaker multi-model endpoint.