Deploying 🤗 ViT on Vertex AI
@sayakpaull and I have been covering the deployment aspects of (TensorFlow) vision models fromTransformers, and we’re delighted to announce the final post on that series today!In this post, we cover deployment with Vertex AI. You’ll learn how to deploy a ViT B/16 following best practices, consuming the deployed endpoint in different forms, conducting load-tests, and, more importantly, the pricing around the deployment.When we started this series, there was a dearth of resources showing how to deploy TF models fromTransformers to GCP(Google Cloud Platform) and TF ecosystem following good practices. We wanted to close that gapHere’s the latest post:DeployingViT on Vertex AIFor those of who are interested in the last postDeployingViT on Kubernetes with TF ServingThanks to all the reviewers from:@merve, osanseviero, joaogante, Matthew Carrigan, and stevhliu! (sorry for not mentioning others since a new user like me can only mention two person in a post)
2023-09-25T10:55:52Z
Thanks for this blog. This one is for tensorflow models on huggingface. Are there any similar guides to deploy pytorch based huggingface models on Vertex AI