Returning Multiple Questions for a Question Generation Model on SageMaker
Hi,I am using valhalla/t5-base-qa-qg-hl(valhalla/t5-base-qa-qg-hl · Hugging Face) Text2Text-Generation Model to generate questions from some context. When it comes to inference, I have found that on sagemaker it is only returning one output, while running the model locally the model generates multiple output.I wanted to get all the model outputs from sagemaker endpoint. I am using the sagemaker api to deploy it there.Thanks,Jatin