Deploying Seq2Seq using ONNX on GPU
Has anyone deployed a seq2seq model by converting it to ONNX?What I want to do:Convert T5 (preferably, but any seq2seq model should work)  to ONNXUse the ONNX RT or Tensor RT runtime and host the ONNX model using TritonRun the model on the GPUDo batch inferenceAny help on this would be appreciated