How to use optimum with encoder-decoder models
Optimum has recently added support for encoder-decoder type models. I have succesfully converted some of them (such as mt5) to ONNX using optimum. However, I have a encoder-decoder type model (Encoder Decoder Models) built using 2x Roberta type models, that I want to convert to ONNX. Whenever I try to do so, I get an “unsupported” message, giving me a list of the supported models (using this tutorialConvert Transformers to ONNX with Hugging Face Optimumwhich seems to be in line with the docs).I wanted to make sure that, since encoder-decoder models are a bit of a special case (Roberta is actually supported, but the combination of two of them in the form of a encoder-decoder model does not seem to be) there is actually no way for me to optimize my model’s inference in production using Optimum to use a ONNX version of the same.Thanks for your help,Sergio
2022-10-16T10:12:32Z
Hi@Giskard1994, is this related to thisissueposted on Github?