DistilHubert: PyTorch to ONNX conversion issue
Hello there!My team has trained a model whose upstream model was DistilHuBERT. We’re happy with the outcomes, and we’d like to convert it to ONNX in order to deploy to multiple platforms.We obtain the following error when we try the conversion withtorch.onnx.export():RuntimeError: ONNX export failed: Couldn't export Python operator GradMultiplyHas anyone else run into this issue? What’s the best practice - ask the ONNX team to implementGradMultiply, or is there already some workarounds we can apply?@merve@mervenoyansuggested me to drop the question here. Many Thanks!
2022-02-24T10:44:50Z
Welcome to our forum!Pinging@lewtunhere
2022-02-24T11:02:43Z
Hey@Onur, thanks for your message! For this kind of error, it would be best to open an issue on the PyTorch side since the op in question doesn’t seem to be supported yet. Once they’ve done that, feel free to open an issue / PR ontransformersto support the ONNX conversion directly in the library
2022-02-24T12:07:48Z
Onur:RuntimeError: ONNX export failed: Couldn't export Python operator GradMultiplyThank you@lewtunand@mervefor quick response! I’ll take it to PyTorch first.