EncoderDecoderModel with Longformer and Bert
Hi,Is it possible to create EncoderDecoderModel using Longformer and Bert? I tried Longformer and Roberta and it works (the training runs), but if I use Longformer and Bert, I get this error messageRuntimeError: CUDA error: device-side assert triggeredwhen I train it.
2021-02-11T19:48:19Z
Normally Longformer and BERT should work in an encoder-decoder setting.If you have a CUDA error, it’s advised to test the code on CPU and see if you’re getting an error that is more interpretable.