Summarization with mT5
Hello,I am trying to do summarization with mT5 and when I use the official summarization colab which uses seq2seq trainer, the model outputs trash. You can see myGitHub issue here. Do you have any ideas on how to proceed with summarization using mT5?
2021-05-16T10:51:32Z
disabling fp16 seems to solve the issue, but I would rather have fp16 because it doubles the training speed