TRL loss blowing up
Hello@lvwerra,@natolambert, I am trying to use a Pegasus model and improve it in certain aspects using the TRL library. My reward function is based on ROUGE. While training it on a subset of the CNN dataset, the model loss seems to explode and the model outputs gibberish. Since I am new to this area, I needed some help understanding the problem. You can view the Wandb logshere.Best,Raj
2023-03-15T14:03:18Z
Hi@RajSangcould you please share a Colab notebook or a minimal example that reproduces your problem? That will help us better understand what’s going wrong
2023-03-16T00:30:51Z
Thanks for responding@lewtun,hereis the colab notebook!