Eval Loss spike Seq2seq Trainer Resume from Checkpoint
I ran Trainer.train(resume_from_checkpoint = True). The eval loss spiked from 1.x to 5.x, but training loss is decreasing consistently, any possible reasons for this? Thanksimage1429×739 108 KB