Training Arguments - eval_step vs save_step
I am confused a little bit about these two arguments and I did read thedocumentation here. So my question is as follows:wheneval_stepis less thansave_stepand if the best eval_step results does not correspond to the save_step, which step is saved?For example --eval_step= 200 and --save_step=400.300th step loss: 0.4400th step loss: 0.5So, obviously 300th is better than 400th in terms of loss. Which step’s weights would be saved?Thank you in advance.
2021-03-18T14:42:52Z
Unless you are using another argument, the save doesn’t care about the best model, so will just save everysave_stepsregardless of which step had the better loss.
2021-03-18T14:49:03Z
Oh I see, I misinterpretthanks a lot