Saving eval loss for every evaluation/saved checkpoint with Trainer
I am running the trainer with--do_eval  --report_to none --evaluation_strategy epoch --num_train_epochs 10so I am expecting the trainer to evaluate after every epoch and saving those results in eithereval_results.jsonorall_results.json. But those files unfortunately only contain the results of the last evaluation.It is useful that checkpoints are saved, but I cannot seem to find the evaluation results for each checkpoint. That would be very useful to select the optimal checkpoint.
2021-10-04T12:17:13Z
There will be in thelog_historyfield of thetrainer_state, which is also saved in the same folder.
2021-10-04T12:46:42Z
Excellent, thanks!