Rouge eval metrics in summarization not computing
Hello@philschmidI was trying to fine tune a summarization model with a very small data set (100 samples) and none of the rouge eval metrics are being computed in the training job. Is there size limit in terms of samples that could be causing this?Thank you.
2021-09-22T07:48:43Z
Hello@Jorgeutd,Are you using theexamples/script? and are you passing thehyperparameter→'predict_with_generate': True,predict_with_generate (bool, optional, defaults toFalse):Whether to use generate to calculate generative metrics (ROUGE, BLEU).`
2021-09-23T13:39:19Z
Thank you@philschmid. I reviewed indeed that the run summ.py script this time.