Why is the average length of generated summaries during Hugging Face text summarization training much smaller than the actual average length of the training data?
Hello,I’m using Hugging Face’s text generation model to train a model on my own dataset for text summarization, and I’m noticing that the average length of generated summaries during training is much smaller than the actual average length of the training data.Here are some details about my setup:I’m usingSeq2SeqTrainerAPI in Hugging Face’s Transformers library to train thegoogle/flan-t5-smallmodel for text summarization.The average length of the target output text in my training data is around270words, while the average length of the summaries is only around20words.The final rouge1 score I get after training for 20 epochs is 25.In this context, I would like to ask several questions:Why the model is generating shorter texts of average 20 words while the training data has average 270 words?How can I force the model to generate longer summaries during training.I believe that if the model increases the length of generation then it will increase the rouge1 score too. Please share your feedback on this too.Thank you.
2023-11-20T00:57:26Z
Just curious were you able to resolve/understand this? If so how?