Incorporate SARI score into run_summarization.py example script
I am working with the example summarization script provided by Huggingfacehere. My task is not quite summarization, but a different seq2seq task where I would like to use the SARI metric to evaluate my models. The compute_metrics function in this script takes only the predictions and labels as input, making it easy to calculate ROUGE or BLEU sores, but does not include the source text, which is required for computing the SARI score. The compute_metrics function is then given to the Seq2SeqTrainer as an argument, and I’m not sure how it is used from there. Does anyone have any guidance on how I can edit this function to be able to take the source text as an argument as well? Thanks!