Any simple functionality to use multiple metrics together?
Some tasks like question generation requires multiple metrics (BLEU, METEOR, ROUGE).It would be quite helpful if there is a function such asload_metric(['bleu', 'meteor', 'rouge'])
2021-05-18T12:48:09Z
hey@ad26kr, thanks for the suggestion!one complication i see is that some metrics likeglueare paired a subtask:metric = load_metric('glue', sub_task)so it’s not clear what should happen if someone passes something likeload_metric(["bleu", "glue"])in your proposal. nevertheless, i invite you to open a feature request on thedatasetslibrary where it can be discussed in more detail:Issues · huggingface/datasets · GitHub
2021-08-16T12:45:26Z
Do we still have this feature?
2021-09-13T08:49:43Z
Please. Did you add multi-metric feature to huggingface or not yet?