Recommend argument values for transformers.generation_utils.GenerationMixin.generate() for summarization and translation tasks?
Are there a set of recommended argument values folks should pass togeneratefor summarization and for translation?I’m looking for values that generally work for those tasks generally, as well as, values that are recommended for specific models.  If any of this is documented somewhere I’d love to get the link(s) to such resources.Thanks
2020-12-24T07:25:04Z
Hi@wgpubsThe values will be different for different models and tasks, you should try and see what works for you. Also, almost every pre-trained model comes with some default values which you find in itsconfigfile.For ex, if you look atbart-large-cnnmodel’sconfig, it uses  4num_beamswithno_repeat_ngram_size3.Also, this blog explains differentgenerationarguments and should help pick values for thosehttps://huggingface.co/blog/how-to-generate