Can trainer.predict() return multiple generations for each sample?
I am looking for a similar feature as in model.generate() which takes a parameternum_return_sequences. It decides how many generations should be returned for each sample. It is especially useful when using beam search and analyzing the effect of beam search on the metrics.Trainer.predict() does not seem to support this feature. Is there a workaround? I can use model.generate() but then it was very slow last time because I have to create a for loop iterating over batches whereas trainer.predict automatically handles the data loading separating
2021-11-25T08:16:27Z
Hi@berkayberabi! I have a similar problem. Did you manage to solve this issue?
2022-01-18T21:39:51Z
Hi Silvia,No unfortunately, I could not solve it