Text generation confidence
Hi.I’m working on fine-tuning seq2seq models and having a question about the validation of the generated output. As far as I understand, when using beam search for text generation, it is possible to get asequences_scoresmetric from thegenerate()function as describedhere. Is it right that this can be treated as the confidence of the model in the generated output and takingtorch.exp()fromsequences_scoreswould give me some sort of understandable value from which I can make conclusions about the quality of results?
2022-12-07T15:43:21Z
Hi, did you ever find a solution to your question?