T5 randomness in generation
Hello,I would like to use the T5 network to obtain different outputs with same input, like an intelligent randomness in generation.Example:

Run1:
Input: input1
Output: output1

Run2:
Input: input1
Output: output2

...How can I do this?Thank you
2022-05-10T10:06:56Z
Hi GennaroYou can use thedo_sampleparameter to introduce randomness in text generation.Example:Once you use sampling, you can even generate multiple responses with one inference request using thenum_return_sequencesparameter:Capture2823×286 8.14 KBHope that helps!CheersHeiko
2022-05-10T10:11:34Z
Hey, i also found this article from huggingface really useful for your problemHow to generate text: using different decoding methods for language generation with TransformersBest regards
2022-05-11T15:13:17Z
@marshmellow77Thank you, it works fine!@tilomichelthank you too!
2022-05-15T05:35:59Z
Where is the usecase of this?