Get top_k tokens for each time step instead of the highest probability token
When using autoregressive models like GPT-2, GPT-NEO for text generation. At each time step, can we extractother candidate tokenswith their probabilities intop_kinstead of the token withhighest probability?cc@patrickvonplaten,@lysandre