Using penalized sampling from CTRL
SoCTRLuses a new decoding mechanism calledPenalized samplingwhich basically discounts the scores of previously generated tokens. I was wondering about the implementation withmodel.generate. Isrepetition_penalty=1.2withtemperature=0sufficient ?
2021-02-04T16:34:04Z
Withrepetition_penaltyset, I’m not seeing as compelling generation as the ones mentioned in the paper. I’m trying out with other decoding strategies as well. If you’ve a suggestion about parameters which works best withCTRL, please let me know.