T5v1.1 tokenizer legacy=False
Hello, I am using t5v1.1 right now and have a question about the arglegacy. The only thing I know is it involves fixing some bugs.legacy(bool,optional) — Whether or not thelegacybehaviour of the tokenizer should be used. Legacy is before the merge of#24622and#25224which includes fixes to properly handle tokens that appear after special tokens. A simple example:legacy=True:But should I set it to false to use new behavior??