Minimum number of tokens in generate
I am usingflant5-xxlto generate a sequence as followstokenizer = T5Tokenizer.from_pretrained("google/flan-t5-xxl",cache_dir="/home/racball/flan-t5-xxl--tokeniser")
model = T5ForConditionalGeneration.from_pretrained("google/flan-t5-xxl",cache_dir="/home/racball/models--flan-t5-xxl",device_map="balanced_low_0")generated = tokenizer.decode(model.generate(tokenizer('',return_tensors='pt').input_ids,min_new_tokens=30)[0])gives the result'<pad>. Images via Wikipedia, Wikimedia Commons, wikimedia.org, Wiki'However,len(tokenizer.encode(generated)) = 22which is less than themin_new_tokensI passed as the function argument.Shouldnt it generate a sequence of token length of atleast 30 according to the documentationhere? What am I doing wrong?