Difference between vocab_size in model T5forConditionalGeneration "t5-small" and its corresponding Tokenizer "t5-small"
There appears to be a difference betweenmodel.config.vocab_sizeandtokenizer.vocab_sizefor T5ForConditionalGeneration - t5-small. Not sure where the additional 28 tokens appear from. Why is that so? Bart does not have this issue.Screenshot 2021-12-10 at 11.08.59 AM737×441 72.3 KB
2023-06-30T03:19:05Z
Hi@ashutoshmlis this resolved now?If so what is the final verdict?Thanks