Does tokenizer.max_model_input_sizes do anything?
Hi,Is themax_model_input_sizesfield on a tokenizerused anywhere, and how does it interact with themax_position_embeddingsfield on a model? I don’t see any usages of this field outside of a research script.Thanks,Norman