Train tokenizer for seq2seq model
Hi all,I am trying to train the seq2seq model using t5v1.1My task is simple; I want to map text from format A to format Bfor example, 19 July 2020 → 19/07/2020. This is not my real data, just an example of what I am doing.I want to train the tokenizer for this data, but for the seq2seq model, the tokenizer needs to tokenize both input data and label, right?So, I am a bit confused about arranging the data to train the tokenizer.Should I concatenate input data and label together and then pass itold_tokenizer.train_new_from_iteratorI have read the docTraining a new tokenizer from an old one - Hugging Face NLP CourseBut I am still confused about seq2seq settingThanks