Is it possible to tokenize multiple text modalities?
Do the tokenizers in the transformers package support tokenization of triplets?For example:Lets assume we’re dealing with a VQA dataset. Each entry in the dataset contains the following information:Image nameQuestion5 possible answers (1 is correct)Image captionsI would like to able to represent each input as:[CLS] Q + [SEP] + A + [SEP] + CAPTIONS
2022-09-01T08:27:51Z
Did you figure out an answer to this?