For MLM task, TextDataset or LineByLineTextDataset which one is better?
I’m trying to train T5 with unsupervised denoising training method.I foundTextDatasetandLineByLineTextDatasetin Transformers library while I looking for a dataset to use.Which one is better in terms of accuracy? or which one is more commonly used?
2023-12-08T12:21:44Z
I thinkLineByLineTextDatasetwill be deprecated soon