acl-long.427
Analysing The Impact of Sequence Composition on Language Model Pre-Training
Zhao, Yu Qu, Yuanbin Staniszewski, Konrad Tworkowski, Szymon Liu, Wei Mi{\l}o{\'s}, Piotr Wu, Yuxiang Minervini, Pasquale