acl-long.220
SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training
He, Nan Xiong, Weichen Liu, Hanwen Liao, Yi Ding, Lei Zhang, Kai Tang, Guohua Han, Xiao Wei, Yang