naacl-long.179
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
Longpre, Shayne Yauney, Gregory Reif, Emily Lee, Katherine Roberts, Adam Zoph, Barret Zhou, Denny Wei, Jason Robinson, Kevin Mimno, David Ippolito, Daphne