NeurIPS.cc/2024/Datasets_and_Benchmarks_Track
DataComp-LM: In search of the next generation of training sets for language models
Jeffrey Li Alex Fang Georgios Smyrnis Maor Ivgi Matt Jordan Samir Yitzhak Gadre Hritik Bansal Etash Kumar Guha Sedrick Keh Kushal Arora Saurabh Garg Rui Xin Niklas Muennighoff Reinhard Heckel Jean Mercat Mayee F Chen Suchin Gururangan Mitchell Wortsman Alon Albalak Yonatan Bitton Marianna Nezhurina Amro Kamal Mohamed Abbas Cheng-Yu Hsieh Dhruba Ghosh Joshua P Gardner Maciej Kilian Hanlin Zhang Rulin Shao Sarah M Pratt Sunny Sanyal Gabriel Ilharco Giannis Daras Kalyani Marathe Aaron Gokaslan Jieyu Zhang Khyathi Chandu Thao Nguyen Igor Vasiljevic Sham M. Kakade Shuran Song Sujay Sanghavi Fartash Faghri Sewoong Oh Luke Zettlemoyer Kyle Lo Alaaeldin El-Nouby Hadi Pouransari Alexander T Toshev Stephanie Wang Dirk Groeneveld Luca Soldaini Pang Wei Koh Jenia Jitsev Thomas Kollar Alex Dimakis Yair Carmon Achal Dave Ludwig Schmidt Vaishaal Shankar