naacl-long.260
Effective Long-Context Scaling of Foundation Models
Xiong, Wenhan Liu, Jingyu Molybog, Igor Zhang, Hejia Bhargava, Prajjwal Hou, Rui Martin, Louis Rungta, Rashi Sankararaman, Karthik Abinav Oguz, Barlas Khabsa, Madian Fang, Han Mehdad, Yashar Narang, Sharan Malik, Kshitiz Fan, Angela Bhosale, Shruti Edunov, Sergey Lewis, Mike Wang, Sinong Ma, Hao