findings-acl.489
BASS: Batched Attention-optimized Speculative Sampling
Qian, Haifeng Gonugondla, Sujan Kumar Ha, Sungsoo Shang, Mingyue Gouda, Sanjay Krishna Nallapati, Ramesh Sengupta, Sudipta Ma, Xiaofei Deoras, Anoop