emnlp-industry.34
TensorOpera Router: A Multi-Model Router for Efficient LLM Inference
Stripelis, Dimitris Xu, Zhaozhuo Hu, Zijian Shah, Alay Dilipbhai Jin, Han Yao, Yuhang Zhang, Jipeng Zhang, Tong Avestimehr, Salman He, Chaoyang