Model Agnostic Hybrid Sharding For Heterogeneous Distributed Inference Paper • 2407.19775 • Published Jul 29, 2024
Meta-Learning for Speeding Up Large Model Inference in Decentralized Environments Paper • 2410.21340 • Published Oct 28, 2024
Towards Secure and Private AI: A Framework for Decentralized Inference Paper • 2407.19401 • Published Jul 28, 2024