text
Thrilled to unveil DS-MoE: a dense training and sparse inference scheme for enhanced computational and memory efficiency in your MoE models! 🚀🚀🚀
Thrilled to unveil DS-MoE: a dense training and sparse inference scheme for enhanced computational and memory efficiency in your MoE models! 🚀🚀🚀
new_line
new_line
text
Discover more in our blog: 
Discover more in our blog: 
link
https://huggingface.co/blog/bpan/ds-moe
https://huggingface.co/blog/bpan/ds-moe
text
 and dive into the details with our paper: 
 and dive into the details with our paper: 
resource
https://huggingface.co/papers/2404.05567
paper
2404.05567
https://huggingface.co/papers/2404.05567
Dense Training, Sparse Inference: Rethinking Training of
  Mixture-of-Experts Language Models (2404.05567)
Thrilled to unveil DS-MoE: a dense training and sparse inference scheme for enhanced computational and memory efficiency in your MoE models! 🚀🚀🚀

Discover more in our blog: https://huggingface.co/blog/bpan/ds-moe and dive into the details with our paper: https://huggingface.co/papers/2404.05567
❤️
samusenps umuthopeyildirim zoratrox osanseviero victor ybelkada mayank-mishra
🚀
samusenps ybelkada
https://cdn-avatars.huggingface.co/v1/production/uploads/5f17f0a0925b9863e28ad517/X7QKoiXbUtEZSG9jyvfk3.jpeg
Victor Mustar
victor
user