ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
Paper
•
2412.14711
•
Published
•
15
Ziteng Wang
thuwzt
AI & ML interests
None yet
Recent Activity
authored
a paper
22 days ago
Efficient Backpropagation with Variance-Controlled Adaptive Sampling
authored
a paper
22 days ago
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
upvoted
a
paper
27 days ago
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
Organizations
None yet