Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
Paper
•
2501.11873
•
Published
•
43
Zekun Wang
kugwzk
·
AI & ML interests
None yet
Recent Activity
authored
a paper
7 minutes ago
Demons in the Detail: On Implementing Load Balancing Loss for Training
Specialized Mixture-of-Expert Models
authored
a paper
7 days ago
OpenCSG Chinese Corpus: A Series of High-quality Chinese Datasets for
LLM Training
authored
a paper
12 days ago
Next Token Prediction Towards Multimodal Intelligence: A Comprehensive
Survey
Organizations
kugwzk's activity
authored
a
paper
7 minutes ago
authored
a
paper
7 days ago
authored
a
paper
12 days ago
Upload folder using huggingface_hub
#1 opened 15 days ago
by
kugwzk
updated
a
model
15 days ago
authored
a
paper
16 days ago
upvoted
a
paper
19 days ago
upvoted
a
paper
about 1 month ago
liked
a
Space
about 1 month ago
upvoted
a
paper
about 1 month ago
authored
a
paper
about 1 month ago
upvoted
a
paper
about 1 month ago
Upload seeclick.tar.gz.part_05 with huggingface_hub
#24 opened about 1 month ago
by
kugwzk
Upload seeclick.tar.gz.part_04 with huggingface_hub
#23 opened about 1 month ago
by
kugwzk
updated
a
dataset
about 1 month ago
Upload seeclick.tar.gz.part_03 with huggingface_hub
#22 opened about 1 month ago
by
kugwzk
Upload seeclick.tar.gz.part_02 with huggingface_hub
#21 opened about 1 month ago
by
kugwzk
Upload seeclick.tar.gz.part_01 with huggingface_hub
#20 opened about 1 month ago
by
kugwzk
Upload seeclick.tar.gz.part_00 with huggingface_hub
#19 opened about 1 month ago
by
kugwzk
Upload webui350k.zip with huggingface_hub
#18 opened about 1 month ago
by
kugwzk