Mixture of Experts (MoEs) - a parinayachaturvedi Collection

parinayachaturvedi 's Collections

MultiLingual LLMs

Mixture of Experts (MoEs)

Multimodal LLMs

Vision Language Models (VLM)

LLMs as Synthetic Data Generators

Mixture of Experts (MoEs)

updated 30 days ago

Monet: Mixture of Monosemantic Experts for Transformers

Paper • 2412.04139 • Published Dec 5, 2024 • 11