Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
ML×1AI×1Distributed×1Systems and Control×1
Frequent co-authors
Research Timeline
2026
FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs
This paper introduces FoMoE, a system that reduces communication costs and achieves speedups in training large language models by partitioning expert layers across workers.
Highlighted terms show continued research focus across papers