Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:
ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Home/Authors/Wanru Zhao
Recent (6 mo)
1
With code
0
Influential cites
0
Benchmarked
0

Publications per year

1
26

Top categories

ML×1AI×1Distributed×1Systems and Control×1

Frequent co-authors

Lorenzo Sani1×
Zeyu Cao1×
Meghdad Kurmanji1×
Alex Iacob1×
Andrej Jovanovic1×
Yan Gao1×

Research Timeline

2026
FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs

This paper introduces FoMoE, a system that reduces communication costs and achieves speedups in training large language models by partitioning expert layers across workers.

Highlighted terms show continued research focus across papers

Papers