Lorenzo Sani
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
ML×1AI×1Distributed×1Systems and Control×1
Frequent co-authors
Research Timeline
2026
FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs
This paper introduces FoMoE, a system that reduces communication costs and achieves speedups in training large language models by partitioning expert layers across workers.
Highlighted terms show continued research focus across papers
Papers
cs.LGcs.AIcs.DCEmpiricalRecentJun 17, 2026
FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs
Lorenzo Sani, Zeyu Cao, Meghdad Kurmanji, Alex Iacob +4 more
This paper introduces FoMoE, a system that reduces communication costs and achieves speedups in training large language models by partitioning expert layers across workers.
View →