Song Guo
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
Networking×1NLP×1
Frequent co-authors
Research Timeline
2026
HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference
This paper proposes HetRoute, a framework for optimizing Mixture-of-Experts model inference over geo-distributed heterogeneous edge servers by considering jointly the effects of cross-server link bandwidth, GPU computing capability, GPU-CPU expert loading delay, instantaneous queueing backlog, and replica-level quantization quality loss.
Highlighted terms show continued research focus across papers
Papers
cs.NIcs.CLEmpiricalRecentAug 1, 2026
HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference
Xin Yuan, Ning Li, Wenchao Xu, Athanasios V. Vasilakos +2 more
This paper proposes HetRoute, a framework for optimizing Mixture-of-Experts model inference over geo-distributed heterogeneous edge servers by considering jointly the effects of cross-server link band…
View →