Gangmuk Lim
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
Distributed×1AI×1ML×1
Frequent co-authors
Research Timeline
2026
Lodestar: An Online-Learning LLM Inference Router
Lodestar is a novel online learning-based request routing system that significantly improves LLM inference efficiency by dynamically assigning incoming requests to the optimal GPU instance to minimize latency.
Highlighted terms show continued research focus across papers
Papers
cs.DCcs.AIcs.LGRecentMay 31, 2026
Lodestar: An Online-Learning LLM Inference Router
Gangmuk Lim, Wanyu Zhao, Brighten Godfrey, Jiaxin Shan +2 more
Lodestar is a novel online learning-based request routing system that significantly improves LLM inference efficiency by dynamically assigning incoming requests to the optimal GPU instance to minimize…
View →