Brighten Godfrey
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper introduces CCLab, an adversarial testing framework, to systematically evaluate the robustness of both learning-based and traditional congestion controllers, finding that learning-based controllers are generally more robust and can be further improved using adversarial traces.
Lodestar is a novel online learning-based request routing system that significantly improves LLM inference efficiency by dynamically assigning incoming requests to the optimal GPU instance to minimize latency.
Papers
Lodestar: An Online-Learning LLM Inference Router
Gangmuk Lim, Wanyu Zhao, Brighten Godfrey, Jiaxin Shan +2 more
Lodestar is a novel online learning-based request routing system that significantly improves LLM inference efficiency by dynamically assigning incoming requests to the optimal GPU instance to minimize…