Sarbartha Banerjee
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper systematically analyzes the benefits and limits of Attention-FFN Disaggregation (AFD) for Mixture-of-Experts (MoE) LLM serving, demonstrating that AFD is crucial for achieving high throughput under strict latency constraints.
The paper introduces TRACE-Router, a task-level routing framework for large language models that aligns routing with the unit of supervision using delayed task feedback.
Papers
TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AI
Ritik Raj, Souvik Kundu, Sarbartha Banerjee, Dheemanth Joshi +2 more
The paper introduces TRACE-Router, a task-level routing framework for large language models that aligns routing with the unit of supervision using delayed task feedback.