Yitao Yuan
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
Distributed×1
Frequent co-authors
Research Timeline
2026
InstantInfer: Enabling Fast LLM Cold Start with Communicating Finite Automata
The paper proposes the Communicating Finite Automata (CFA) abstraction and a framework for component program refactoring in large language model inference services, achieving significant speedup and robustness.
Highlighted terms show continued research focus across papers