Yuchen Teng
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
Distributed×1AI×1ML×1Performance×1
Frequent co-authors
Research Timeline
2026
CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation
This paper proposes CrossPool, a serving engine for cold Machine Learning Models (LLMs) that separates weights and KV-cache into two GPU memory pools to improve GPU memory utilization and long-context support.
Highlighted terms show continued research focus across papers
Papers
cs.DCcs.AIcs.LGEmpiricalRecentJun 23, 2026
CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation
Zhuoren Ye, Tianyu Wo, Dinghao Xue, Mingming Zhang +3 more
This paper proposes CrossPool, a serving engine for cold Machine Learning Models (LLMs) that separates weights and KV-cache into two GPU memory pools to improve GPU memory utilization and long-context…
View →