Tianyu Wo
2 indexed papers
Recent (6 mo)
2With code
0Influential cites
0Benchmarked
0Publications per year
226
Top categories
Distributed×2AI×2ML×2Performance×2
Frequent co-authors
Research Timeline
2026
CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation
This paper proposes CrossPool, a serving engine for cold Machine Learning Models (LLMs) that separates weights and KV-cache into two GPU memory pools to improve GPU memory utilization and long-context support.
SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving
This paper presents SpecBox, a runtime system for LLM agents that uses speculative sandbox preallocation to improve resource utilization and reduce interactive tail latency.
Highlighted terms show continued research focus across papers
Papers
cs.DCcs.AIcs.LGEmpiricalRecentJul 27, 2026
SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving
Yihui Zhang, Tianyu Wo, Jinghao Wang, Xiaoyang Sun +6 more
This paper presents SpecBox, a runtime system for LLM agents that uses speculative sandbox preallocation to improve resource utilization and reduce interactive tail latency.
View →
cs.DCcs.AIcs.LGEmpirical