Chunming Hu
3 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
This paper proposes CrossPool, a serving engine for cold Machine Learning Models (LLMs) that separates weights and KV-cache into two GPU memory pools to improve GPU memory utilization and long-context support.
This paper presents SpecBox, a runtime system for LLM agents that uses speculative sandbox preallocation to improve resource utilization and reduce interactive tail latency.
This paper proposes LibFan, a learning-based approach to detect third-party libraries in Android apps.