Yukuan Zhang
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
SecureRouter is an encrypted routing and inference framework that accelerates secure transformer inference by adaptively selecting the optimal model size based on the encrypted input, achieving a 1.95x latency reduction.
The paper proposes PPRoute, a privacy-preserving LLM routing framework that significantly speeds up secure model selection while maintaining high performance comparable to non-private methods.
Papers
Privacy-Preserving LLMs Routing
Xidong Wu, Yukuan Zhang, Yuqiong Ji, Reza Shirkavand +2 more
The paper proposes PPRoute, a privacy-preserving LLM routing framework that significantly speeds up secure model selection while maintaining high performance comparable to non-private methods.