Shuai Zhang
2 indexed papers
Recent (6 mo)
2With code
0Influential cites
0Benchmarked
0Publications per year
226
Top categories
NLP×2Software Eng.×1
Frequent co-authors
Research Timeline
2026
Cost-Aware Diffusion Draft Trees for Speculative Decoding
The paper introduces CaDDTree, a cost-aware method that optimizes token throughput by jointly selecting the tree structure and node budget for speculative decoding, outperforming existing methods like DDTree.
Token-Operations-Oriented Inference Optimization Techniques for Large Models
This paper proposes a four-layer technical architecture for large model inference optimization, including Multi-model Fusion, Model Optimization, Compute-Model Fusion, and Compute-Network-Model Fusion.
Highlighted terms show continued research focus across papers
Papers
cs.SEcs.CLSurveyRecentJun 18, 2026
Token-Operations-Oriented Inference Optimization Techniques for Large Models
Shiguo Lian, Kai Wang, Zhaoxiang Liu, Wen Liu +21 more
This paper proposes a four-layer technical architecture for large model inference optimization, including Multi-model Fusion, Model Optimization, Compute-Model Fusion, and Compute-Network-Model Fusion…
View →
cs.CLRecentJun 1, 2026