Shuai Yuan
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper proposes Speculative Pipeline Decoding (SPD), a novel framework that uses pipeline parallelism to accelerate LLM inference by processing multiple tokens in parallel, achieving higher speedup and zero latency bubbles.
This paper analyzes the non-monotonic relationship between perturbation power and the probability of delaying the first error position in finite-length PE-SC decoding. It proposes an efficient perturbation power selection algorithm to maximize the delay probability.
Papers
Perturbation Power Selection for First-Error Delay Maximization in Enhanced SC Decoding
Zhicheng Liu, Liuquan Yao, Shuai Yuan, Zhongjun Yang +4 more
This paper analyzes the non-monotonic relationship between perturbation power and the probability of delaying the first error position in finite-length PE-SC decoding. It proposes an efficient perturb…