Sebastian Rogawski
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper introduces Hybrid Verified Decoding, a method that predicts the acceptance length of a cache draft to intelligently select between cache verification and model-based drafting, achieving significant speedups, especially in agentic workflows.
The paper introduces Hybrid Verified Decoding, a method that predicts the acceptance length of a cache draft to intelligently select between cache verification and model-based drafting, achieving significant speedups, especially in agentic workflows.
Papers
Hybrid Verified Decoding: Learning to Allocate Verification in Speculative Decoding
Xin Su, Dawid Majchrowski, Fangyuan Yu, Vanshil Atul Shah +4 more
The paper introduces Hybrid Verified Decoding, a method that predicts the acceptance length of a cache draft to intelligently select between cache verification and model-based drafting, achieving sign…