Michael Sullivan
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper introduces CFGzip, an offline token space compression technique that significantly reduces the computational overhead of constrained decoding, making complex grammar enforcement feasible at scale.
The paper introduces CFGzip, an offline token space compression technique that significantly reduces the computational overhead of constrained decoding, making complex grammar enforcement feasible at scale.
Papers
Accelerating Constrained Decoding with Token Space Compression
The paper introduces CFGzip, an offline token space compression technique that significantly reduces the computational overhead of constrained decoding, making complex grammar enforcement feasible at…