Shiwei Liu
3 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
This paper introduces a new on-policy self-distillation framework tailored for diffusion large language models.
The paper introduces SLORR, a simple and stateless framework for in-training low-rank regularization of neural networks using two variants based on the Hoyer sparsity metric and the nuclear norm.
This paper introduces Isospectral Optimization (ISO), a new optimization framework for reinforcement learning with verifiable rewards (RLVR), which inherits the base model's weight spectra while optimizing the frames to achieve stronger performance.
Papers
ISO: An RLVR-Native Optimization Stack
Hanqing Zhu, Wenyan Cong, Zhizhou Sha, Sagnik Mukherjee +7 more
This paper introduces Isospectral Optimization (ISO), a new optimization framework for reinforcement learning with verifiable rewards (RLVR), which inherits the base model's weight spectra while optim…