Lingwei Chen
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
ML×1AI×1
Frequent co-authors
Research Timeline
2026
Rethinking the Role of Temperature in Large Language Model Distillation
This paper re-examines the role of temperature ($ au$) in LLM distillation, demonstrating that while Reverse KL (RKL) is often preferred, Forward KL (FKL) significantly outperforms RKL at higher temperatures, overturning standard empirical conclusions.
Highlighted terms show continued research focus across papers