Nishant Kumar Singh
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
ML×1AI×1Sound×1
Frequent co-authors
Research Timeline
2026
Logit Distillation on Manifolds: Mapping by Learning
The paper proposes a novel layer and point-wise projection mapping combined with LoRA injection to efficiently distill knowledge from a large teacher model to a small student model, significantly improving performance while drastically reducing trainable parameters.
Highlighted terms show continued research focus across papers
Papers
cs.LGcs.AIcs.SDRecentMay 30, 2026
Logit Distillation on Manifolds: Mapping by Learning
Yiru Yang, Junling Wang, Nishant Kumar Singh, Luohong Wu +1 more
The paper proposes a novel layer and point-wise projection mapping combined with LoRA injection to efficiently distill knowledge from a large teacher model to a small student model, significantly impr…
View →