Babak Hodjat
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
ML×1AI×1
Frequent co-authors
Research Timeline
2026
Efficient Pre-Training of LLMs through Truncated SVD Layers
The paper introduces TSVD, a novel framework that efficiently pre-trains LLMs by enforcing both low rank and strict weight orthonormality, achieving performance comparable to full-parameter models with significantly reduced computational cost.
Highlighted terms show continued research focus across papers