Soohyeong Shin
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
AI×1NLP×1ML×1
Frequent co-authors
Research Timeline
2026
Forget Attention: Importance-Aware Attention Is All You Need
The paper proposes SISA (SSM-Informed Softmax Attention), a novel hybrid attention mechanism that integrates state-space model (SSM) importance signals directly into the attention score, achieving state-of-the-art performance and superior efficiency.
Highlighted terms show continued research focus across papers