ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “attention”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.CRcs.AIApr 30, 2026

Attention Is Where You Attack

Aviral Srivastava, Sourav Panda

The paper introduces the Attention Redistribution Attack (ARA), a white-box adversarial method that bypasses safety alignments in LLMs by manipulating the attention mechanism's geometry, showing that…

View →
cs.AIcs.CLcs.LGRecentJun 1, 2026

Forget Attention: Importance-Aware Attention Is All You Need

Soohyeong Shin, Yeongwook Yang

The paper proposes SISA (SSM-Informed Softmax Attention), a novel hybrid attention mechanism that integrates state-space model (SSM) importance signals directly into the attention score, achieving sta…

View →
cs.LGcs.NEnlin.AOEmpiricalRecentJun 10, 2026

Attention by Synchronization in Coupled Oscillator Networks

Fabio Pasqualetti, Taosha Guo

This paper presents a novel attention mechanism, fixed-query oscillator attention, that replaces softmax attention on energy-constrained physical substrates.

View →
cs.CLcs.AIcs.SDRecentMay 29, 2026

DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs

Sara Papi, Luisa Bentivogli

The paper proposes DOA, a training-free attention policy that leverages self-attention in decoder-only SpeechLLMs to achieve high-quality, low-latency simultaneous long-form translation without requir…

View →
cs.LGcs.AIEmpiricalRecentJul 7, 2026

Graph Convolutional Attention: A Spectral Perspective on Graph Denoising and Diffusion

Shervin Khalafi, Igor Krawczuk, Sergio Rozada, Charilaos Kanatsoulis +2 more

This paper introduces Spectral Attention and Graph Convolutional Attention (GCA) for denoising graphs, which outperforms linear attention and provably utilizes the input graph spectrum.

View →
cs.DCEmpiricalRecentJul 25, 2026

Libra: Taming Attention Workload Skew in Long-Context LLM Training with Bounded Sequence Pool

Yan Wang, Xiulong Yuan, Kaiming Yang, Jiaxuan Peng +15 more

Libra is a load balancing approach for long-context LLM training that groups packed sequences into fixed-size pools and reduces attention workload variance, improving end-to-end throughput and straggl…

View →
cs.AIRecentMay 28, 2026

Moment-KV: Momentum-Based Decode-Time KV Cache Compression for Long Generation

Soumyadeep Jana, Sagar Nishad, Sanasam Ranbir Singh

Moment-KV introduces a novel momentum-based technique to compress the Key-Value (KV) cache during the decoding phase of LLM generation, significantly improving fidelity in long-generation tasks.

View →
cs.SDcs.AIEmpiricalRecentJun 12, 2026

Listening with Attention: Entropy-Guided Explainability for Transformer-Based Audio Models

Ravi Ranjan, Utkarsh Grover, Xiaomin Lin, Agoritsa Polyzou

This paper proposes a model-intrinsic XAI framework for transformer-based ASR models to improve faithfulness and temporal grounding of explanations.

View →
cs.LGcs.AIEmpiricalRecentJun 17, 2026

Explaining Attention with Program Synthesis

Amiri Hayes, Belinda Li, Jacob Andreas

The paper proposes a method to approximate the behavior of attention heads in transformer language models with executable programs.

View →
cs.AIRecentMay 28, 2026

Enhancing Multi-Agent Communication through Attention Steering with Context Relevance

Hongxiang Zhang, Yuan Tian, Tianyi Zhang

The paper introduces Agent-Radar, a training-free method that dynamically steers multi-agent attention toward relevant context using a novel decay mechanism, significantly improving performance in lon…

View →
cs.SDcs.AIeess.ASEmpiricalRecentJun 9, 2026

Steering Where to Listen: Instruction-Based Activation Steering Redirects Temporal Attention in Large Audio-Language Models

Tsung-En Lin, Hung-Yi Lee

This paper introduces instruction-based vector steering to redistribute attention in Large Audio-Language Models (LALMs) and demonstrates its effectiveness in recovering sound event locations.

View →
cs.CVEmpiricalRecentJun 12, 2026

RATS! Patches Talk Through Registers: Emergent Parts in Register Attention Transformers

Timing Yang, Predrag Neskovic, Jansen Seheult, Wenchao Han +3 more

This paper proposes a self-supervised visual model called RATS that discovers compositional structure in images.

View →
cs.LGcs.ITstat.MLTheoreticalRecentJun 21, 2026

Asymptotic Signal Subspace Recovery in Softmax Attention Models

Lan V. Truong

This paper provides a theoretical understanding of attention mechanisms in identifying relevant information from large collections of tokens.

View →
cs.LGcs.CLTheoreticalRecentOct 10, 2026

HodgePhaseNet: Discrete Hodge Decomposition of Semantic Flows in Transformer Attention

Kiyotaka Kasubuchi, Kazuo Fukiya

HodgePhaseNet introduces a new representation for semantic transitions as an antisymmetric real-valued 1-cochain on a finite oriented simplicial complex.

View →
cs.ROcs.CVEmpiricalRecentJun 18, 2026

Fast Human Attention Prediction for Fixation-guided Active Perception in Autonomous Navigation

Fatma Youssef Mohammed, Grzegorz Malczyk, Kostas Alexis

This paper introduces GazeLNN, a computationally lightweight scanpath prediction model for robot autonomy.

View →
cs.AIEmpiricalRecentJul 2, 2026

A Hippocampus for Linear Attention: An Exact Memory for What the Recurrent State Forgets

Wanyun Cui

The paper introduces HOLA (Hippocampal Linear Attention), a semiparametric test-time memory system that combines a compressive linear-attention state with a bounded exact cache for key-value associati…

View →