20 results for “Spiking Transformers”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
Zeqi Zheng, Zizheng Zhu, Yuping Yan, Wenxuan Pan +2 more
This paper proposes Spatially Contiguous Local Attention with Boundary Continuity Pathway (SCLA-BCP) for Spiking Transformers, improving spatial locality and consistency across layers and architecture…
Liwen Jing, Yisha Lu, Tingting Yang, Li Sun +4 more
The paper introduces SpikeWFM, a novel hybrid architecture combining spiking neural networks (SNNs) and transformers, which significantly improves the robustness and accuracy of wireless foundation mo…
This paper proposes a fully SNN-based implementation of the Transformer decoder block for natural language processing, reducing energy consumption by 87-93%.
This paper proposes a hybrid ANN-SNN pipeline that leverages pretrained ANNs to enable high-performance SNNs.
This paper presents two compact spiking neural networks for distinguishing Purkinje cell simple and complex spikes in cerebellar recordings.
This paper introduces Mega, a digital architecture for Convolutional Spiking Neural Networks (SNNs) that addresses underutilization of parallelism and inflexibility in existing SNN accelerators throug…
This paper extends hls4ml to deploy spiking neural networks on FPGA firmware for real-time inference.
Lingxin Jin, Wei Jiang, Maregu Assefa Habtie, Letian Chen +4 more
The paper introduces Spike-PTSD, a novel, biologically inspired adversarial attack framework that successfully compromises the robustness of Spiking Neural Networks (SNNs) by modeling abnormal neural…
This paper presents a novel interpretation of resonate-and-fire neural networks using state-space models, enabling parallel training with real and spiking inputs, and maintaining biologically-realisti…
This paper proposes Spiking Fourier Graph Operators (SpikF-GO) for multivariate time series forecasting using Spiking Neural Networks (SNNs), introducing Hard Concrete frequency gates and Complex LIF…
This paper introduces SupraSNN, a superscalar-inspired architecture for efficient execution of Spiking Neural Networks (SNNs) on physical hardware.
The paper presents a learnable speech-to-spike encoder jointly trained with a Recurrent Leaky Integrate-and-Fire backbone for neuromorphic speech processing.
Zitian Gao, Yilong Chen, Yihao Xiao, Xinyu Yang +3 more
The paper introduces Loopie, two Mixture-of-Experts models that outperform vanilla Transformer baselines in looped Transformers, with extensive ablation studies and a strong reasoning pipeline.