AI RESEARCH
Not All Timesteps Matter Equally: Selective Alignment Knowledge Distillation for Spiking Neural Networks
arXiv CS.LG
•
ArXi:2605.14252v1 Announce Type: new Spiking neural networks (SNNs), which are brain-inspired and spike-driven, achieve high energy efficiency. However, a performance gap between SNNs and artificial neural networks (ANNs) still remains. Knowledge distillation (KD) is commonly adopted to improve SNN performance, but existing methods typically enforce uniform alignment across all timesteps, either from a teacher network or through inter-temporal self-distillation, implicitly assuming that per-timestep predictions should be treated equally.