The silence of the weights: a structural pruning strategy for attention-based audio signal architectures with second order metrics

ArXi:2509.26207v2 Announce Type: replace-cross Transformer-based models have become the state of the art across multiple domains, from natural language processing to machine listening, thanks to the attention mechanisms. However, the attention layers require a large number of parameters and high-end hardware for both