AI RESEARCH
Higher-Order Modular Attention: Fusing Pairwise and Triadic Interactions for Protein Sequences
arXiv CS.LG
•
ArXi:2603.11133v1 Announce Type: new Transformer self-attention computes pairwise token interactions, yet protein sequence to phenotype relationships often involve cooperative dependencies among three or residues that dot product attention does not capture explicitly. We