AI RESEARCH
Composer: A Search Framework for Hybrid Neural Architecture Design
arXiv CS.LG
•
ArXi:2510.00379v2 Announce Type: replace Hybrid model architectures that combine computational primitives (e.g., Attention, MLP) in different ratios have shown promising performance beyond Transformers. Some studies have shown that different interleavings of primitives can affect model quality as well. However, prior works explore the hybrid model architecture design space manually. Due to the large design space and