MoEITS: A Green AI approach for simplifying MoE-LLMs

ArXi:2604.10603v1 Announce Type: cross Large language models are transforming all areas of academia and industry, attracting the attention of researchers, professionals, and the general public. In the trek for powerful architectures, Mixture-of-Experts, inspired by ensemble models, have emerged as one of the most effective ways to follow. However, this implies a high computational burden for both