Benchmarking EngGPT2-16B-A3B against Comparable Italian and International Open-source LLMs

ArXi:2605.07731v1 Announce Type: cross This report benchmarks the performance of ENGINEERING Ingegneria Informatica S.p. A.'s EngGPT2MoE-16B-A3B LLM, a 16B parameter Mixture of Experts (MoE) model with 3B active parameters. Performance is investigated across a wide variety of representative benchmarks, and is compared against comparably-sized open-source MoE and dense models.