Has anyone tried Zyphra 1 - 8B MoE?
r/LocalLLaMA
•
Generative AI
Open Source AI
Today we're releasing ZAYA1-8B, a reasoning MoE trained on u/AMD and optimized for intelligence density. With <1B active params, it outperforms open-weight models many times its size on math and reasoning, closing in on DeepSeek-V3.2 and GPT-5-High with test-time compute submitted by /u/appakaradi [link] [comments]