tok/s on ASUS Zenbook A16 (Snapdragon X2)
r/LocalLLaMA
•
Generative AI
AI Hardware
Open Source AI
Just quick numbers for anyone interested on new snapdragon chipset with windows on arm via llama.cpp ## Hardware - Snapdragon X2 Elite Extreme (X2E94100, Qualcomm Oryon Gen 3) - 18 cpu cores - 48 GB Unified Memory - ~228 GB/s peak memory bandwidth - Adreno GPU (unused) - Decent Hexagon NPU (unused) - ISA features reported: NEON, FMA, DOTPROD, I8MM, SVE/SVE2, SME/SME2, fp16 - 4096-bit Matrix Engine (SME2) - present in hardware i couldnt get KleidiAI (SME2) to work (guessing windows problem?) llama.cpp does recognize and try to use the adreno gpu, but everything ive tried get adreno gpu to.