How to run AI on Samsung NPU
r/LocalLLaMA
•
Generative AI
AI Hardware
I've been trying to find the most optimized app for running LLM's on Android and been struggling. I have an S24 Ultra with a pretty powerful NPU but AFAIK no app lets me user the power of this NPU to run AI. I've even tried making (vibe-coding) my own app to NPU but still couldn't get it to work. Does anyone know of any apps that allow me to use my NPU, or at the very most the fastest android apps for running AI? submitted by /u/CucumberAccording813 [link] [comments]