Turn an old Android phone into a Local AI Voice Assistant

r/LocalLLaMA
Generative AI Open Source AI

I had a nice old cracked pixel 5a laying around that I wanted to get some use out of, so I turned it into a local AI Voice assistant. A server on a laptop running llama.cpp gemma-3-4b-q4.gguf served by flask connects to a script running on the phone. scrcpy was used to access the phone, setup termux, and ssh in. Here's the repo! Script sets up a config file on the first run. You might be able to get this up and going in under 10 minutes. I ask it how the weather's going to be, or other random questions I think of while I'm putting on my shoes.