I got tired of manually prompting every single clip for my AI music videos, so I built a 100% local open-source (LTX Video desktop + Gradio) app to automate it, meet - Synesthesia
r/StableDiffusion
•
Generative AI
Open Source AI
AI Tools
Synesthesia takes 3 files as inputs; an isolated vocal stem, the full band performance, and the txt lyrics. Given that information plus a rough concept Synesthesia queries your local LLM to create an appropriate singer and plotline for your music video. (I recommended Qwen3.5-9b) You can run the LLM in LM studio or llama.cpp. The output is a shot list that cuts to the vocal performance when singing is detected and back to the "story" during musical sections. Video prompts are