Hosting an AI Image Generator on 7 Consumer GPUs in My Living Room: Architecture Deep-Dive
Dev.to AI
•
Generative AI
When people hear that zsky.ai runs on seven consumer GPUs in my living room, the usual reaction is a mix of disbelief and "that cannot possibly be stable." It is stable. It serves tens of thousands of users a day, generates both images and video, and the whole thing sits behind a single public endpoint. This post is the architecture walkthrough I wish someone had written when I was starting. Why consumer GPUs at all I'm a photographer with aphantasia - I cannot visualize images in my head. When I recovered from a TBI, the camera became my way of seeing.