Upgrading Kiwi-chan’s Brain: Pushing a 30GB "Frankenstein" GPU Rig to the Limit with Qwen 3.6-35B-A3B
Dev.to AI
•
AI Hardware
Open Source AI
Upgrading Kiwi-chan’s Brain: Pushing a 30GB "Frankenstein" GPU Rig to the Limit with Qwen 3.6-35B-A3B If you’ve been following my journey of building "Kiwi-chan" (my autonomous Minecraft AI), you know she runs on what I lovingly call a "Frankenstein" GPU rig. Instead of a single enterprise-grade behemoth, my setup is a heterogeneous mix of consumer cards running on Ubuntu Server 24.04 LTS: NVIDIA RTX 3060 (12GB) NVIDIA RTX 3050 (6GB) NVIDIA GTX 1660 Ti (6GB) NVIDIA GTX 1660 Super (6GB) Total VRAM: 30GB. Until recently, Kiwi-chan’s brain was powered by Gemma 2 27B (Q4_K_M.