Tried to vibe coded expert parallelism on Strix Halo — running Qwen3.5 122B-A10B at 9.5 tok/s

Hey all. I'm pretty new to low-level GPU stuff. But for fun I wanted to see if i could make Expert Paralellism work on my Strix Halo nodes (Minisforum boxes, 128GB unfied memory each) that i'm running as part of my k8s cluster. I must admit i have been using AI heavily and asked many stupid questions along the way, but i'm quite happy with the progress and wanted to share it. Here is my dashboard on my workload running across my two machines: From here i plan to surgically go after the bottlenecks.