Qwen-27B as a Local Agent — It Actually Works Now
r/LocalLLaMA
•
Open Source AI
It's been a busy week testing and trying to get the 27B model set up correctly. TL;DR: The only setup that worked for my dual 3090s was this one. And the funny thing? I just gave the Qwen27B LlamaCPP setup link to the Pi agent and asked it to handle it. It basically set itself up in one shot. I then compared 37B-Q8 vs. Qwen3.6-27B-AutoRound-Q4, and I was amazed - the AutoRound version was both faster and smarter. Here's what I tested: 1. Modem access script - I gave it the IP and password. After about 20 minutes, success. 2.