Is there a fix to Tool Calling Issues with Qwen?

r/LocalLLaMA
Open Source AI

So, for the past few days I've been trying to setup hermes and openclaw agent with 27b qwen 3.5 locally, but the tool calling issue isn't going away. The agent type the tool commands / terminal commands in the chat. I've tried several different fine tunes & base model, llamacpp / kobaldcpp as backend, etc. For the people that are running agents locally, what did you do? I've tried adding instructions in SOUL.md but that hasn't fixed, tried several different parameters (like default or Unsloth recommended) as well. I'm primarily using chatml format.