Gemma 4 is terrible with system prompts and tools
r/LocalLLaMA
•
Open Source AI
I tried Gemma 4 (26b-a4b) and I was a bit blown away at how much better it is than other models. However, I soon found three things: it gets significantly worse as context fills up, moreso than other models it completely disregards the system prompt, no matter what I put in there it (almost) never does tool calls, even when I explicitly ask it Note: Other open models also have the same flaws, but they feel much accentuated with Gemma.