Can we talk about the reasoning token format chaos?
r/LocalLLaMA
•
Open Source AI
AI Tools
Qwen/DeepSeek: Gemma: <|channel>. Ok weird but sure. Gemma again, sometimes: just bare thought\n with no delimiters at all vLLM has --reasoning-parser flags per model which helps but that's basically just the vLLM maintainers volunteering to play whack-a-mole forever. And if you're doing anything downstream with the raw output you're still writing your own parser per model. We just went through this with chat templates. Now we're doing it again.