Qwen 3.6-27B Dense with MTP on Strix Halo Windows - Benchmarks

r/LocalLLaMA
Generative AI Open Source AI

Here are some results (llama.cpp)! Task 1: write a short poem 27B Dense: 12.5 tokens/s 27B Dense MTP: (spec-draft-n-max 6): 14.5 tokens/s 27B Dense MTP (spec-draft-n-max 3): 18.7 tokens/s Task 2: edit a hello word html artifact 27B Dense: 12.6 tokens/s 27B Dense MTP (spec-draft-n-max 6): 14.2 tokens/s 27B Dense MTP (spec-draft-n-max 3): 19.8 tokens/s Task 3: create a hello world html directly in chat 27B Dense: 12.6 tokens/s 27B Dense MTP (spec-draft-n-max 6): 17.9 tokens/s 27B Dense MTP (spec-draft-n-max 3): 23.2 tokens/s It's fascinating how it varies with tasks! Settings used: { "name.