Luce DFlash + PFlash on 7900XTX: Qwen3.6-27B at 2.24x decode and 3.05x prefill vs llama.cpp HIP
r/LocalLLaMA
•
Generative AI
AI Hardware
Open Source AI
AI Research
Tested a bit on my XTX, a bit share hope helpful, thanks to Lucebox! Lucebox DFlash + PFlash PR Reproduction Report (RX 7900 XTX) Hardware Environment Component Spec GPU AMD Radeon RX 7900 XTX (Navi 31, gfx1100) VRAM 24 GiB GDDR6 (~936 GB/s) System RAM 62 GiB DDR5 ROCm 7.1 OS Ubuntu 26.04, Linux 7.0.0-14-generic Benchmark Results Model: Qwen3.6-27B Q4_K_M (15.65 GiB) + Lucebox Q8_0 DFlash drafter (1.84 GiB) Test: 10-prompt HumanEval-style, --n-gen 128, --fast-rollback Baseline: llama.cpp HIP AR (tg128) - 28.07 tok/s Config Mean tok/s Mean AL Speedup (vs llama.cpp HIP) llama.cpp.