[Paper on Hummingbird+: low-cost FPGAs for LLM inference] Qwen3-30B-A3B Q4 at 18 t/s token-gen, 24GB, expected $150 mass production cost

r/LocalLLaMA
Generative AI

Submitted by /u/ayake_ayake [link] [comments]