calculated my costs per 1M tokens for Qwen3.5 27B
r/LocalLLaMA
•
AI Hardware
Open Source AI
AI Tools
I was curious about the real electric costs of running qwen 3.5 27B on my hardware. For this I measured TPS for prompt processing and for generation and power consumption. I was running it with vLLM on a rtx 3090 + rtx pro 4000. I measured 53.8 tps in generation and 1,691 tps in prompt processing uncached. This was through a python script calling the real api. My electric costs are around 0.30€/kWh. Nvidia tools showed my around 470W while sampling of GPU power, with some other components in the pc I calculated with 535W.