ComfyUI: VL/LLM models not using GPU (stuck on CPU)

I'm trying to run the Searge LLM node or QwenVL node in ComfyUI for auto-prompt generation, but I’m running into an issue: both nodes only run on CPU, completely ignoring my GPU. I’m on Ubuntu and have tried multiple setups and configurations, but nothing seems to make these nodes use the GPU. All other image/video models works OK on GPU. Has anyone managed to get VL/LLM nodes working on GPU in ComfyUI? Any tips would be appreciated! Thanks! submitted by /u/No_Progress_5160 [link] [comments]