NVidia GreenBoost kernel modules opensourced
r/StableDiffusion
•
Generative AI
AI Hardware
This is a Linux kernel module + CUDA userspace shim that transparently extends GPU VRAM using system DDR4 RAM and NVMe storage, so you can run large language models that exceed your GPU memory without modifying the inference software at all. Which mean it can make softwares (not limited to LLM, probably include ComfyUI/Wan2GP/LTX-Desktop too, since it hook the library's functions that dealt with VRAM detection/allocation/deallocation) see that you have larger VRAM than you actually have, in other mean, software/program that doesn't have offloading feature (ie.