How can I modify only a specific clothing area on an uploaded photo (keep everything else unchanged)

Hi everyone, I'm working locally in Stable Diffusion (Automatic1111, RTX 3060 GPU) and I would like to modify only a selected clothing area on an uploaded image, while keeping: the face unchanged body proportions unchanged pose unchanged lighting unchanged background unchanged Basically I want high-quality localized editing, not regeneration of the whole image. My current idea is to use: img2img → Inpaint masked area only low denoise strength ControlNet (maybe depth / openpose / softedge?) But I'm not sure what the optimal workflow is for best realism.