Best Open-Source Model for Character Consistency with Reference Image?

r/StableDiffusion
Generative AI Open Source AI

I am a newbie in using ComfyUI. I want to make realistic AI-generated person photo, posing in different backgrounds and outfits, using an AI-generated head close-up of that person directly looking at camera in a plain background as reference image, and prompt for backgrounds, outfits and poses. The final output should be that person exactly looking like the person in reference image, in pose, outfit and background mentioned in the prompt. I have 32GB RAM and 16GB RTX 4080.