Issues with LoRA training (SD 1.5 / XL) using Ostrys' AI tool kit - Deformed faces

r/StableDiffusion
Generative AI AI Research AI Tools

Hi everyone, I'm trying to train a character LoRA for Stable Diffusion 1.5 and XL using Ostrys' kit, but the results are consistently poor. The faces are coming out deformed from the very first steps all the way to the end. My setup is: Dataset: ~50 varied images of the character. Captions: Fairly detailed image descriptions. Steps: 3000 steps total, testing checkpoints every 250 steps. In the past, I used to train these models and they worked perfectly on the first try.