Need help with LoRA training for Flux with Ai-Toolkit
Today I trained a LoRA for Flux using the Ai-Toolkit, following their instructions, along with this video that is linked in the GIThub page.
Using the wooly worlds training diary examples, I elected to go without any captions or triggerwords, as I was doing a style LoRA.
I had 21 screencap images from the movie Spirited Away, all 1920x1038 in size, and matching txt files that were blank. I copied the train_lora_flux_24gb.yaml, with the only changes being to set the network linear and linear alpha to 32, as was recommended in the video. I set the steps to 3000 and let if fly.
As things progressed I ended up getting one image to look different out of all the test images it ran:
The rest ended up being basically unchanged:
In the example video she was getting the images to take on the style within a few hundred. Even at 3000 steps I noticed my learning rate was way high, at like 4-3.8 or something.
Thoughts on what I should do differently?