
Character Consistency | Lora Training and testing | Flux
Okay just to keep it short, this is how i trained a lora in Comfyui local for my first character, and results were amazing and of course needs further tuning
I am new to Comfyui world, so excuse my non technical language but thought to share this to help anyone else here as an open source community
Disclaimer
all workflows are not mine (maybe i tuned or customized some) i don't claim ownership of any of the workflows here
So, First step - Main Character Image
use any Text 2 Image workflow to generate one single portrait of you lovely character , nothing much to add here, just the basic workflows or any , just get something you like
Second Step - Data Set generation
Use this workflow
KLEIN DATASET GENERATOR - ICEKIUB Vid version.json
to generate i would recommend something up to 100 different images of your character, different poses, different clothes , different camera angle
after generations, it is critical to carefully check the output images, and delete any blurry / ugly / low details ones
in my case i filtered the 100 and got 62 images ( my mistake was that i didn't generate enough side and back views of the character so am not getting good results with back and side image generation.
Third Step - Training the lora
i followed this tutorial exactly as it is
How To Train A lora Youtube Video
it is very simple two steps
first one is generating captions for the images (very critical) using this workflow here
Generating Image Captions - workflow
second one is to locally train you lora using this workflow
Will try to share some examples for my character as well
It took me almost 40 minutes for training , i was really shocked with this times (very fast) not as i expected , i am using RTX5090