u/LeebLaab

Character Consistency | Lora Training and testing | Flux
▲ 30 r/comfyui

Character Consistency | Lora Training and testing | Flux

Okay just to keep it short, this is how i trained a lora in Comfyui local for my first character, and results were amazing and of course needs further tuning

I am new to Comfyui world, so excuse my non technical language but thought to share this to help anyone else here as an open source community

Disclaimer
all workflows are not mine (maybe i tuned or customized some) i don't claim ownership of any of the workflows here

So, First step - Main Character Image

use any Text 2 Image workflow to generate one single portrait of you lovely character , nothing much to add here, just the basic workflows or any , just get something you like

Second Step - Data Set generation

Use this workflow

KLEIN DATASET GENERATOR - ICEKIUB Vid version.json

Dataset Generation workflow

to generate i would recommend something up to 100 different images of your character, different poses, different clothes , different camera angle

after generations, it is critical to carefully check the output images, and delete any blurry / ugly / low details ones

in my case i filtered the 100 and got 62 images ( my mistake was that i didn't generate enough side and back views of the character so am not getting good results with back and side image generation.

Third Step - Training the lora

i followed this tutorial exactly as it is
How To Train A lora Youtube Video

it is very simple two steps

first one is generating captions for the images (very critical) using this workflow here

Generating Image Captions - workflow

second one is to locally train you lora using this workflow

Lora Training Workflow

Will try to share some examples for my character as well

It took me almost 40 minutes for training , i was really shocked with this times (very fast) not as i expected , i am using RTX5090

Lora download link - civitai

Testing the lora

test 2

https://preview.redd.it/8w6xiqyzio2h1.png?width=720&format=png&auto=webp&s=f8481f6abc1035c185525052b2caa846a1b1d43e

https://preview.redd.it/zlqqg551jo2h1.png?width=720&format=png&auto=webp&s=e6a0014e7d851da21f4106da6eac4bc0a686905d

reddit.com
u/LeebLaab — 1 day ago

Hi all,

I have been using Comfyui for almost 2 months now, i am was really suffering with all type of control over the video movement and prompting lol , not the right into

anyway, i have been looking for a prompt relay workflow for WAN22 and didn't find any , till today someone recommended Ai Verse channel on youtube , i went there i found a i2v workflow, i adjusted too much parameters on it and it finally worked,

This is my first ever workflow that i develop from scratch , i have developed based on my knowledge this Workflow here for text2video using WAN2.2.

i have added both options for the prompt relay node so you can text both the smart encoder and the timeline.

feel free to test it and let me know what i have missed, as am still new to this world.

Enjoy

maybe this will help

reddit.com
u/LeebLaab — 16 days ago