u/Ok-Option-6683

First of all, I'd like to thank this community for teaching me a lot from Day 1. And thanks for your time.

Early edit : Please watch it in 4K if you can. The quality and grain both look really beautiful in 4K.

Early edit 2 : The song is not AI. The video is.

So long story short, I realized there were so many stuff I had to learn about generative AI in ComfyUI, and I decided to start this music video project to learn as much as I can.

You already know how it's done, so I don't think I have to explain, but if you have questions, please don't hesitate to ask. If I have the answer, I'll provide.

Instead, I want to draw your attention to some stuff I had problems with,

- The video is square because I couldn't generate 16:9 in 720p with WAN in the first place (my graphic card sucks for 16:9), and therefore I went for 720x720.

- I generated WAN videos in 720p, and LTX videos in 1440p. WAN is definitely superior when it comes to real life dynamics. For some clips, I tried both WAN and LTX. WAN always won but it is too slow and LTX has way better quality because of 1440p exporting. I'm an LTX fan now.

- I exported the pre-final video in 1080p. Then firstly, I tried RTX Super Resolution to upscale it to 4K. Since the videos were generated in 8bit, after the RTX upscale the banding was too visible. It actually looked horrible.

- Then I tried to upscale to 4K within Topaz Video AI. I tried only Gaia, the banding was really bad again.

- Then I just opened a 4K sequence in Davinci and chose bicubic as the upscaler in the project settings and exported the final video like that.

- The final video is heavily color-graded. I mean HEAVILY.

- u/ltx_model LTX video, hear me out, the lower teeth looks terrible, man. Fix this in the future please! ps. I love you.

- This goes for both WAN and LTX : If the faces are (too) small in the image, they get deformed pretty badly in the generated video. For most of those clips with small faces in the video, I used Face Detailer. But sometimes even that didn't work.

- Meanwhile I had a chance to try Ideogram. Even though I love its flexibility and bbox option, I couldn't get film-like generations as I could with Z-Image. I think I have to work on Ideogram more. I believe this problem is on my side. So anyway, I went with Z-image (base+turbo workflow). This is all i2v btw.

- Lip-sync in LTX is amazing but it is really hard to get the "100% matching" lip movements. Sometimes no matter what I do, some part of the line just doesn't match (for example at the end of a word). You can see this in the video.

- Lip-sync in WAN is definitely superior but I can't get the characters move at the same time. I found a workflow for that but my system OOMed pretty fast.

- I've tried a few LTX FLF workflows but the results were unbearable tbh. then I learnt how to use WAN VACE for FLF. I love it. It is just amazing (I made a few transitions in the video with WAN VACE 2.2).

Let me know what you think. If you have any questions or wanna criticize, please don't hesitate. I'm here to learn more.

And if you like the video or the song, please follow us on Youtube. We are also on Spotify and Apple Music. https://www.youtube.com/@MilkenTiers

Thanks for your time again!

Hi everybody,

Most likely you all already know that LTX 2.3 sucks when it comes to teeth, especially lower teeth. Even some high quality generations (over 1440p) gives crooked or AI teeth, which bothers me a lot. (I tried prompting something like "clear, defined teeth" etc but it didn't work well.

I have never trained any LoRAs for LTX 2.3 before. So my question is, do you think it is possible to train a teeth LoRA for LTX 2.3. For example, if I find some high quality photos of people smiling, and crop the teeth area for 512x512px (or even 1024px), then train it all, will I get good teeth in videos?

Any other suggestions?

Thanks for your time!