Gemini Pro generates great UGC videos, but keeps changing my script. Any workaround?
I'm experimenting with Gemini Pro for AI-generated UGC videos and have been getting mixed results.
This is the prompt I'm using:
Please use the attached photo as talking photo.
A casual, friendly young Taiwanese woman in her mid-20s, looking directly at the camera, talking. She has a natural, light makeup look, wearing smart-casual office attire like a pastel blouse. Bright, well-lit modern office or cozy cafe background. Shot on an iPhone 15 front camera, vertical video aspect ratio, cinematic lighting, photorealistic, UGC style, TikTok aesthetic, highly detailed face, 8k. --ar 9:16 --v 6.0
Scene 1
Script: Zoning out in meetings? Can’t keep up with your boss?
Video: UGC-style; Taiwanese girl looking relatable but expressive.
Scene 2
Script: Check out this lifesaver!
Video: Girl looks pleasantly surprised, holding up her phone/product.
Scene 3
Script: Just tap record, and let AI handle the heavy lifting.
Video: Girl points to the top of the screen.
Scene 4
Script: Meeting over? Get a full summary in just one minute!
Video: Faster pace, highlighting "one minute" and "summary."
Scene 5
Script: Replay audio and export to PDF in one click. So easy!
Video: Girl looks relieved and relaxed.
Scene 6
Script: Download now for a 3-day free trial! Click the link below!
Video: Enthusiastic, urgent tone; gestures strongly toward the bottom of the screen.
Overall, I'm actually quite impressed with the results:
- The generated scenes closely match the prompt.
- The voice sounds surprisingly natural (although not perfect).
However, one major issue is that the spoken dialogue doesn't faithfully follow the script. The model frequently skips words, paraphrases sentences, or omits parts of the script entirely, even when I explicitly provide the exact wording.
I'm wondering:
- Are there prompt engineering techniques that improve script adherence?
- Is this simply a current limitation of Gemini Pro's video generation model?
- Has anyone had better success with other AI video platforms that can generate talking-head UGC videos while following the script almost word-for-word?
I'm happy to pay for a service if it produces significantly better results.
I'd especially appreciate recommendations from people who have actually compared multiple platforms for this use case (e.g. realistic talking avatars, UGC-style ads, TikTok creatives, etc.).