we put an ai video generator inside premiere as a panel. would you actually use it or stay in the browser?

we put an ai video generator inside premiere as a panel. would you actually use it or stay in the browser?

i work on ella (mostly backend) and this is our premiere plugin. you chat with it, it generates the clip, and "place at playhead" drops it straight onto your timeline

in the screenshot it's making a transition shot. you give it a first frame and a last frame from your own stuff, and it generates what happens in between (here: lighthouse, through a window, into the next scene)

the Plugin is free to install

question for editors: would you use something like this inside premiere, or do you prefer generating in a browser and importing? and what would make you uninstall it in 5 minutes haha

u/Vaciuum1 — 6 days ago

a few of you asked how our ai video agent picks from 1000+ models, so i made a video

Yesterday i posted Ella here and a few of you asked how it picks a model out of 1000+ so here's a real request start to finish. i drop in a corgi from stock (not my dog sadly haha), ask for 10s, 9:16, slow motion, and it picks gemini omni flash 1.1, one that can actually take the image, 9:16 and 10s the trick is the llm never sees models that can't do the job. i filter those out in code first, then it picks from a short list. nothing runs till you hit generate

u/Vaciuum1 — 6 days ago

my agent picks from 1000+ video models and used to be confidently wrong. heres what fixed it

i work on the backend of an ai video agent. you ask for a video in chat, agent picks a model, you approve a draft, then it generates

the naive version is "here are 1000+ models, pick one"

the agent then picks a model that cant take your reference image, cant do the length you asked for, cant do 9:16, and explains why its perfect. confident and wrong, my favorite combo

what we do now:

  1. before the agent sees anything, i throw out every model that cant handle the inputs (ref images, video, audio, length, aspect ratio). the agent never even meets them

  2. score whats left (release date, description, a score, plus stuff the user told it to remember like "always use seedance")

  3. agent picks from a short list that already works. basically i took away its ability to embarrass me

  4. user gets a draft with the model + a cost estimate. nothing runs till they hit generate, because video is expensive and i like my job

  5. we pull model schemas every 10 min so when a provider changes something at 3am it doesnt quietly break jobs

dumbest bug so far: one model with an unreadable schema emptied the whole catalog

1000+ models. gone. because one of them had a bad day

fixed now. i think. please dont check

questions for people doing routing:

which is better learned picker or rules + scoring?

reddit.com
u/Vaciuum1 — 6 days ago

built an ai video agent as a chrome extension, whats the best way to let an ai pick between 1000+ models? (dev here)

dev here, ive been working on a chat based video agent (ella). you type what you want in a sidebar, it drafts the prompt, picks a model and makes the clip. clip above is a real run, nothing edited except the label

the part im still unsure about is the model picking. every model has different limits (length, ratio, resolution) so i validate the inputs first and only then let the agent choose

how do you guys handle picking between lots of models in your ai apps? hardcoded rules(which i try to avoid as much as possible), or let the model decide? curious what worked for you

u/Vaciuum1 — 7 days ago

lone astronaut in a neon desert, seedance 2.5, whats off with the lighting?

the glow on the suit is what i keep looking at, does it look real to you or too clean?

u/Vaciuum1 — 7 days ago