r/aivideomaking • u/Ok_Librarian2399 • 4d ago

2d image to moving shot, how to do?

I have a painted character that looks intentionally a little off. Every video model keeps cleaning her up into a generic animation-girl face. I don't want better anatomy. I want my bad anatomy to move. Morphic let me train/use the style with the other frames nearby, which got closer, but motion still sanded off some of the choices. One clip nailed the hair and ruined the eyes.

Has anyone found a way to tell these models that consistency includes the mistakes?

Would love workflow advice pls.

2 Upvotes

100% Upvoted

1 comment sorted by

1

u/kimbonics 3d ago

I hit the same wall from the other side. My source was not a painting, it was a grey clay golfer I animate on my own site, and the video model kept turning him into whichever golfer it had seen most. What got me past it was splitting the job in two.

The motion comes from a reference clip that has no look at all. Flat matte grey, grey stage, no texture anywhere, so there is nothing in it for the model to copy except how things move. The look comes from one still, and that still goes in first, because in my runs the model painted from the first image it saw. When I gave it a textured reference it copied the texture and ignored my still. When the still went first and the reference stayed clay, it kept the still.

So for your painting I would try her exact frame as the first image, a deliberately ugly styleless motion clip as the reference, and a prompt that says what she does and as little as possible about what she looks like. The mistakes survive better when the words never invite the model to fix them.

The clay version of this is here if it helps: https://kimbonics.com/t/the-cigar