Characters faces changing

[bevangg]

Motion transfer is brilliant but characters are unrecognisable after 2 seconds. Using FP16 on a 5090 for 5 second clip. Source video is mma roundhouse kick knockout, trying to replace with poluticians. It loses the faces after characters not facing the camera

[fengjia-guo]

Thanks for the feedback. Identity drift can still happen, especially in challenging motions. The model is also somewhat stochastic, so results may vary across runs.

One thing worth trying is a more detailed character description in the prompt. As mentioned in the README, SCAIL-2 is trained with long, detailed prompts, and this can sometimes improve character consistency, especially in replacement mode.

If possible, please share the reference image and prompt you used. We'd be interested to see whether a more descriptive prompt helps in this case.