[FL2VA] Anime style videos have half the FPS
Anime style videos generated by MiniMax-H3 are likely to be 12 FPS instead of 24 (the resulting 24 FPS video will have each frame repeated twice), or they can be of variable framerate (where one part is smooth and the other part is stuttering). I can only get like 1 out of 10+ videos that are actually smooth 24 FPS.
I know this is mostly contributed by the training data where most anime is just like this. But I struggle to generate one in real 24 FPS, even by using prompts like "Smooth motion", "Fluid", "High framerate".
Does anyone have any success in generating real 24 FPS anime style videos consistently?
Maybe you could try generating a realistic style video first, then transfering it into anime style.
In fact, even realistic video generated by H3, there are frame extraction and almost identical 2 frames problems. I guess most training data is not native 24fps video but resampled from 30/60fps, which makes the generated video not smooth.
Maybe you could try generating a realistic style video first, then transfering it into anime style.
That's one way to go about it, but we could never guarantee the second style transfer pass to not also generate at 12FPS.
I'm thinking to just select every 2 frame and slap GIMM VFI on it, that might be easier as a workaround. Though I still hope this can be fixed at prompt / model level.