AniDoc: Animation Creation Made Easier
Authors: name: Yihao Meng; name: Hao Ouyang; name: Hanlin Wang; name: Qiuyu Wang; name: Wen Wang; name: Ka Leong Cheng; name: Zhiheng Liu; name: Yujun Shen; name: Huamin Qu
Published: 2024-12-18 18:59:59

Abstract: The production of 2D animation follows an industry-standard workflow,
encompassing four essential stages: character design, keyframe animation,
in-betweening, and coloring. Our research focuses on reducing the labor costs
in the above process by harnessing the potential of increasingly powerful
generative AI. Using video diffusion models as the foundation, AniDoc emerges
as a video line art colorization tool, which automatically converts sketch
sequences into colored animations following the reference character
specification. Our model exploits correspondence matching as an explicit
guidance, yielding strong robustness to the variations (e.g., posture) between
the reference character and each line art frame. In addition, our model could
even automate the in-betweening process, such that users can easily create a
temporally consistent animation by simply providing a character image as well
as the start and end sketches. Our code is available at:
https://yihao-meng.github.io/AniDoc_demo.