Workflow-friendly Anime In-betweening Using Video Generation Models

概要

In-betweening is a labor-intensive process in anime production requiring skill and time especially for complex motions such as turning around. While vector-based interpolation methods struggle with such out-of-plane movements, recent video generation models address this issue with their motion prior; however the output is not aligned with the technical standard of the existing anime production workflows. We propose a framework which generates anime in-betweens while satisfying the technical standards of the traditional pipelines. This achieves state-of-the-art results, especially in complex out-of-plane motion scenarios. Our framework is unique and effective by filling the gap between existing video generation models and production-ready requirements.