ToonCrafter is an open-source video interpolation model that is fine-tuned to produce cartoon and anime motion videos. It requires two images – a starter and end to your video or animation (also known as the key frames.) The AI then uses these two images to generate and interpolate fluid motion between the frames. This can save valuable time for sketchers and illustrators who are doing animation as they no longer need to draw every frame individually. ToonCrafter’s code is available on the GitHub page, and the model weights are available on Hugging Face. There is also a handy demo on Hugging Face where you can try out the tool with 2 second animations.
Please note that the ToonCrafter model currently requires a powerful GPU with lots of VRAM to work correctly. Some users are reporting that it can use a whopping 26GB VRAM (sorry, 4090 owners!).
