Integrating sketch-based animation and realistic colourisation with user-driven prompts

Abstract

The process of transforming static sketches into vibrant, coloured animations repre- sents a significant advancement in digital content creation, combining the precision of sketch-based animation with the implementation of realistic colourisation. This paper presents a novel approach that combines the methodologies of sketch-to-animation generation and black-and-white image colourisation. By leveraging on state-of-the-art deep learning models, we develop a system capable of producing coloured animations from a single input sketch. We also implement a prompt-based system that allows users to influence the animation process which enables further customisations and contextual outcomes. This system not only enhances the creative process for artists but also opens up new possibilities in digital media production and interactive content creation.