I am deeply intrigued by the transformative potential of artificial intelligence (AI) in expediting the iterative phases of creative prototyping. The application of AI stands poised to revolutionize the creative process, particularly in the swift development of captivating visual effects with minimal exertion. This innovation allows creative individuals to generate remarkable prototypes rapidly, enabling them to iterate efficiently. In essence, AI becomes a facilitative tool in the transition from conceptualization to refined execution.
The power of AI in this context lies in its ability to streamline the prototyping process, allowing artists to effortlessly experiment with ideas and make swift revisions. If a prototype falls short of expectations, AI empowers creators to seamlessly transition to the next iteration, fostering an environment conducive to continuous improvement.AI, in this capacity, acts as a collaborator, enhancing the rough draft of a prototype to a more polished state while preserving the artist's creative essence. It functions as a catalyst for innovation, providing a dynamic platform for artists to express their vision with greater fluidity.
To demonstrate the potential collaborative AI in the creative process, I decided to use Runway to manifest an animated representation of a steampunk fantasy concept I drew a year before. This creative odyssey commenced with the crafting of two distinctive environment illustrations, using Blender and Photoshop. I then put these two illustrations in Runway along with a description of the conceptual world setting, asking Runway to create animation introducing this fictional steampunk world.
My first attempt: I am very surprised that my first attempt has already meet what I want. The rotating angle, the floating smoke and waving lights all injects new flow of liveliness into the static illustration. The tower seems to be actually moving.
My Second Attempt: I altered the prompt a bit with more specific what elements to be shown in the video such as working working, train to approach.... I also set the camera motion to panning down, from left to right, and zooming in. The animation is a lot of dramatic than the first attempt as it actually invites the viewers into the core of the tower. Yet, the quality of the video becomes much more obscure and blurry. But I really like how it add the lightening animation to the tower itself as it is all covered in the mist in the illustration.
The Third attempt: I tried to use the motion brush (Beta) on the train to make the train approach the tower. Yet, this attempt seems to fail and the overall animation seems to be too dramatic making the architecture lose its basic shape, creating the morphing dreamy atmosphere.
The Final Attempt: I asked the Runway to make the transformation from the first illustration-tower fully functional- to the second illustration-the tower abandoned. I also altered the camera movement a bit. The transformation effect is not that obvious. I really wish that Runway could allow me to input both illustrations but for now, it only allow one image input. I really like that Runway creates a foreground building in the video when zooming out.