Artificial Imagination: Deconstructing Style

Preface

Each section shows off experiments with a different model, and as such, trained separately. When listing the epoch number, that is merely to identify stage of training, but all testing images will utilize the model at the latest epoch: 200.

Also, all experiments will be shown in reverse chronological order: that is the most recent ones will be here at the top.

Phase 2: Retraining on Itself

You will notice that the following retrained models only show the training process: this is to show how the model is now affected by reintroducing (and slowly replacing) the dataset over time, so that it generates art that is based on its own art. As such, I am slowly cutting off its imagination, and allowing it to be "inspired" by its own artworks, molded as it continuously weens off of its creator. However, as the creator, I also have the responsibility in shaping its style: I curate the best testing images that make it back into the training database, so I can help guide it to evolved. One could say this is similar to selective breeding, but with a machine's art style instead. 

You'll notice this cool "smoothing" or mellowing out of the artworks produced--I am using the imperfection of the generator as a feature of change over time. Many weird artifacts get smoothed out as I re-feed these works.

Model: Full Retrain with Generated Art (6/10/2023)

(100% Generated Art)

Training

(Epoch 177/200)

Input 

Target (Real)

Output (Simulated)

(Epoch 181/200)

Input 

Target (Real)

Output (Simulated)

(Epoch 190/200)

Input 

Target (Real)

Output (Simulated)

Model: Retrain with Generated Art (6/6/2023)

(50% Generated Art, 50% My Art)

Training

(Epoch 100/200)

Input 

Target (Real)

Output (Simulated)

(Epoch 166/200)

Input 

Target (Real)

Output (Simulated)

(Epoch 194/200)

Input 

Target (Real)

Output (Simulated)

Model: Retrain with Generated Art (5/8/2023)

(11% Generated Art, 89% My Art)

Training

(Epoch 102/200)

Input 

Target (Real)

Output (Simulated)

(Epoch 163/200)

Input 

Target (Real)

Output (Simulated)

(Epoch 174/200)

Input 

Target (Real)

Output (Simulated)

Phase 1: Training with my Art

This section is dedicated to the ideation process, and a stage where the machine is fully dependent on my own artwork for training itself. We can see the various stages as it is allowed to develop, but one thing to note is that the imperfections are part of the process: they are what make for interesting little accidents.

Model: Sketch to Full Piece (4/24/2023)

Training

(Epoch 200/200)

Input 

Target (Real)

Output (Simulated)

Testing

Input

Output (Simulated)

Model: Line Art to Full Piece (4/10/2023)

Training

(Epoch 200/200)

Input 

Target (Real)

Output (Simulated)

Testing

Input

Output (Simulated)

Model: Sketch to Line Art (2/27/2023)

Training

(Epoch 151/200)

Input 

Target (Real)

Output (Simulation)

Testing

Input 

Output (Simulated)