February 14, 2022

The rabbit hole is quite deep

phil_in_a_can Blog, GANS, ITP gans, ITP, machine learning 0 Comments

This week I mostly worked with text-to-images notebooks in Google Colab. I also tried some style transfer notebooks, but to be honest I don’t really find them that interesting. Maybe I’m not using them right but a lot of my outputs feel like they are just layered photoshop files.

Lets get started with text-to-image. First up

Hypertron 2.0

Prompt: A spaceship, by Hakashina Mokinato. A brutal Style.:1 | Trending on ArtStation, unreal engine. 8K 3D. Volumetric lighting.:0.75

I used 2000 steps (iterations); the imagenet_16384, coco, and wikiart_1024 models; and 480×480 to get the final image.

Google Colab Notebook:

https://colab.research.google.com/drive/1N4UNSbtNMd31N_gAT9rAm8ZzPh62Y5ud?usp=sharing

Final image after 2000 steps

Step #95

Step #1000

Step #200

Step #1250

Step #300

Step #1500

Step #500

Step #1750

Below are a selection of steps, as the steps progress it get to a point where the changes in image are less significant. If time was a factor I probably would have around 900 steps.

Illustrip 3D

I made two different trips with this notebook. Iused the same prompt as the Hypertron 2.0 to see the difference in the output.

Prompt: A spaceship, by Hakashina Mokinato. A brutal Style.:1 | Trending on ArtStation, unreal engine. 8K 3D. Volumetric lighting.:0.75 3d hyper real

I used 200 steps to create this video.

Google Colab Notebook

https://colab.research.google.com/github/eps696/aphantasia/blob/master/IllusTrip3D.ipynb

Step #1, this starts with noise

Step #150

Step #50

Step #175

Step #100

Step #200

Prompt: A colorful snake, by HR Giger. Blood surrounds it. Trending on ArtStation, unreal engine. 8K 3D. Volumetric lighting

I wanted to see what more steps (iterations) produced, for this video I used 2000 steps.

Google Colab Notebook

https://colab.research.google.com/github/eps696/aphantasia/blob/master/IllusTrip3D.ipynb

Again we start with noise, Step #1

Step #500

Step #150

Step #750

Step #375

Step #999

Zeotrope 5.5

For Zeotrope I used both text input and images.
Prompt: A grotesque face of evil, blood, deformed teeth.

Below are the image inputs I used.

Disco Diffusion 4.1

I started with a text prompt: Spiders crawl across the landscape in space, by HR Giger, Trending on artstation. 3d.

Google colab notebook

https://colab.research.google.com/drive/1sHfRn5Y0YKYKi1k-ifUSBFRNJ8_1sa39

NueralStyleTransferFor

For this style transfer I started with a content image and a style image. After I made the composite from the two images I also tried giving the content image a weight of 0 to create a new texture image. I did this twice once with 100 steps and 1000 steps.

Google colab notebook

https://colab.research.google.com/github/dvschultz/artificial-images/blob/master/neural_style_tf.ipynb