VQGAN + CLIP Training Compilation
Channel: IzarahWolf
Date: 2022-05-03

Series of 10 VQGAN+CLIP images being produced, building on each other.

VQGAN+CLIP is a generative text-to-image model.
VQGAN (Vector Quantized General Adversarial Network) uses a generator and a discriminator to generate data and attempt to distinguish the generated data from real data. The discriminator constantly improves its ability to discern real from generated data, while the generator continues to try fooling it with the generated data. This back and forth process is the adversarial aspect.
CLIP (Contrastive Language-Image Pre-training) is an OpenAI learning method that essentially maps image and text embeddings together. Training works to correctly match (image, text) pairings, which can then be used to describe images textually, or produce images given textual input.

Parameters used:
Seed: 7677598577
Iterations: 500 per input
[ Input Text | Up to three modifiers / Learning Rate ]
1. (00:00) Fierce wolf running through the forest at night | airbrush art | charcoal drawing | album art / 0.1
2. (00:05) A wolf howling at the moon | ink drawing | watercolor | ? / 0.1
3. (00:10) A siberian tiger volcanic eruption | Arthur Suydam:0.5 | chalk art | charcoal drawing / 0.1
4. (00:15) Lightning striking a fallen log | photography | ambient occlusion / 0.1
5. (00:20) robin chicks hatching on ley lines | film noir | fantasy / 0.11
6. (00:25) goldfish playing video games | infrared | kaleidoscope | greyscale / 0.12
7. (00:30) popcorn in a cheese grater | pixiv | steampuink:0.4 | Syd Mead:0.7 / 0.13
8. (00:35) metal wings | chihuly / 0.14
9. (00:41) ballerinas playing basketball | made of wire | made of feathers | matte background / 0.12
10. (00:47) smoke scene on a round theatre stage | low poly | made of mist | art on Instagram / 0.1

Audio by 0xF

More VQGAN+CLIP:
https://imgur.com/a/SALxbQm
https://creator.nightcafe.studio/vqgan-clip-keyword-modifier-comparison#results
https://www.fabianmosele.com/generating-images-from-text-vqgan-clip

Run your own VQGAN+CLIP:
(Local) https://github.com/nerdyrodent/VQGAN-CLIP
(Jupyter NB) https://colab.research.google.com/drive/1ZAus_gn2RhTZWzOWUpPERNC0Q8OhZRTZ