Apply for community grant: Academic project

#1
by vict0rsch - opened

Beyond ClimateGAN

ClimateGAN's contributions are mostly around the data set and the Masker model. The "Painter" is but a GauGAN with small tweaks.

In this space, I explore how in-painting with Stable Diffusion as a Painter can turn ClimateGAN into ClimateDiffGAN (the Masker is still trained with a GAN approach to Domain Adaptation (AdvEnt / DADA)).

It runs in 30s on T4s which I pay for myself (it does not run on CPUs unfortunately) so this can't stay up for long... except for a community grant!

Twitter thread

I'm adding output examples and Space screenshots to see the potential:

1
2
3
4
5
6
7
8
9
10

Sign up or log in to comment