Spaces:
Sleeping
SD 1.5 or 2.1 support?
Hello,
This is really great, thanks! Is it possible to connect this to SD 1.5 or 2.1? If so, how would I go about doing so? What about a custom checkpoint like OpenJourney v2?
Thanks!
Hi there!
So far I have not tried other SD versions or models. My guess is that SD 1.5 might work out of the box, because as far as I know it doesn't involve a different model architecture. SD 2 however, will probably not work out of the box, because it includes a super-resolution component. You will have to change some points in the code where a mapping between pixels locations and latent space locations is computed. In SD 1.4 the mapping is just (x/8, y/8) because that is the compression factor of the encoder to latent space. For SD 2 you will need to take into account the upscaling model as well.
Regarding other models such as OpenJourney, they might also require other adaptions of the source code. But since I have not worked with such models, I'm currently clueless about the path to follow. I guess I would start by trying to load such model and see what happens :)