[Questions] Updates, SDXL TI, Compressions... curiosities

#30
by ZProphete - opened

Hello @GuiyeC !
I'm just checking up on my favorite app/dev !
Thanks for the updates in the converter and the LoRA addition,

  • Will you support the SDXL TI's soon ?
    While there are not many yet, I've been in a journey in training TI's for 1.5 with decent success, so I'd like to dive into it !
    I see there is "TextEncoder" and "TextEncoder2", I hope those added TI will fit into the smallest :D

  • Maybe you got some progress at Reference controlnet ? It may stops the training/dreambooth once for all, idk :)

  • I'm not on Sonoma Beta, I'm curious about your experience with the compressions, How long are those compressions ? have you tried to go lower than 6bits ?
    On Apple's HF repo there is (only?) about 570MB difference from 16bits to 6bits I was hoping to have 1:1, 2:3, 3:2 for the storage of a single old model, are my expectations too high ?

Cheers.

Guernika org

Hey @ZProphete ! Let's see:

  • It looks like there is no official support for SDXL in diffusers yet, I will add it once it's there, for now LoRA is working nicely with SDXL, I know it's not as convenient :/
  • I did check it out and I gave up pretty quickly, it seemed reaaaally hacky, I think it would need two different Unet models in order to work, maybe I should give it another look but I'm not 100% sure it will be convenient.
  • I did try compressing down to 4 bits but the precision loss was way to noticeable, with 6 bits it was pretty much the same as with no compression, there is a new method in Apple's repo that may improve on this but I haven't tried it yet, it takes a loooong time for compression to run so I will probably wait until Sonoma is closer to public release.

Hi !

  • You are right, thank you !
  • Hope you can give another look, you mean like a separate controlNet model to download instead of builtin ?
  • Dang, I hope they fix multi-input anytime soon :)

Thank you for your work,

  • May I suggest to add "Right-click, Paste" context menu on img2img and specially controlNet, beside Drag-Drop and Select File.
  • I guess Guernika is SwiftUI based ? For fun, I'm trying to make a 2D skeleton editor with inverse kinematics (for open pose), I'll drop it here if it goes anywhere :)

No complains so far xD,
good job xD

Edit :
Actually, I can't start the app anymore without playing inside ~/Library/Containers/com.guiyec.Guernika/Data/Documents/ and rename remove the "Models" folder from time to time,
Thought it was character error or symlined folder, I'm not sure anymore
Guernika crashes silently, opening in console shows nothing special to me, but I see you are on the track with a Sentry, how can I report correctly ?

ZProphete changed discussion status to closed

Sign up or log in to comment