InstantX

/

FLUX.1-dev-Controlnet-Union

like 334

？？

Line art is controlnet model on sd 1.5, it works well in sd. I was wondering if a model like that will exist for flux.

Hello, thanks for the good work you've done, it's great!
Are you planning to add the Flux-compatible Lineart controlnet model?

At present, there are no plans to implement lineart control. Personally, I think that Lineart and Canny are essentially the same thing. Value is not very significant.

Canny - Preprocessor uses the openCV canny edge detection to detect edges in an image. Generally used to get structure and details of an image.
Lineart - Preprocessor uses a model awacke1/Image-to-Line-Drawings to generate the map. Model can accept either images from the preprocessor or pure lineart to effectively color the lineart.

I believe it's not intended for the same use case. For instance, artists tend to prefer lineart over canny because it allows the generated output to precisely match their original drawings.
Maybe I can help to implement this? :D

Yes, line art model is what artist love to use because it keeps to the drawing.

The lineart models allow for much better sketch painting, relative to the regular canny one

I'm also looking for this!
I just found this that could be what we need.. ?
I don't run flux in my computer because of capabilities neither I am a programmer so I am hoping some charitable soul will implement this into a google colab notebook or something usable for people like us. 🥺
https://huggingface.co/promeai/FLUX.1-controlnet-lineart-promeai

I'm also looking for this!
I just found this that could be what we need.. ?
I don't run flux in my computer because of capabilities neither I am a programmer so I am hoping some charitable soul will implement this into a google colab notebook or something usable for people like us. 🥺
https://huggingface.co/promeai/FLUX.1-controlnet-lineart-promeai
Hi @VSG ,
I tested controlnet and it doesn't work as well as controlnet-union on sdxl