Image-to-Image
Diffusers
Safetensors
English
controlnet
laion
face
mediapipe

Changing the position of the view does not work (location of eye apples)

#15
by Alek80 - opened

Hello.
Problem # 1:
I can not change the position of the eyeballs. The position of the mouth (open or closed mouth) works, also works a change in the position of the head. I can’t understand why the direction of gaze does not change. What could be the problem? I tried different settings.

Question #2:
Now I have a version of Mediapipe == 0.9.1.0, this is a current version?

Thank you for your time)

Hi there. To answer #1, the network is not perfect. It will still get gaze direction wrong some of the time and for some art styles. It can help to add to the prompt "looking to the left" or things like this, but it's still not quite a guarantee. To answer #2, that is a current version, yes. I think there's an apple-silicon version, too, but that shouldn't be needed unless you're on an ARM chipset.

Hi.
I understood you.
Therefore, I again have two questions:
1# are it planned to improve and refine ControlnetMediapipeFace (representation, eye position)?
2# the main question. Controlnet 1.1 updated. But I can’t get it because I installed ControlnetMediapipeFace, now I have to delete it and install Controlnet 1.1. When the merger is planned, so can Controlnet 1.1 and ControlnetMediapipeFace be used together?

Sincerely

The progress of the merge can be tracked here: https://github.com/Mikubill/sd-webui-controlnet/pull/688

As of 42 minutes ago the merge conflicts are resolved. We are hopeful that things will be merged and shipped shortly.

Sign up or log in to comment