Ip adapter face id and face id plus not working sdxl forge ui

#48
by mantrap - opened

Hey everyone, I am using forge UI and working with control net, but ip adapter face id and ip adapter face id plus is generating image but completely different not even of the face! I am assuming its not able to read the input image even though i can see it in the preview of control net window, I am using InsightFace+CLIP-H and ViT-H, ViT-bigG as an encoder(control net preprocessor) . But when I am using ip-adapter-plus-face_sdxl_vit-h model it is around 50-70 percent working. Also other ViT-H models working, except for face id and ViT-bigG it is not giving error but result is not at all related, btw the base model is sdxl

Owner

can you also give a PR at forge UI repo?

To create a public link, set share=True in launch().
2024-04-06 16:27:54,561 - AnimateDiff - INFO - Hacking i2i-batch.
2024-04-06 16:27:54,563 - AnimateDiff - INFO - Hacking i2i-batch.
Startup time: 2.8s (load scripts: 1.0s, create ui: 1.2s, add APIs: 0.3s).
2024-04-06 16:29:11,873 - ControlNet - INFO - Preview Resolution = 512
Traceback (most recent call last):
File "D:\novelai-webui-aki-v3\py310\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "D:\novelai-webui-aki-v3\py310\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "D:\novelai-webui-aki-v3\py310\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "D:\novelai-webui-aki-v3\py310\lib\site-packages\anyio\to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "D:\novelai-webui-aki-v3\py310\lib\site-packages\anyio_backends_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "D:\novelai-webui-aki-v3\py310\lib\site-packages\anyio_backends_asyncio.py", line 867, in run
result = context.run(func, *args)
File "D:\novelai-webui-aki-v3\py310\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "D:\novelai-webui-aki-v3\extensions\sd-webui-controlnet\scripts\controlnet_ui\controlnet_ui_group.py", line 1015, in run_annotator
result, is_image = preprocessor(
File "D:\novelai-webui-aki-v3\extensions\sd-webui-controlnet\scripts\utils.py", line 81, in decorated_func
return cached_func(*args, **kwargs)
File "D:\novelai-webui-aki-v3\extensions\sd-webui-controlnet\scripts\utils.py", line 65, in cached_func
return func(*args, **kwargs)
File "D:\novelai-webui-aki-v3\extensions\sd-webui-controlnet\scripts\global_state.py", line 37, in unified_preprocessor
return preprocessor_modules[preprocessor_name](*args, **kwargs)
File "D:\novelai-webui-aki-v3\extensions\sd-webui-controlnet\scripts\processor.py", line 830, in face_id_plus
face_embed, _ = g_insight_face_model.run_model(img)
File "D:\novelai-webui-aki-v3\extensions\sd-webui-controlnet\scripts\processor.py", line 749, in run_model
self.load_model()
File "D:\novelai-webui-aki-v3\extensions\sd-webui-controlnet\scripts\processor.py", line 741, in load_model
self.model = FaceAnalysis(
TypeError: FaceAnalysis.init() got an unexpected keyword argument 'providers'

Sign up or log in to comment