Problem optimising in Olive/ONNX/Automatic1111

#30
by mistamichal - opened

I'm having a problem here.

I can download the model just fine but I can't optimise it. If I use the Stable diffusion option, it just gives me an assertion error straight away. If I use the Stable diffusion XL (which is the one I think I'm supposed to use), it starts optimising then, after a few minutes, quits with an assertion error.

Am I doing something wrong?

RuntimeError: mat1 and mat2 shapes cannot be multiplied (2x2304 and 2816x1280)
[2023-12-16 22:24:13,938] [WARNING] [engine.py:912:_run_passes] Skipping evaluation as model was pruned
[2023-12-16 22:24:13,939] [INFO] [engine.py:610:create_pareto_frontier_footprints] Output all 0 models
[2023-12-16 22:24:13,940] [INFO] [engine.py:357:run] Run history for gpu-dml:
[2023-12-16 22:24:13,940] [INFO] [engine.py:636:dump_run_history] Please install tabulate for better run history output
[2023-12-16 22:24:13,941] [INFO] [engine.py:372:run] No packaging config provided, skip packaging artifacts
*** Error completing request
*** Arguments: ('', '', 'vae', 'stable-diffusion-v1-5', 'stable-diffusion-v1-5', 'stabilityai/sdxl-turbo', '', 'vae', 'sdxl-turbo', 'sdxl-turbo', True, True, True, True, True, True, True, True, True, True, 'euler', True, 512, False, '', '', '') {}
Traceback (most recent call last):
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\call_queue.py", line 57, in f
res = list(func(*args, **kwargs))
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\call_queue.py", line 36, in f
res = func(*args, **kwargs)
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\ui.py", line 2117, in optimize
return optimize_sdxl_from_onnx(
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\sd_olive_ui.py", line 285, in optimize_sdxl_from_onnx
optimize(
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\sd_olive_ui.py", line 363, in optimize
assert conversion_footprint and optimizer_footprint
AssertionError

I'm having a problem here.

I can download the model just fine but I can't optimise it. If I use the Stable diffusion option, it just gives me an assertion error straight away. If I use the Stable diffusion XL (which is the one I think I'm supposed to use), it starts optimising then, after a few minutes, quits with an assertion error.

Am I doing something wrong?

RuntimeError: mat1 and mat2 shapes cannot be multiplied (2x2304 and 2816x1280)
[2023-12-16 22:24:13,938] [WARNING] [engine.py:912:_run_passes] Skipping evaluation as model was pruned
[2023-12-16 22:24:13,939] [INFO] [engine.py:610:create_pareto_frontier_footprints] Output all 0 models
[2023-12-16 22:24:13,940] [INFO] [engine.py:357:run] Run history for gpu-dml:
[2023-12-16 22:24:13,940] [INFO] [engine.py:636:dump_run_history] Please install tabulate for better run history output
[2023-12-16 22:24:13,941] [INFO] [engine.py:372:run] No packaging config provided, skip packaging artifacts
*** Error completing request
*** Arguments: ('', '', 'vae', 'stable-diffusion-v1-5', 'stable-diffusion-v1-5', 'stabilityai/sdxl-turbo', '', 'vae', 'sdxl-turbo', 'sdxl-turbo', True, True, True, True, True, True, True, True, True, True, 'euler', True, 512, False, '', '', '') {}
Traceback (most recent call last):
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\call_queue.py", line 57, in f
res = list(func(*args, **kwargs))
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\call_queue.py", line 36, in f
res = func(*args, **kwargs)
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\ui.py", line 2117, in optimize
return optimize_sdxl_from_onnx(
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\sd_olive_ui.py", line 285, in optimize_sdxl_from_onnx
optimize(
File "C:\Users******\sd-local\stable-diffusion-webui-directml\modules\sd_olive_ui.py", line 363, in optimize
assert conversion_footprint and optimizer_footprint
AssertionError

Having this exact same issue and I haven't managed to solve it yet.

I had this error, but there where actually another error before that when I scrolled back hinting at missing .json files in "stable-diffusion-webui-directml\models\OliveCache\stable-diffusion-v1-5"
after deleting the cache and restarting models are optimizing just fine.

I updated to ONNYX/Olive and it works great, the only problem is that none of the face swapping extensions work, any ideas? When I run it, it doesnt even acknowlege that it is trying to faceswap.

Sign up or log in to comment