Repository: stable-diffusion-webui
Issue: [Bug]: SD XL model loading on AMD - Failed to create model quickly; will retry using slow method
Labels: bug-report

### Is there an existing issue for this?

- [X] I have searched the existing issues and checked the recent builds/commits

### What happened?

Trying to load the sd_xl_base_0.9.safetensors model ends with:

> Creating model from config: /dockerx/repositories/generative-models/configs/inference/sd_xl_base.yaml
> Failed to create model quickly; will retry using slow method.

The file is in the folder present and should be readable. 

Inside an docker container on a linux maschine with an AMD card. Maybe i missed a step.

### Steps to reproduce the problem

Load sd_xl_base_0.9.safetensors via UI. 


### What should have happened?

Model should be loaded

### Version or Commit where the problem happens

14cf434bc36d0ef31f31d4c6cd2bd15d7857d5c8

### What Python version are you running on ?

Python 3.9.x (below, no recommended)

### What platforms do you use to access the UI ?

Linux

### What device are you running WebUI on?

AMD GPUs (RX 6000 above)

### Cross attention optimization

Automatic

### What browsers do you use to access the UI ?

Google Chrome

### Command Line Arguments

```Shell
TORCH_COMMAND='pip install  torch==1.13.1+rocm5.2 torchvision==0.14.1+rocm5.2 --index-url https://download.pytorch.org/whl/rocm5.2' python launch.py --precision full --no-half --lyco-dir /dockerx/models/lycoris/
```


### List of extensions



PBRemTools | https://github.com/mattyamonaca/PBRemTools.git | main | d0fee2a8 | Thu Jun 29 14:08:23 2023 | latest
-- | -- | -- | -- | -- | --
Stable-Diffusion-Webui-Civitai-Helper | https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper.git | main | 920ca326 | Tue May 23 11:53:22 2023 | latest
a1111-sd-webui-lycoris | https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris.git | main | 8e97bf54 | Sun Jul 9 07:44:58 2023 | latest
a1111-sd-webui-tagcomplete | https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git | main | 737b6973 | Sat Jul 8 16:03:44 2023 | latest
model_preset_manager | https://github.com/rifeWithKaiju/model_preset_manager.git | main | 4e25eebd | Tue May 30 15:07:37 2023 | latest
sd-webui-controlnet | https://github.com/Mikubill/sd-webui-controlnet.git | main | 07bed6cc | Sat Jul 8 20:54:01 2023 | latest
stable-diffusion-webui-eyemask | https://github.com/ilian6806/stable-diffusion-webui-eyemask.git | master | 7b803a43 | Fri Jun 2 11:15:19 2023 | latest

PBRemTools	https://github.com/mattyamonaca/PBRemTools.git	main	[d0fee2a8](https://github.com/mattyamonaca/PBRemTools/commit/d0fee2a81dd4b656002873493bc27a5312df2187)	Thu Jun 29 14:08:23 2023	latest
Stable-Diffusion-Webui-Civitai-Helper	https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper.git	main	[920ca326](https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper/commit/920ca3267f789a72e3225c99f069bf0be0db795d)	Tue May 23 11:53:22 2023	latest
a1111-sd-webui-lycoris	https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris.git	main	[8e97bf54](https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris/commit/8e97bf54867c25d00fc480be1ab4dae5399b35ef)	Sun Jul 9 07:44:58 2023	latest
a1111-sd-webui-tagcomplete	https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git	main	[737b6973](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/commit/737b697357af06eb2edb392a5b82d98f6e726637)	Sat Jul 8 16:03:44 2023	latest
model_preset_manager	https://github.com/rifeWithKaiju/model_preset_manager.git	main	[4e25eebd](https://github.com/rifeWithKaiju/model_preset_manager/commit/4e25eebd4b24fb903d2815ac30b787f37a98923c)	Tue May 30 15:07:37 2023	latest
sd-webui-controlnet	https://github.com/Mikubill/sd-webui-controlnet.git	main	[07bed6cc](https://github.com/Mikubill/sd-webui-controlnet/commit/07bed6ccf8a468a45b2833cfdadc749927cbd575)	Sat Jul 8 20:54:01 2023	latest
stable-diffusion-webui-eyemask	https://github.com/ilian6806/stable-diffusion-webui-eyemask.git	master	[7b803a43](https://github.com/ilian6806/stable-diffusion-webui-eyemask/commit/7b803a438f02b381903916b65cc5b15c98e3231c)	Fri Jun 2 11:15:19 2023	latest

### Console logs

```Shell
> Creating model from config: /dockerx/repositories/generative-models/configs/inference/sd_xl_base.yaml
> Failed to create model quickly; will retry using slow method.
```


### Additional information

Its running in the following docker container image:

> rocm/pytorch:rocm5.5_ubuntu20.04_py3.8_pytorch_1.13.1