Repository: stable-diffusion-webui
Issue: [Bug]: Connection errored out when using SDXL at 1024.
Labels: bug-report

### Checklist

- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [X] The issue has not been reported before recently
- [ ] The issue has been reported before but has not been fixed yet

### What happened?

Connection errors out whenever trying to use SDXL.

### Steps to reproduce the problem

Choose any SDXL, set width and height to 1024, type something in the prompt, and hit generate.

### What should have happened?

Generated an image and still be able to operate in a non-crashed state.

### What browsers do you use to access the UI ?

Microsoft Edge

### Sysinfo

[sysinfo-2024-03-02-08-45.json](https://github.com/AUTOMATIC1111/stable-diffusion-webui/files/14468636/sysinfo-2024-03-02-08-45.json)


### Console logs

```Shell
venv "M:\StableDiffusion\venv\Scripts\Python.exe"
fatal: not a git repository (or any of the parent directories): .git
fatal: not a git repository (or any of the parent directories): .git
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: 1.8.0-RC
Commit hash: <none>
Launching Web UI with arguments: --theme=dark --xformers --medvram --no-half-vae --no-gradio-queue
2024-03-02 03:51:17.211065: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
WARNING:tensorflow:From M:\StableDiffusion\venv\lib\site-packages\keras\src\losses.py:2976: The name tf.losses.sparse_softmax_cross_entropy is deprecated. Please use tf.compat.v1.losses.sparse_softmax_cross_entropy instead.

==============================================================================
You are running torch 2.0.1+cu118.
The program is tested to work with torch 2.1.2.
To reinstall the desired version, run with commandline flag --reinstall-torch.
Beware that this will cause a lot of large files to be downloaded, as well as
there are reports of issues with training tab on the latest version.

Use --skip-version-check commandline argument to disable this check.
==============================================================================
=================================================================================
You are running xformers 0.0.20.
The program is tested to work with xformers 0.0.23.post1.
To reinstall the desired version, run with commandline flag --reinstall-xformers.

Use --skip-version-check commandline argument to disable this check.
=================================================================================
Loading weights [0b76532e03] from M:\StableDiffusion\models\Stable-diffusion\Normal\crystalClearXL_ccxl.safetensors
Creating model from config: M:\StableDiffusion\repositories\generative-models\configs\inference\sd_xl_base.yaml
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 11.3s (prepare environment: 1.6s, import torch: 6.0s, import gradio: 0.4s, setup paths: 0.5s, initialize shared: 0.2s, other imports: 0.4s, load scripts: 0.5s, initialize extra networks: 0.4s, create ui: 0.9s, gradio launch: 0.3s).
Applying attention optimization: xformers... done.
Model loaded in 6.4s (load weights from disk: 0.8s, create model: 0.6s, apply weights to model: 4.2s, calculate empty prompt: 0.7s).
100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:04<00:00,  1.82it/s]
Total progress: 100%|████████████████████████████████████████████████████████████████████| 8/8 [00:02<00:00,  2.94it/s]
```


### Additional information

I have updated my GPU driver recently...probably has nothing to do with this.