Repository: stable-diffusion-webui
Issue: [Bug]: "Interrupt" and "skip" are frequently nonfunctional
Labels: bug-report

### Is there an existing issue for this?

- [X] I have searched the existing issues and checked the recent builds/commits

### What happened?

When I'm trying to cancel image generation, the "interrupt" and "skip" buttons frequently do nothing, and depending on how much of the image is left to process, it's often quicker to close the command window and restart the process.

### Steps to reproduce the problem

I haven't been able to reproduce it consistently, but on approximately 80-90% of the time I attempt to interrupt or skip, it will continue as though I had not interacted with it.  This happens whether I click once or several times.

The other 10%, it ends within about 15-30 seconds.

I haven't been able to determine a common thread on the generations that I can interrupt vs the ones I can't.

### What should have happened?

It should stop within 30 seconds all the time, save for extraordinary circumstances.



### Version or Commit where the problem happens

version: [v1.4.1]  •  python: 3.10.0  •  torch: 2.0.1+cu118  •  xformers: 0.0.20  •  gradio: 3.32.0 

### What Python version are you running on ?

Python 3.10.x

### What platforms do you use to access the UI ?

Windows

### What device are you running WebUI on?

Nvidia GPUs (RTX 20 above)

### Cross attention optimization

xformers

### What browsers do you use to access the UI ?

Google Chrome

### Command Line Arguments

```Shell
@echo off

set PYTHON=
set GIT=
set VENV_DIR=
set COMMANDLINE_ARGS= --no-half-vae --xformers
call webui.bat
```


### List of extensions

![image](https://github.com/AUTOMATIC1111/stable-diffusion-webui/assets/5383283/0142aa8f-229d-4565-8253-cb9d2a1d5bbf)

### Console logs

```Shell
venv "E:\p\SDWU\venv\Scripts\Python.exe"
Python 3.10.0 (tags/v3.10.0:b494f59, Oct  4 2021, 19:00:18) [MSC v.1929 64 bit (AMD64)]
Version: v1.4.1
Commit hash: f865d3e11647dfd6c7b2cdf90dde24680e58acd8
Installing requirements


#######################################################################################################
Initializing Civitai Link
If submitting an issue on github, please provide the below text for debugging purposes:

Python revision: 3.10.0 (tags/v3.10.0:b494f59, Oct  4 2021, 19:00:18) [MSC v.1929 64 bit (AMD64)]
Civitai Link revision: 2dfc03c17304278ca0b456366cc7871a2af8377b
SD-WebUI revision: f865d3e11647dfd6c7b2cdf90dde24680e58acd8

Checking Civitai Link requirements...
[+] python-socketio[client] version 5.7.2 installed.

#######################################################################################################

Launching Web UI with arguments: --no-half-vae --xformers
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
2023-07-20 11:32:16,649 - ControlNet - INFO - ControlNet v1.1.230
ControlNet preprocessor location: E:\p\SDWU\extensions\sd-webui-controlnet\annotator\downloads
2023-07-20 11:32:17,245 - ControlNet - INFO - ControlNet v1.1.230
Civitai: API loaded
Loading weights [5a1c2b4a08] from E:\p\SDWU\models\Stable-diffusion\meinaunreal_v1Beta.safetensors
E:\p\SDWU\venv\lib\site-packages\gradio\components.py:4504: UserWarning: The 'grid' parameter will be deprecated. Please use 'columns' instead.
  warnings.warn(
E:\p\SDWU\venv\lib\site-packages\gradio\components.py:3356: UserWarning: You have unused kwarg parameters in Button, please remove them: {'size': 'sm'}
  IOComponent.__init__(
Creating model from config: E:\p\SDWU\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Civitai Link: Connecting to Civitai Link Server
Civitai Link: Connected to Civitai Link Server
Civitai: Check resources for missing preview images
Startup time: 72.3s (import torch: 27.1s, import gradio: 6.5s, import ldm: 3.8s, other imports: 8.9s, setup codeformer: 0.4s, list SD models: 2.4s, load scripts: 12.1s, initialize extra networks: 0.2s, scripts before_ui_callback: 1.2s, create ui: 5.7s, gradio launch: 2.2s, app_started_callback: 1.6s).
Civitai: Found 4 resources missing preview images
Civitai Link: Joined room 888bc4ef35fb6c3841fc6136b4b1650b38b73844120d44e15082451fde51d963fb8f72d0f1bf881cca5a69a5f5e8a3eb5f60465d8fd18be0ea34c2e31c413b86
Civitai Link: Presence update: SD: 1, Clients: 1
Civitai Link: Connected to Civitai Instance
Civitai Link: Incoming Command: activities:list
Civitai Link: Incoming Command: resources:list
Civitai: No preview images found on Civitai
preload_extensions_git_metadata for 20 extensions took 7.46s
Applying attention optimization: xformers... done.
Textual inversion embeddings loaded(21): an6, bad-artist, bad-hands-5, bad-picture-chill-75v, BadDream, badhandv4, black-ballgag, corneo_ball_gag, corneo_dva, corneo_tentacle_sex, difConsistency_negative_v2, easynegative, FastNegativeV2, fcNeg-neg, helly-valentine-v1, negativeembed, ng_deepnegative_v1_75t, realisticvision-negative-embedding, SimpleNegative, Unspeakable-Horrors-Composition-4v, verybadimagenegative_v1.3
Textual inversion embeddings skipped(4): negmutation-200, Neg_Facelift768, photozoov21, rz-neg-general
Model loaded in 100.5s (load weights from disk: 8.0s, load config: 0.5s, create model: 1.8s, apply weights to model: 78.3s, apply half(): 0.9s, move model to device: 9.0s, load textual inversion embeddings: 1.7s, calculate empty prompt: 0.2s).
2023-07-20 11:34:24,595 - ControlNet - INFO - Loading model: control_v11p_sd15_openpose [cab727d4]
2023-07-20 11:34:32,777 - ControlNet - INFO - Loaded state_dict from [E:\p\SDWU\extensions\sd-webui-controlnet\models\control_v11p_sd15_openpose.pth]
2023-07-20 11:34:32,777 - ControlNet - INFO - Loading config: E:\p\SDWU\extensions\sd-webui-controlnet\models\control_v11p_sd15_openpose.yaml
2023-07-20 11:34:36,199 - ControlNet - INFO - ControlNet model control_v11p_sd15_openpose [cab727d4] loaded.
2023-07-20 11:34:36,339 - ControlNet - INFO - Loading preprocessor: none
2023-07-20 11:34:36,339 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 50/50 [01:06<00:00,  1.34s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [03:34<00:00,  8.57s/it]
E:\p\SDWU\venv\lib\site-packages\torchvision\models\_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
  warnings.warn(
E:\p\SDWU\venv\lib\site-packages\torchvision\models\_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`.
  warnings.warn(msg)
Total progress: 100%|██████████████████████████████████████████████████████████████████| 75/75 [05:43<00:00,  4.59s/it]
Python 3.10.0 (tags/v3.10.0:b494f59, Oct  4 2021, 19:00:18) [MSC v.1929 64 bit (AMD64)]| 75/75 [05:43<00:00,  8.60s/it]
Version: v1.4.1
Commit hash: f865d3e11647dfd6c7b2cdf90dde24680e58acd8
Installing requirements


#######################################################################################################
Initializing Civitai Link
If submitting an issue on github, please provide the below text for debugging purposes:

Python revision: 3.10.0 (tags/v3.10.0:b494f59, Oct  4 2021, 19:00:18) [MSC v.1929 64 bit (AMD64)]
Civitai Link revision: 2dfc03c17304278ca0b456366cc7871a2af8377b
SD-WebUI revision: f865d3e11647dfd6c7b2cdf90dde24680e58acd8

Checking Civitai Link requirements...
[+] python-socketio[client] version 5.7.2 installed.

#######################################################################################################

Launching Web UI with arguments: --no-half-vae --xformers
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
2023-07-20 11:47:46,676 - ControlNet - INFO - ControlNet v1.1.230
ControlNet preprocessor location: E:\p\SDWU\extensions\sd-webui-controlnet\annotator\downloads
2023-07-20 11:47:47,220 - ControlNet - INFO - ControlNet v1.1.230
Civitai: API loaded
Loading weights [5a1c2b4a08] from E:\p\SDWU\models\Stable-diffusion\meinaunreal_v1Beta.safetensors
E:\p\SDWU\venv\lib\site-packages\gradio\components.py:4504: UserWarning: The 'grid' parameter will be deprecated. Please use 'columns' instead.
  warnings.warn(
Creating model from config: E:\p\SDWU\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Civitai Link: Connecting to Civitai Link Server
DiffusionWrapper has 859.52 M params.
Civitai Link: Connected to Civitai Link Server
Civitai: Check resources for missing preview images
Startup time: 42.5s (import torch: 8.4s, import gradio: 4.7s, import ldm: 2.1s, other imports: 5.2s, setup codeformer: 0.3s, list SD models: 1.6s, load scripts: 9.5s, initialize extra networks: 0.2s, scripts before_ui_callback: 1.1s, create ui: 3.8s, gradio launch: 4.1s, app_started_callback: 1.3s).
Civitai Link: Joined room 888bc4ef35fb6c3841fc6136b4b1650b38b73844120d44e15082451fde51d963fb8f72d0f1bf881cca5a69a5f5e8a3eb5f60465d8fd18be0ea34c2e31c413b86
Civitai Link: Presence update: SD: 1, Clients: 1
Civitai Link: Connected to Civitai Instance
Civitai: Found 4 resources missing preview images
Civitai Link: Incoming Command: activities:list
Civitai Link: Incoming Command: resources:list
Civitai: No preview images found on Civitai
preload_extensions_git_metadata for 20 extensions took 7.91s
Applying attention optimization: xformers... done.
Textual inversion embeddings loaded(21): an6, bad-artist, bad-hands-5, bad-picture-chill-75v, BadDream, badhandv4, black-ballgag, corneo_ball_gag, corneo_dva, corneo_tentacle_sex, difConsistency_negative_v2, easynegative, FastNegativeV2, fcNeg-neg, helly-valentine-v1, negativeembed, ng_deepnegative_v1_75t, realisticvision-negative-embedding, SimpleNegative, Unspeakable-Horrors-Composition-4v, verybadimagenegative_v1.3
Textual inversion embeddings skipped(4): negmutation-200, Neg_Facelift768, photozoov21, rz-neg-general
Model loaded in 98.8s (load weights from disk: 8.5s, load config: 0.1s, create model: 1.7s, apply weights to model: 78.3s, apply half(): 1.0s, move model to device: 7.7s, load textual inversion embeddings: 0.8s, calculate empty prompt: 0.5s).
                                  controlnet batch mode
2023-07-20 11:57:34,208 - ControlNet - INFO - Loading model: control_v11p_sd15_openpose [cab727d4]
2023-07-20 11:57:42,298 - ControlNet - INFO - Loaded state_dict from [E:\p\SDWU\extensions\sd-webui-controlnet\models\control_v11p_sd15_openpose.pth]
2023-07-20 11:57:42,298 - ControlNet - INFO - Loading config: E:\p\SDWU\extensions\sd-webui-controlnet\models\control_v11p_sd15_openpose.yaml
2023-07-20 11:57:45,886 - ControlNet - INFO - ControlNet model control_v11p_sd15_openpose [cab727d4] loaded.
2023-07-20 11:57:46,072 - ControlNet - INFO - Loading preprocessor: none
2023-07-20 11:57:46,072 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 50/50 [01:03<00:00,  1.26s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [03:20<00:00,  8.02s/it]
E:\p\SDWU\venv\lib\site-packages\torchvision\models\_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
  warnings.warn(
E:\p\SDWU\venv\lib\site-packages\torchvision\models\_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`.
  warnings.warn(msg)
2023-07-20 12:03:06,597 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_openpose [cab727d4]
2023-07-20 12:03:06,709 - ControlNet - INFO - Loading preprocessor: none
2023-07-20 12:03:06,710 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 50/50 [00:57<00:00,  1.15s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [03:24<00:00,  8.16s/it]
2023-07-20 12:08:13,969 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_openpose [cab727d4] 8.07s/it]
2023-07-20 12:08:14,018 - ControlNet - INFO - Loading preprocessor: none
2023-07-20 12:08:14,019 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 50/50 [00:58<00:00,  1.16s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [03:30<00:00,  8.41s/it]
2023-07-20 12:13:30,262 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_openpose [cab727d4] 8.57s/it]
2023-07-20 12:13:30,332 - ControlNet - INFO - Loading preprocessor: none
2023-07-20 12:13:30,333 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 50/50 [01:01<00:00,  1.23s/it]
 28%|███████████████████████▏                                                           | 7/25 [01:00<02:34,  8.60s/it]Civitai Link: Presence update: SD: 1, Clients: 0██████████████████████████████████▏   | 282/300 [21:02<02:35,  8.65s/it]
Civitai Link: Disconnected from Civitai Instance
 32%|██████████████████████████▌                                                        | 8/25 [01:08<02:26,  8.61s/it]Civitai Link: Presence update: SD: 1, Clients: 1██████████████████████████████████▎   | 283/300 [21:11<02:27,  8.65s/it]
Civitai Link: Connected to Civitai Instance
Civitai Link: Incoming Command: activities:list
Civitai Link: Incoming Command: resources:list
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [03:32<00:00,  8.49s/it]
Total progress: 100%|████████████████████████████████████████████████████████████████| 300/300 [23:59<00:00,  4.80s/it]
 31%|█████████████████████████▉                                                         | 5/16 [00:42<01:14,  6.80s/it]packet queue is empty, aborting███████████▉                                              | 5/16 [00:22<00:53,  4.90s/it]
 50%|█████████████████████████████████████████▌                                         | 8/16 [00:58<00:47,  5.94s/it]Civitai Link: Disconnected from Civitai Link Server████▌                                 | 8/16 [00:38<00:42,  5.36s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 16/16 [01:44<00:00,  6.56s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 16/16 [01:45<00:00,  6.60s/it]
controlnet batch mode██████████████████████████████████████████████████████████████████| 16/16 [01:45<00:00,  5.70s/it]
2023-07-20 12:43:00,538 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_openpose [cab727d4]
2023-07-20 12:43:00,653 - ControlNet - INFO - Loading preprocessor: none
2023-07-20 12:43:00,654 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 50/50 [00:57<00:00,  1.15s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [03:20<00:00,  8.03s/it]
2023-07-20 12:48:11,610 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_openpose [cab727d4] 8.01s/it]
2023-07-20 12:48:11,730 - ControlNet - INFO - Loading preprocessor: none
2023-07-20 12:48:11,730 - ControlNet - INFO - preprocessor resolution = 512
 80%|█████████████████████████████████████████████████████████████████▌                | 40/50 [00:45<00:11,  1.14s/it]
```


### Additional information

This behavior has existed since I started using Stable Diffusion, even when I had no extensions