Repository: stable-diffusion-webui
Issue: [Bug]: Inpainting gives more or less SAME result as the input image
Labels: bug-report

### Is there an existing issue for this?

- [X] I have searched the existing issues and checked the recent builds/commits

### What happened?

Inpainting gives the same result as input image

I want a seaside view in the masked area, but i got the same white bg as the input
![image](https://github.com/AUTOMATIC1111/stable-diffusion-webui/assets/73646719/4ccc9a43-e768-446f-a1c8-e19c1a03620f)

But if I do in the official stable diffusion inpainting huggingface space, it works fine. (same checkpoint and image)
![image](https://github.com/AUTOMATIC1111/stable-diffusion-webui/assets/73646719/1db3de87-4a8c-46e3-928c-bb8fb2328cb1)


### Steps to reproduce the problem

1. use the stable diffusion 1.5 inpainting model
2. input an image with a pure white background 
3. do inpainting


### What should have happened?

It should give what I described in the text prompt

### Commit where the problem happens

https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/18acc0b30d9184702a772287ed8197385e0aed98

### What Python version are you running on ?

Python 3.10.x

### What platforms do you use to access the UI ?

Linux

### What device are you running WebUI on?

Nvidia GPUs (RTX 20 above)

### What browsers do you use to access the UI ?

Google Chrome

### Command Line Arguments

```Shell
No
```


### List of extensions

![image](https://github.com/AUTOMATIC1111/stable-diffusion-webui/assets/73646719/7e1e4e7f-e2b9-4865-837c-4310d604cd6b)

### Console logs

```Shell
Launching Web UI with arguments: 
No module 'xformers'. Proceeding without it.
ControlNet v1.1.191
ControlNet v1.1.191
Loading weights [c6bbc15e32] from /home/workspace/difusion_models/stable-diffusion-webui/models/Stable-diffusion/sd-v1-5-inpainting.ckpt
Create LRU cache (max_size=16) for preprocessor results.
Create LRU cache (max_size=16) for preprocessor results.
preload_extensions_git_metadata for 8 extensions took 0.07s
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Create LRU cache (max_size=16) for preprocessor results.
Startup time: 3.3s (import torch: 0.9s, import gradio: 0.7s, import ldm: 0.3s, other imports: 0.5s, load scripts: 0.4s, create ui: 0.3s).
Creating model from config: /home/workspace/difusion_models/stable-diffusion-webui/configs/v1-inpainting-inference.yaml
LatentInpaintDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.54 M params.
Applying attention optimization: Doggettx... done.
Textual inversion embeddings loaded(0): 
Model loaded in 4.4s (load weights from disk: 3.1s, create model: 0.3s, apply weights to model: 0.5s, apply half(): 0.3s, move model to device: 0.2s).
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16/16 [00:03<00:00,  5.12it/s]
Total progress: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16/16 [00:02<00:00,  6.15it/s]
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16/16 [00:02<00:00,  6.32it/s]
Total progress: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16/16 [00:02<00:00,  6.25it/s]
Total progress: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16/16 [00:02<00:00,  6.33it/s]
```


### Additional information

_No response_