Repository: stable-diffusion-webui
Issue: [Bug]: "line 459, in _conv_forward         return F.conv2d(input, weight, bias, self.stride,     RuntimeError: Input type (torch.FloatTensor) and weight type (torch.cuda.FloatTensor) should be the same or input should be a MKLDNN tensor and weight is a dense tensor
Labels: bug-report

### Is there an existing issue for this?

- [X] I have searched the existing issues and checked the recent builds/commits

### What happened?

Whenever I am using controlnet and animatediff together, I get this error.



### Steps to reproduce the problem

Go to txt2img
enable controlnet
enable animatediff
upload video to animatediff section

### What should have happened?

A GIF should be produced

### Sysinfo

[sysinfo-2023-12-03-16-59.txt](https://github.com/AUTOMATIC1111/stable-diffusion-webui/files/13538432/sysinfo-2023-12-03-16-59.txt)


### What browsers do you use to access the UI ?

_No response_

### Console logs

```Shell
Python 3.10.11 (tags/v3.10.11:7d4cc5a, Apr  5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)]
Version: 1.6.0
Commit hash: <none>
Launching Web UI with arguments: --xformers --api --skip-python-version-check --no-half
2023-12-03 08:52:02,987 - ControlNet - INFO - ControlNet v1.1.419
ControlNet preprocessor location: C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator\downloads
2023-12-03 08:52:03,052 - ControlNet - INFO - ControlNet v1.1.419
Loading weights [3c8530cb22] from C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\models\Stable-diffusion\cyberrealistic_v33.safetensors
2023-12-03 08:52:03,196 - AnimateDiff - INFO - Injecting LCM to UI.
2023-12-03 08:52:03,323 - AnimateDiff - INFO - Hacking i2i-batch.
Creating model from config: C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\configs\v1-inference.yaml
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 6.7s (prepare environment: 1.6s, import torch: 1.9s, import gradio: 0.5s, setup paths: 0.5s, initialize shared: 0.2s, other imports: 0.3s, load scripts: 1.0s, create ui: 0.3s, gradio launch: 0.3s).
Applying attention optimization: xformers... done.
Model loaded in 1.8s (load weights from disk: 0.5s, create model: 0.2s, apply weights to model: 0.9s).
2023-12-03 08:53:22,055 - AnimateDiff - INFO - AnimateDiff process start.
2023-12-03 08:53:22,056 - AnimateDiff - INFO - Loading motion module mm_sd_v15_v2.ckpt from C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-animatediff\model\mm_sd_v15_v2.ckpt
2023-12-03 08:53:23,111 - AnimateDiff - INFO - Guessed mm_sd_v15_v2.ckpt architecture: MotionModuleType.AnimateDiffV2
2023-12-03 08:53:25,386 - AnimateDiff - WARNING - Missing keys <All keys matched successfully>
2023-12-03 08:53:26,227 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet middle block.
2023-12-03 08:53:26,227 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet input blocks.
2023-12-03 08:53:26,227 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet output blocks.
2023-12-03 08:53:26,227 - AnimateDiff - INFO - Setting DDIM alpha.
2023-12-03 08:53:26,263 - AnimateDiff - INFO - Injection finished.
2023-12-03 08:53:26,263 - AnimateDiff - INFO - Hacking loral to support motion lora
2023-12-03 08:53:26,263 - AnimateDiff - INFO - Hacking CFGDenoiser forward function.
2023-12-03 08:53:26,263 - AnimateDiff - INFO - Hacking ControlNet.
2023-12-03 08:53:28,680 - ControlNet - INFO - Loading model: control_v11p_sd15_canny [d14c016b]
2023-12-03 08:53:29,495 - ControlNet - INFO - Loaded state_dict from [C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\models\control_v11p_sd15_canny.pth]
2023-12-03 08:53:29,495 - ControlNet - INFO - controlnet_default_config
2023-12-03 08:53:31,229 - ControlNet - INFO - ControlNet model control_v11p_sd15_canny [d14c016b] loaded.
2023-12-03 08:53:32,835 - ControlNet - INFO - Loading preprocessor: canny
2023-12-03 08:53:32,835 - ControlNet - INFO - preprocessor resolution = 512
100%|##########| 45/45 [00:03<00:00, 11.41it/s]
2023-12-03 08:53:36,927 - ControlNet - INFO - ControlNet Hooked - Time = 8.43305230140686
  0%|          | 0/9 [00:01<?, ?it/s]
*** Error completing request
*** Arguments: ('task(g2cxo92szn512ow)', '(Highest Quality, UHD,8k,masterpiece, Amazing Details),  sexy woman, girl, beautiful, long hair, short shorts, indian', 'nude, naked, deformed, cartoon, lowres, bad anatomy, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low normal jpeg artifacts, signature, watermark, username, blurry, out of focus, ugly, old, deformed, amateur drawing, odd, fat, morphing, black and white, anime, ((simple background)), artifacts, signature, artist name, (((deformed))), [blurry], disfigured, poorly drawn face, mutation, mutated, (extra_limb), (ugly), (poorly hands), messy broken legs decay, cartoon, painting', [], 9, 'DPM++ 2M Karras', 1, 1, 7, 800, 496, False, 0.7, 2, 'Latent', 0, 0, 0, 'Use same checkpoint', 'Use same sampler', '', '', [], <gradio.routes.Request object at 0x0000029EA57DAAA0>, 0, False, '', 0.8, -1, False, -1, 0, 0, 0, <scripts.animatediff_ui.AnimateDiffProcess object at 0x0000029EE1B7AF20>, UiControlNetUnit(enabled=True, module='canny', model='control_v11p_sd15_canny [d14c016b]', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=512, threshold_a=100, threshold_b=200, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', save_detected_map=True), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', save_detected_map=True), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', save_detected_map=True), False, False, 'positive', 'comma', 0, False, False, '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0, False, None, None, False, None, None, False, None, None, False, 50) {}
    Traceback (most recent call last):
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\call_queue.py", line 57, in f
        res = list(func(*args, **kwargs))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\call_queue.py", line 36, in f
        res = func(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\txt2img.py", line 55, in txt2img
        processed = processing.process_images(p)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\processing.py", line 732, in process_images
        res = process_images_inner(p)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-animatediff\scripts\animatediff_cn.py", line 119, in hacked_processing_process_images_hijack
        return getattr(processing, '__controlnet_original_process_images_inner')(p, *args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\processing.py", line 867, in process_images_inner
        samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\hook.py", line 420, in process_sample
        return process.sample_before_CN_hack(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\processing.py", line 1140, in sample
        samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_samplers_kdiffusion.py", line 235, in sample
        samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_samplers_common.py", line 261, in launch_sampling
        return func()
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_samplers_kdiffusion.py", line 235, in <lambda>
        samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\k-diffusion\k_diffusion\sampling.py", line 594, in sample_dpmpp_2m
        denoised = model(x, sigmas[i] * s_in, **extra_args)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-animatediff\scripts\animatediff_infv2v.py", line 269, in mm_cfg_forward
        x_out[a:b] = self.inner_model(x_in[a:b], sigma_in[a:b], cond=make_condition_dict(c_crossattn, image_cond_in[a:b]))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\k-diffusion\k_diffusion\external.py", line 112, in forward
        eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\k-diffusion\k_diffusion\external.py", line 138, in get_eps
        return self.inner_model.apply_model(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_hijack_utils.py", line 17, in <lambda>
        setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_hijack_utils.py", line 28, in __call__
        return self.__orig_func(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 858, in apply_model
        x_recon = self.model(x_noisy, t, **cond)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 1335, in forward
        out = self.diffusion_model(x, t, context=cc)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\hook.py", line 827, in forward_webui
        raise e
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\hook.py", line 824, in forward_webui
        return forward(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\hook.py", line 561, in forward
        control = param.control_model(x=x_in, hint=hint, timesteps=timesteps, context=context, y=y)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\cldm.py", line 31, in forward
        return self.control_model(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\cldm.py", line 300, in forward
        guided_hint = self.input_hint_block(hint, emb, context)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\generative-models\sgm\modules\diffusionmodules\openaimodel.py", line 102, in forward
        x = layer(x)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions-builtin\Lora\networks.py", line 444, in network_Conv2d_forward
        return originals.Conv2d_forward(self, input)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward
        return self._conv_forward(input, self.weight, self.bias)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward
        return F.conv2d(input, weight, bias, self.stride,
    RuntimeError: Input type (torch.FloatTensor) and weight type (torch.cuda.FloatTensor) should be the same or input should be a MKLDNN tensor and weight is a dense tensor

---
2023-12-03 08:54:33,408 - AnimateDiff - INFO - AnimateDiff process start.
2023-12-03 08:54:33,408 - AnimateDiff - INFO - Motion module already injected. Trying to restore.
2023-12-03 08:54:33,408 - AnimateDiff - INFO - Restoring DDIM alpha.
2023-12-03 08:54:33,408 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet input blocks.
2023-12-03 08:54:33,408 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet output blocks.
2023-12-03 08:54:33,408 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet middle block.
2023-12-03 08:54:33,408 - AnimateDiff - INFO - Removal finished.
2023-12-03 08:54:33,416 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet middle block.
2023-12-03 08:54:33,416 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet input blocks.
2023-12-03 08:54:33,416 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet output blocks.
2023-12-03 08:54:33,416 - AnimateDiff - INFO - Setting DDIM alpha.
2023-12-03 08:54:33,424 - AnimateDiff - INFO - Injection finished.
2023-12-03 08:54:33,424 - AnimateDiff - INFO - AnimateDiff LoRA already hacked
2023-12-03 08:54:33,424 - AnimateDiff - INFO - CFGDenoiser already hacked
2023-12-03 08:54:33,424 - AnimateDiff - INFO - Hacking ControlNet.
2023-12-03 08:54:33,424 - AnimateDiff - INFO - BatchHijack already hacked.
2023-12-03 08:54:33,424 - AnimateDiff - INFO - ControlNet Main Entry already hacked.
2023-12-03 08:54:35,683 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_canny [d14c016b]
2023-12-03 08:54:37,228 - ControlNet - INFO - Loading preprocessor: canny
2023-12-03 08:54:37,228 - ControlNet - INFO - preprocessor resolution = 512
100%|##########| 45/45 [00:02<00:00, 15.95it/s]
2023-12-03 08:54:40,122 - ControlNet - INFO - ControlNet Hooked - Time = 4.459296226501465
  0%|          | 0/9 [00:00<?, ?it/s]
*** Error completing request
*** Arguments: ('task(jlnyor56g16wb29)', '(Highest Quality, UHD,8k,masterpiece, Amazing Details),  sexy woman, girl, beautiful, long hair, short shorts, indian', 'nude, naked, deformed, cartoon, lowres, bad anatomy, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low normal jpeg artifacts, signature, watermark, username, blurry, out of focus, ugly, old, deformed, amateur drawing, odd, fat, morphing, black and white, anime, ((simple background)), artifacts, signature, artist name, (((deformed))), [blurry], disfigured, poorly drawn face, mutation, mutated, (extra_limb), (ugly), (poorly hands), messy broken legs decay, cartoon, painting', [], 9, 'DPM++ 2M Karras', 1, 1, 7, 328, 328, False, 0.7, 2, 'Latent', 0, 0, 0, 'Use same checkpoint', 'Use same sampler', '', '', [], <gradio.routes.Request object at 0x0000029EE1BA4340>, 0, False, '', 0.8, -1, False, -1, 0, 0, 0, <scripts.animatediff_ui.AnimateDiffProcess object at 0x0000029EE1B6DBD0>, UiControlNetUnit(enabled=True, module='canny', model='control_v11p_sd15_canny [d14c016b]', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=512, threshold_a=100, threshold_b=200, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', save_detected_map=True), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', save_detected_map=True), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', save_detected_map=True), False, False, 'positive', 'comma', 0, False, False, '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0, False, None, None, False, None, None, False, None, None, False, 50) {}
    Traceback (most recent call last):
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\call_queue.py", line 57, in f
        res = list(func(*args, **kwargs))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\call_queue.py", line 36, in f
        res = func(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\txt2img.py", line 55, in txt2img
        processed = processing.process_images(p)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\processing.py", line 732, in process_images
        res = process_images_inner(p)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-animatediff\scripts\animatediff_cn.py", line 119, in hacked_processing_process_images_hijack
        return getattr(processing, '__controlnet_original_process_images_inner')(p, *args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\processing.py", line 867, in process_images_inner
        samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\hook.py", line 420, in process_sample
        return process.sample_before_CN_hack(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\processing.py", line 1140, in sample
        samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_samplers_kdiffusion.py", line 235, in sample
        samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_samplers_common.py", line 261, in launch_sampling
        return func()
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_samplers_kdiffusion.py", line 235, in <lambda>
        samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\k-diffusion\k_diffusion\sampling.py", line 594, in sample_dpmpp_2m
        denoised = model(x, sigmas[i] * s_in, **extra_args)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-animatediff\scripts\animatediff_infv2v.py", line 269, in mm_cfg_forward
        x_out[a:b] = self.inner_model(x_in[a:b], sigma_in[a:b], cond=make_condition_dict(c_crossattn, image_cond_in[a:b]))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\k-diffusion\k_diffusion\external.py", line 112, in forward
        eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\k-diffusion\k_diffusion\external.py", line 138, in get_eps
        return self.inner_model.apply_model(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_hijack_utils.py", line 17, in <lambda>
        setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\modules\sd_hijack_utils.py", line 28, in __call__
        return self.__orig_func(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 858, in apply_model
        x_recon = self.model(x_noisy, t, **cond)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 1335, in forward
        out = self.diffusion_model(x, t, context=cc)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\hook.py", line 827, in forward_webui
        raise e
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\hook.py", line 824, in forward_webui
        return forward(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\hook.py", line 561, in forward
        control = param.control_model(x=x_in, hint=hint, timesteps=timesteps, context=context, y=y)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\cldm.py", line 31, in forward
        return self.control_model(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\cldm.py", line 300, in forward
        guided_hint = self.input_hint_block(hint, emb, context)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\repositories\generative-models\sgm\modules\diffusionmodules\openaimodel.py", line 102, in forward
        x = layer(x)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\extensions-builtin\Lora\networks.py", line 444, in network_Conv2d_forward
        return originals.Conv2d_forward(self, input)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward
        return self._conv_forward(input, self.weight, self.bias)
      File "C:\Users\micha\Downloads\StabilityMatrix-win-x64\StabilityMatrix-win-x64\Data\Packages\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward
        return F.conv2d(input, weight, bias, self.stride,
    RuntimeError: Input type (torch.FloatTensor) and weight type (torch.cuda.FloatTensor) should be the same or input should be a MKLDNN tensor and weight is a dense tensor

---
```


### Additional information

_No response_