what went wrong??

H:\Hot\Pookie\Poo\poo\api\yue.git\app\inference>conda_hook && conda deactivate && conda deactivate && conda deactivate && conda activate base && H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Scripts\activate H:\Hot\Pookie\Poo\poo\api\yue.git\app\env && python gradio_server.py --profile 4 --compile --icl 

You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:00<00:00,  5.48it/s]
H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\nn\utils\weight_norm.py:143: FutureWarning: `torch.nn.utils.weight_norm` is deprecated in favor of `torch.nn.utils.parametrizations.weight_norm`.
  WeightNorm.apply(module, name, dim)
H:\Hot\Pookie\Poo\poo\api\yue.git\app\inference\gradio_server.py:135: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
  parameter_dict = torch.load(args.resume_path, map_location='cpu')
************ Memory Management for the GPU Poor (mmgp 3.1.4-15) by DeepBeepMeep ************
You have chosen a profile that requires at least 32 GB of RAM and 12 GB of VRAM. Some RAM is consumed to reduce VRAM consumption. 
Quantization of model 'transformer' started to format 'quanto.qint8'
Quantization of model 'transformer' done
Pytorch compilation of 'transformer' is scheduled for these modules : ['model.layers.*'].
Pinning data of 'transformer' to reserved RAM
The whole model was pinned to reserved RAM: 26 large blocks spread across 6266.83 MB
Hooked to model 'transformer' (LlamaForCausalLM)
Pytorch compilation of 'stage2' is scheduled for these modules : ['model.layers.*'].
Hooked to model 'stage2' (LlamaForCausalLM)
* Running on local URL:  http://localhost:42003

To create a public link, set `share=True` in `launch()`.

  0%|                                                                                                                                                                                                          | 0/2 [00:00<?, ?it/s]The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\transformers\generation\utils.py:2139: UserWarning: You are calling .generate() with the `input_ids` being on a device type different than your model's device. `input_ids` is on cuda, whereas the model is on cpu. You may experience unexpected behaviors or slower generation. Please make sure that you have put `input_ids` to the correct device by calling for example input_ids = input_ids.to('cpu') before running `.generate()`.
  warnings.warn(

cuda_utils.c
LINK : fatal error LNK1104: cannot open file 'python310.lib'
cuda_utils.c
LINK : fatal error LNK1104: cannot open file 'python310.lib'
 50%|█████████████████████████████████████████████████████████████████████████████████████████████████                                                                                                 | 1/2 [00:32<00:32, 32.16s/it]
Traceback (most recent call last):
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\output_graph.py", line 1446, in _call_user_compiler
    compiled_fn = compiler_fn(gm, self.example_inputs())
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\repro\after_dynamo.py", line 129, in __call__
    compiled_gm = compiler_fn(gm, example_inputs)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\__init__.py", line 2234, in __call__
    return compile_fx(model_, inputs_, config_patches=self.config)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\compile_fx.py", line 1521, in compile_fx
    return aot_autograd(
           ^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\backends\common.py", line 72, in __call__
    cg = aot_module_simplified(gm, example_inputs, **self.kwargs)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_functorch\aot_autograd.py", line 1071, in aot_module_simplified
    compiled_fn = dispatch_and_compile()
                  ^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_functorch\aot_autograd.py", line 1056, in dispatch_and_compile
    compiled_fn, _ = create_aot_dispatcher_function(
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_functorch\aot_autograd.py", line 522, in create_aot_dispatcher_function
    return _create_aot_dispatcher_function(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_functorch\aot_autograd.py", line 759, in _create_aot_dispatcher_function
    compiled_fn, fw_metadata = compiler_fn(
                               ^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_functorch\_aot_autograd\jit_compile_runtime_wrappers.py", line 179, in aot_dispatch_base
    compiled_fw = compiler(fw_module, updated_flat_args)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\compile_fx.py", line 1350, in fw_compiler_base
    return _fw_compiler_base(model, example_inputs, is_inference)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\compile_fx.py", line 1421, in _fw_compiler_base
    return inner_compile(
           ^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\compile_fx.py", line 475, in compile_fx_inner
    return wrap_compiler_debug(_compile_fx_inner, compiler_name="inductor")(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\repro\after_aot.py", line 85, in debug_wrapper
    inner_compiled_fn = compiler_fn(gm, example_inputs)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\compile_fx.py", line 661, in _compile_fx_inner
    compiled_graph = FxGraphCache.load(
                     ^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\codecache.py", line 1334, in load
    compiled_graph = compile_fx_fn(
                     ^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\compile_fx.py", line 570, in codegen_and_compile
    compiled_graph = fx_codegen_and_compile(gm, example_inputs, **fx_kwargs)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\compile_fx.py", line 878, in fx_codegen_and_compile
    compiled_fn = graph.compile_to_fn()
                  ^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\graph.py", line 1913, in compile_to_fn
    return self.compile_to_module().call
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\graph.py", line 1839, in compile_to_module
    return self._compile_to_module()
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\graph.py", line 1845, in _compile_to_module
    self.codegen_with_cpp_wrapper() if self.cpp_wrapper else self.codegen()
                                                             ^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\graph.py", line 1784, in codegen
    self.scheduler.codegen()
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\scheduler.py", line 3383, in codegen
    return self._codegen()
           ^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\scheduler.py", line 3461, in _codegen
    self.get_backend(device).codegen_node(node)
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\codegen\cuda_combined_scheduling.py", line 80, in codegen_node
    return self._triton_scheduling.codegen_node(node)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\codegen\simd.py", line 1155, in codegen_node
    return self.codegen_node_schedule(node_schedule, buf_accesses, numel, rnumel)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\codegen\simd.py", line 1364, in codegen_node_schedule
    src_code = kernel.codegen_kernel()
               ^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\codegen\triton.py", line 2661, in codegen_kernel
    **self.inductor_meta_common(),
      ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_inductor\codegen\triton.py", line 2532, in inductor_meta_common
    "backend_hash": torch.utils._triton.triton_hash_with_backend(),
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\utils\_triton.py", line 53, in triton_hash_with_backend
    backend = triton_backend()
              ^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\utils\_triton.py", line 45, in triton_backend
    target = driver.active.get_current_target()
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\triton\runtime\driver.py", line 23, in __getattr__
    self._initialize_obj()
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\triton\runtime\driver.py", line 20, in _initialize_obj
    self._obj = self._init_fn()
                ^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\triton\runtime\driver.py", line 9, in _create_driver
    return actives[0]()
           ^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\triton\backends\nvidia\driver.py", line 414, in __init__
    self.utils = CudaUtils()  # TODO: make static
                 ^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\triton\backends\nvidia\driver.py", line 92, in __init__
    mod = compile_module_from_src(Path(os.path.join(dirname, "driver.c")).read_text(), "cuda_utils")
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\triton\backends\nvidia\driver.py", line 69, in compile_module_from_src
    so = _build(name, src_path, tmpdir, library_dirs(), include_dir, libraries)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\triton\runtime\build.py", line 75, in _build
    ret = subprocess.check_call(cc_cmd)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\DjZaN\AppData\Roaming\uv\python\cpython-3.11.11-windows-x86_64-none\Lib\subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.40.33807\\bin\\Hostx64\\x64\\cl.EXE', 'H:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.c', '/nologo', '/O2', '/LD', '/wd4819', '/IH:\\Hot\\Pookie\\Poo\\poo\\api\\yue.git\\app\\env\\Lib\\site-packages\\triton\\backends\\nvidia\\include', '/IH:\\Hot\\Pookie\\Poo\\poo\\bin\\miniconda\\include', '/IH:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv', '/IC:\\Users\\DjZaN\\AppData\\Roaming\\uv\\python\\cpython-3.11.11-windows-x86_64-none\\Include', '/IC:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.40.33807\\include', '/IC:\\Program Files (x86)\\Windows Kits\\10\\Include\\10.0.22621.0\\shared', '/IC:\\Program Files (x86)\\Windows Kits\\10\\Include\\10.0.22621.0\\ucrt', '/IC:\\Program Files (x86)\\Windows Kits\\10\\Include\\10.0.22621.0\\um', '/FoH:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.cp311-win_amd64.obj', '/link', '/LIBPATH:H:\\Hot\\Pookie\\Poo\\poo\\api\\yue.git\\app\\env\\Lib\\site-packages\\triton\\backends\\nvidia\\lib', '/LIBPATH:H:\\Hot\\Pookie\\Poo\\poo\\bin\\miniconda\\lib\\x64', '/LIBPATH:C:\\Users\\DjZaN\\AppData\\Roaming\\uv\\python\\cpython-3.11.11-windows-x86_64-none\\libs', '/LIBPATH:C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.40.33807\\lib\\x64', '/LIBPATH:C:\\Program Files (x86)\\Windows Kits\\10\\Lib\\10.0.22621.0\\ucrt\\x64', '/LIBPATH:C:\\Program Files (x86)\\Windows Kits\\10\\Lib\\10.0.22621.0\\um\\x64', '/LIBPATH:C:\\Users\\DjZaN\\AppData\\Roaming\\uv\\python\\cpython-3.11.11-windows-x86_64-none\\libs', '/LIBPATH:C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.40.33807\\lib\\x64', '/LIBPATH:C:\\Program Files (x86)\\Windows Kits\\10\\Lib\\10.0.22621.0\\ucrt\\x64', '/LIBPATH:C:\\Program Files (x86)\\Windows Kits\\10\\Lib\\10.0.22621.0\\um\\x64', 'cuda.lib', '/OUT:H:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.cp311-win_amd64.pyd', '/IMPLIB:H:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.cp311-win_amd64.lib', '/PDB:H:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.cp311-win_amd64.pdb']' returned non-zero exit status 2.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\gradio\queueing.py", line 625, in process_events
    response = await route_utils.call_process_api(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\gradio\route_utils.py", line 322, in call_process_api
    output = await app.get_blocks().process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\gradio\blocks.py", line 2051, in process_api
    result = await self.call_function(
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\gradio\blocks.py", line 1598, in call_function
    prediction = await anyio.to_thread.run_sync(  # type: ignore
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\anyio\to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 2461, in run_sync_in_worker_thread
    return await future
           ^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 962, in run
    result = context.run(func, *args)
             ^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\gradio\utils.py", line 883, in wrapper
    response = f(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\inference\gradio_server.py", line 280, in generate_song
    output_seq = model.generate(
                 ^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\transformers\generation\utils.py", line 2257, in generate
    result = self._sample(
             ^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\transformers\generation\utils.py", line 3285, in _sample
    outputs = self(**model_inputs, return_dict=True)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\mmgp\offload.py", line 1310, in check_change_module
    return previous_method(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\transformers\models\llama\modeling_llama.py", line 883, in forward
    outputs = self.model(
              ^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\mmgp\offload.py", line 1310, in check_change_module
    return previous_method(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\transformers\models\llama\modeling_llama.py", line 613, in forward
    layer_outputs = decoder_layer(
                    ^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\nn\modules\module.py", line 1844, in _call_impl
    return inner()
           ^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\nn\modules\module.py", line 1790, in inner
    result = forward_call(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\eval_frame.py", line 465, in _fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\convert_frame.py", line 1269, in __call__
    return self._torchdynamo_orig_callable(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\convert_frame.py", line 1064, in __call__
    result = self._inner_convert(
             ^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\convert_frame.py", line 526, in __call__
    return _compile(
           ^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\convert_frame.py", line 924, in _compile
    guarded_code = compile_inner(code, one_graph, hooks, transform)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\convert_frame.py", line 666, in compile_inner
    return _compile_inner(code, one_graph, hooks, transform)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_utils_internal.py", line 87, in wrapper_function
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\convert_frame.py", line 699, in _compile_inner
    out_code = transform_code_object(code, transform)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\bytecode_transformation.py", line 1322, in transform_code_object
    transformations(instructions, code_options)
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\convert_frame.py", line 219, in _fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\convert_frame.py", line 634, in transform
    tracer.run()
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 2796, in run
    super().run()
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 983, in run
    while self.step():
          ^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 895, in step
    self.dispatch_table[inst.opcode](self, inst)
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 580, in wrapper
    return handle_graph_break(self, inst, speculation.reason)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\symbolic_convert.py", line 649, in handle_graph_break
    self.output.compile_subgraph(self, reason=reason)
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\output_graph.py", line 1142, in compile_subgraph
    self.compile_and_call_fx_graph(tx, pass2.graph_output_vars(), root)
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\output_graph.py", line 1369, in compile_and_call_fx_graph
    compiled_fn = self.call_user_compiler(gm)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\output_graph.py", line 1416, in call_user_compiler
    return self._call_user_compiler(gm)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "H:\Hot\Pookie\Poo\poo\api\yue.git\app\env\Lib\site-packages\torch\_dynamo\output_graph.py", line 1465, in _call_user_compiler
    raise BackendCompilerFailed(self.compiler_fn, e) from e
torch._dynamo.exc.BackendCompilerFailed: backend='inductor' raised:
CalledProcessError: Command '['C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.40.33807\\bin\\Hostx64\\x64\\cl.EXE', 'H:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.c', '/nologo', '/O2', '/LD', '/wd4819', '/IH:\\Hot\\Pookie\\Poo\\poo\\api\\yue.git\\app\\env\\Lib\\site-packages\\triton\\backends\\nvidia\\include', '/IH:\\Hot\\Pookie\\Poo\\poo\\bin\\miniconda\\include', '/IH:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv', '/IC:\\Users\\DjZaN\\AppData\\Roaming\\uv\\python\\cpython-3.11.11-windows-x86_64-none\\Include', '/IC:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.40.33807\\include', '/IC:\\Program Files (x86)\\Windows Kits\\10\\Include\\10.0.22621.0\\shared', '/IC:\\Program Files (x86)\\Windows Kits\\10\\Include\\10.0.22621.0\\ucrt', '/IC:\\Program Files (x86)\\Windows Kits\\10\\Include\\10.0.22621.0\\um', '/FoH:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.cp311-win_amd64.obj', '/link', '/LIBPATH:H:\\Hot\\Pookie\\Poo\\poo\\api\\yue.git\\app\\env\\Lib\\site-packages\\triton\\backends\\nvidia\\lib', '/LIBPATH:H:\\Hot\\Pookie\\Poo\\poo\\bin\\miniconda\\lib\\x64', '/LIBPATH:C:\\Users\\DjZaN\\AppData\\Roaming\\uv\\python\\cpython-3.11.11-windows-x86_64-none\\libs', '/LIBPATH:C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.40.33807\\lib\\x64', '/LIBPATH:C:\\Program Files (x86)\\Windows Kits\\10\\Lib\\10.0.22621.0\\ucrt\\x64', '/LIBPATH:C:\\Program Files (x86)\\Windows Kits\\10\\Lib\\10.0.22621.0\\um\\x64', '/LIBPATH:C:\\Users\\DjZaN\\AppData\\Roaming\\uv\\python\\cpython-3.11.11-windows-x86_64-none\\libs', '/LIBPATH:C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.40.33807\\lib\\x64', '/LIBPATH:C:\\Program Files (x86)\\Windows Kits\\10\\Lib\\10.0.22621.0\\ucrt\\x64', '/LIBPATH:C:\\Program Files (x86)\\Windows Kits\\10\\Lib\\10.0.22621.0\\um\\x64', 'cuda.lib', '/OUT:H:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.cp311-win_amd64.pyd', '/IMPLIB:H:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.cp311-win_amd64.lib', '/PDB:H:\\Hot\\Pookie\\Poo\\poo\\cache\\TMPDIR\\tmp10sjxzbv\\cuda_utils.cp311-win_amd64.pdb']' returned non-zero exit status 2.

Set TORCH_LOGS="+dynamo" and TORCHDYNAMO_VERBOSE=1 for more information


You can suppress this exception and fall back to eager by setting:
    import torch._dynamo
    torch._dynamo.config.suppress_errors = True