runtime error
Space failed. Exit code: 1. Reason: <00:00, 99.3MB/s] Downloading (…)neration_config.json: 0%| | 0.00/137 [00:00<?, ?B/s] Downloading (…)neration_config.json: 100%|██████████| 137/137 [00:00<00:00, 963kB/s] Downloading adapter_model.bin: 0%| | 0.00/10.7M [00:00<?, ?B/s] Downloading adapter_model.bin: 100%|██████████| 10.7M/10.7M [00:00<00:00, 190MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 11, in <module> model = AutoPeftModelForCausalLM.from_pretrained(model_id, device_map='auto', torch_dtype=torch.float16) File "/home/user/.local/lib/python3.10/site-packages/peft/auto.py", line 103, in from_pretrained return cls._target_peft_class.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/peft/peft_model.py", line 271, in from_pretrained model.load_adapter(model_id, adapter_name, is_trainable=is_trainable, **kwargs) File "/home/user/.local/lib/python3.10/site-packages/peft/peft_model.py", line 591, in load_adapter dispatch_model( File "/home/user/.local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 343, in dispatch_model raise ValueError( ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: base_model.model.model.layers.6, base_model.model.model.layers.7, base_model.model.model.layers.8, base_model.model.model.layers.9, base_model.model.model.layers.10, base_model.model.model.layers.11, base_model.model.model.layers.12, base_model.model.model.layers.13, base_model.model.model.layers.14, base_model.model.model.layers.15, base_model.model.model.layers.16, base_model.model.model.layers.17, base_model.model.model.layers.18, base_model.model.model.layers.19, base_model.model.model.layers.20, base_model.model.model.layers.21, base_model.model.model.layers.22, base_model.model.model.layers.23, base_model.model.model.layers.24, base_model.model.model.layers.25, base_model.model.model.norm, base_model.model.lm_head.
Container logs:
Fetching error logs...