runtime error
Exit code: 1. Reason: | 82.4M/1.69G [00:06<01:54, 14.1MB/s][A model-00004-of-00004.safetensors: 9%|▉ | 150M/1.69G [00:08<01:07, 22.8MB/s] [A model-00004-of-00004.safetensors: 21%|██ | 351M/1.69G [00:11<00:32, 41.8MB/s][A model-00004-of-00004.safetensors: 33%|███▎ | 552M/1.69G [00:12<00:16, 68.6MB/s][A model-00004-of-00004.safetensors: 48%|████▊ | 820M/1.69G [00:13<00:08, 104MB/s] [A model-00004-of-00004.safetensors: 72%|███████▏ | 1.22G/1.69G [00:14<00:02, 164MB/s][A model-00004-of-00004.safetensors: 88%|████████▊ | 1.49G/1.69G [00:15<00:01, 182MB/s][A model-00004-of-00004.safetensors: 100%|██████████| 1.69G/1.69G [00:16<00:00, 103MB/s] Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s][A Loading checkpoint shards: 100%|██████████| 4/4 [00:00<00:00, 78.17it/s] generation_config.json: 0%| | 0.00/244 [00:00<?, ?B/s][A generation_config.json: 100%|██████████| 244/244 [00:00<00:00, 1.44MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 211, in <module> processor = ImageProcessor(args) File "/home/user/app/app.py", line 27, in __init__ self.model, self.vis_processor = self.load_model_and_processor() File "/home/user/app/app.py", line 41, in load_model_and_processor model = Qwen2_5_VLForConditionalGeneration.from_pretrained(checkpoint, torch_dtype="auto", device_map="auto") File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 279, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4475, in from_pretrained dispatch_model(model, **device_map_kwargs) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 496, in dispatch_model raise ValueError( ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.
Container logs:
Fetching error logs...