runtime error
Exit code: 1. Reason: �████████| 7.85M/7.85M [00:00<00:00, 123MB/s] config.json: 0%| | 0.00/1.66k [00:00<?, ?B/s][A config.json: 100%|██████████| 1.66k/1.66k [00:00<00:00, 11.3MB/s] configuration_deepseek.py: 0%| | 0.00/9.90k [00:00<?, ?B/s][A configuration_deepseek.py: 100%|██████████| 9.90k/9.90k [00:00<00:00, 57.0MB/s] A new version of the following files was downloaded from https://huggingface.co/deepseek-ai/DeepSeek-V3-0324: - configuration_deepseek.py . Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision. modeling_deepseek.py: 0%| | 0.00/75.7k [00:00<?, ?B/s][A modeling_deepseek.py: 100%|██████████| 75.7k/75.7k [00:00<00:00, 211MB/s] A new version of the following files was downloaded from https://huggingface.co/deepseek-ai/DeepSeek-V3-0324: - modeling_deepseek.py . Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision. Traceback (most recent call last): File "/home/user/app/app.py", line 8, in <module> model = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True) File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 593, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 317, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4887, in from_pretrained hf_quantizer.validate_environment( File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/quantizer_finegrained_fp8.py", line 48, in validate_environment raise RuntimeError("No GPU or XPU found. A GPU or XPU is needed for FP8 quantization.") RuntimeError: No GPU or XPU found. A GPU or XPU is needed for FP8 quantization.
Container logs:
Fetching error logs...