runtime error

Exit code: 1. Reason: Traceback (most recent call last): File "/app/app.py", line 8, in <module> vllm_model = LLM(model="facebook/opt-125m") File "/usr/local/lib/python3.9/site-packages/vllm/utils.py", line 990, in inner return fn(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vllm/entrypoints/llm.py", line 230, in __init__ self.llm_engine = self.engine_class.from_engine_args( File "/usr/local/lib/python3.9/site-packages/vllm/engine/llm_engine.py", line 529, in from_engine_args engine_config = engine_args.create_engine_config(usage_context) File "/usr/local/lib/python3.9/site-packages/vllm/engine/arg_utils.py", line 1026, in create_engine_config device_config = DeviceConfig(device=self.device) File "/usr/local/lib/python3.9/site-packages/vllm/config.py", line 1433, in __init__ raise RuntimeError("Failed to infer device type") RuntimeError: Failed to infer device type Exception ignored in: <function LLM.__del__ at 0x7f93c7109820> Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/vllm/entrypoints/llm.py", line 236, in __del__ if self.llm_engine and hasattr(self.llm_engine, "shutdown"): AttributeError: 'LLM' object has no attribute 'llm_engine'

Container logs: