runtime error

Exit code: 1. Reason: Traceback (most recent call last): File "/home/user/app/app.py", line 20, in <module> "meta-llama": LLM(model="meta-llama/Meta-Llama-3.1-8B"), File "/usr/local/lib/python3.10/site-packages/vllm/utils.py", line 986, in inner return fn(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/vllm/entrypoints/llm.py", line 230, in __init__ self.llm_engine = self.engine_class.from_engine_args( File "/usr/local/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 514, in from_engine_args engine_config = engine_args.create_engine_config(usage_context) File "/usr/local/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 1043, in create_engine_config device_config = DeviceConfig(device=self.device) File "/usr/local/lib/python3.10/site-packages/vllm/config.py", line 1527, in __init__ raise RuntimeError("Failed to infer device type") RuntimeError: Failed to infer device type

Container logs: