runtime error

Exit code: 3. Reason: _.py:239] No platform detected, vLLM is running on UnspecifiedPlatform INFO: Started server process [1] INFO: Waiting for application startup. ERROR: Traceback (most recent call last): File "/usr/local/lib/python3.12/dist-packages/starlette/routing.py", line 694, in lifespan async with self.lifespan_context(app) as maybe_state: ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 210, in __aenter__ return await anext(self.gen) ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/dist-packages/gradio/routes.py", line 1290, in new_lifespan async with old_lifespan( ^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 210, in __aenter__ return await anext(self.gen) ^^^^^^^^^^^^^^^^^^^^^ File "/app/app.py", line 26, in lifespan engine = AsyncLLMEngine.from_engine_args(engine_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/dist-packages/vllm/engine/async_llm_engine.py", line 646, in from_engine_args vllm_config = engine_args.create_engine_config(usage_context) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/dist-packages/vllm/engine/arg_utils.py", line 1002, in create_engine_config device_config = DeviceConfig( ^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/dist-packages/pydantic/_internal/_dataclasses.py", line 123, in __init__ s.__pydantic_validator__.validate_python(ArgsKwargs(args, kwargs), self_instance=s) File "/usr/local/lib/python3.12/dist-packages/vllm/config.py", line 2591, in __post_init__ self.device = torch.device(self.device_type) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ RuntimeError: Device string must not be empty ERROR: Application startup failed. Exiting. Lifespan startup: Loading model meta-llama/Llama-3.1-8B-Instruct... IMPORTANT: You are using gradio version 4.31.0, however version 4.44.1 is available, please upgrade. --------

Container logs: