runtime error

Exit code: 1. Reason: ██| 7.85M/7.85M [00:00<00:00, 26.8MB/s] config.json: 0%| | 0.00/1.66k [00:00<?, ?B/s] config.json: 100%|██████████| 1.66k/1.66k [00:00<00:00, 13.1MB/s] configuration_deepseek.py: 0%| | 0.00/9.90k [00:00<?, ?B/s] configuration_deepseek.py: 100%|██████████| 9.90k/9.90k [00:00<00:00, 55.6MB/s] A new version of the following files was downloaded from https://huggingface.co/deepseek-ai/DeepSeek-V3-0324: - configuration_deepseek.py . Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision. modeling_deepseek.py: 0%| | 0.00/75.7k [00:00<?, ?B/s] modeling_deepseek.py: 100%|██████████| 75.7k/75.7k [00:00<00:00, 15.5MB/s] A new version of the following files was downloaded from https://huggingface.co/deepseek-ai/DeepSeek-V3-0324: - modeling_deepseek.py . Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision. Traceback (most recent call last): File "/home/user/app/app.py", line 11, in <module> model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True, torch_dtype=torch.float16, device_map="auto") File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 279, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4228, in from_pretrained hf_quantizer.validate_environment( File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/quantizer_finegrained_fp8.py", line 51, in validate_environment raise RuntimeError("No GPU found. A GPU is needed for FP8 quantization.") RuntimeError: No GPU found. A GPU is needed for FP8 quantization.

Container logs: