Hugging Face's logo

Spaces:
TEN-framework
/
ten-agent-demo
Running on L4

App Files Community
1
wangyoucao577 commited on
Commit
6b752ad
·
1 Parent(s): 0409508

fix: vllm

Browse files
Files changed (1) hide show
  1. entrypoint.sh +1 -1
entrypoint.sh CHANGED
@@ -10,4 +10,4 @@ LOCAL_MODEL_PATH=./data/${HF_MODEL_NAME}
10
  HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download ${HF_MODEL_PATH} --local-dir ${LOCAL_MODEL_PATH}
11
 
12
  # start vllm server
13
- ${HOME}/.local/bin/vllm serve ${LOCAL_MODEL_PATH} --served-model-name ${HF_MODEL_NAME}
 
10
  HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download ${HF_MODEL_PATH} --local-dir ${LOCAL_MODEL_PATH}
11
 
12
  # start vllm server
13
+ vllm serve ${LOCAL_MODEL_PATH} --served-model-name ${HF_MODEL_NAME}