Spaces:

Syzygianinfern0
/

NeuS-V

Sleeping

Syzygianinfern0 commited on Apr 6

Commit

a9665f3

1 Parent(s): 5822c0a

Tricks for lower GPU utilization

Files changed (1) hide show

vllm_serve.sh CHANGED Viewed

@@ -9,4 +9,6 @@ PORT=8000
 vllm serve $MODEL \
     --port $PORT \
     --trust-remote-code \
-    --limit-mm-per-prompt image=4

 vllm serve $MODEL \
     --port $PORT \
     --trust-remote-code \
+    --limit-mm-per-prompt image=4 \
+    --enforce-eager \
+    --max-model-len 32768