Spaces:

yzhuang
/

MixtureOfInputs

Sleeping

yzhuang commited on May 22

Commit

e56723e

verified ·

1 Parent(s): bfbfc37

Update server.py

Files changed (1) hide show

server.py CHANGED Viewed

@@ -25,6 +25,8 @@ def launch_vllm_server(beta=1.0):
         "--max-num-seqs", "36",
         "--host", "0.0.0.0",
         "--port", "8000",
         "--api-key", "EMPTY"
     ]
     _server_process = subprocess.Popen(cmd, env=env)

         "--max-num-seqs", "36",
         "--host", "0.0.0.0",
         "--port", "8000",
+        "--enable-reasoning",
+        "--reasoning-parser", "deepseek_r1",
         "--api-key", "EMPTY"
     ]
     _server_process = subprocess.Popen(cmd, env=env)