Hugging Face's logo

Spaces:
muryshev
/
llama-cpp-server-13b
Sleeping

App Files Community
muryshev commited on
Commit
0887fea
·
1 Parent(s): f1abe43

Update Dockerfile

Browse files
Files changed (1) hide show
  1. Dockerfile +1 -1
Dockerfile CHANGED
@@ -38,4 +38,4 @@ COPY --from=build /data/model.gguf /data/model.gguf
38
  WORKDIR /app
39
  EXPOSE 7860
40
 
41
- CMD ./server -m /data/model.gguf -c 4096 --port 7860 --host 0.0.0.0
 
38
  WORKDIR /app
39
  EXPOSE 7860
40
 
41
+ CMD ./server -m /data/model.gguf -c 4096 -ngl 35 --port 7860 --host 0.0.0.0