Spaces:

chansung
/

llm-discord-bot

Runtime error

chansung commited on Jul 6, 2023

Commit

75ddc5f

1 Parent(s): 2bbbcd1

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -15,7 +15,7 @@ RUN chmod +x ./entry_script.sh
 ENV HF_HOME=./
 ENV LLMCHAT_APP_MODE=DISCORD
 ENV DISCORD_BOT_MAX_WORKERS=1
-ENV DISCORD_BOT_LOAD_MODE=CPU
 # Full list of supported models can be found
 # at https://github.com/deep-diver/LLM-As-Chatbot/blob/main/model_cards.json

 ENV HF_HOME=./
 ENV LLMCHAT_APP_MODE=DISCORD
 ENV DISCORD_BOT_MAX_WORKERS=1
+ENV DISCORD_BOT_LOAD_MODE=8BIT
 # Full list of supported models can be found
 # at https://github.com/deep-diver/LLM-As-Chatbot/blob/main/model_cards.json