Spaces:

chansung
/

LLM-As-Chatbot

Runtime error

chansung commited on Mar 28, 2023

Commit

2e483f3

1 Parent(s): c1c3fd7

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -29,7 +29,7 @@ def chat_stream(
     instruction_prompt = generate_prompt(instruction, state_chatbot, context)
     bot_response = model(
         instruction_prompt,
-        max_tokens=256,
         temperature=1,
         top_p=0.9
     )

     instruction_prompt = generate_prompt(instruction, state_chatbot, context)
     bot_response = model(
         instruction_prompt,
+        max_tokens=128,
         temperature=1,
         top_p=0.9
     )