Spaces:

jdelavande
/

chat-ui-energy

Running on CPU Upgrade

nsarrazin commited on Aug 14, 2024

Commit

89d4aed

unverified ·

1 Parent(s): 256117c

fix(models): correct context window for 405B

Files changed (1) hide show

chart/env/prod.yaml CHANGED Viewed

@@ -83,7 +83,7 @@ envVars:
           "top_p": 0.9,
           "stop": ["<|endoftext|>", "<|eot_id|>"],
           "max_new_tokens": 2048,
-          "truncate": 14337
         },
         "promptExamples": [
           {

           "top_p": 0.9,
           "stop": ["<|endoftext|>", "<|eot_id|>"],
           "max_new_tokens": 2048,
+          "truncate": 14335
         },
         "promptExamples": [
           {