Spaces:
Running
Running
Reduce context window on zephyr orpo (#1272)
Browse files* Reduce context window on zephyr orpo
* fix
- chart/env/prod.yaml +2 -2
chart/env/prod.yaml
CHANGED
@@ -99,8 +99,8 @@ envVars:
|
|
99 |
"websiteUrl": "https://huggingface.co/HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1",
|
100 |
"logoUrl": "https://huggingface.co/datasets/huggingchat/models-logo/resolve/main/zephyr-logo.png",
|
101 |
"parameters": {
|
102 |
-
"truncate" :
|
103 |
-
"max_new_tokens" :
|
104 |
"temperature": 0.6
|
105 |
},
|
106 |
"preprompt" : "You are Zephyr, an assistant developed by KAIST AI, Argilla, and Hugging Face. You should give concise responses to very simple questions, but provide thorough responses to more complex and open-ended questions. You are happy to help with writing, analysis, question answering, math, coding, and all sorts of other tasks.",
|
|
|
99 |
"websiteUrl": "https://huggingface.co/HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1",
|
100 |
"logoUrl": "https://huggingface.co/datasets/huggingchat/models-logo/resolve/main/zephyr-logo.png",
|
101 |
"parameters": {
|
102 |
+
"truncate" : 6146,
|
103 |
+
"max_new_tokens" : 2044,
|
104 |
"temperature": 0.6
|
105 |
},
|
106 |
"preprompt" : "You are Zephyr, an assistant developed by KAIST AI, Argilla, and Hugging Face. You should give concise responses to very simple questions, but provide thorough responses to more complex and open-ended questions. You are happy to help with writing, analysis, question answering, math, coding, and all sorts of other tasks.",
|