nsarrazin HF Staff commited on
Commit
2353ab2
·
unverified ·
1 Parent(s): 5283de6

Reduce context window on zephyr orpo (#1272)

Browse files

* Reduce context window on zephyr orpo

* fix

Files changed (1) hide show
  1. chart/env/prod.yaml +2 -2
chart/env/prod.yaml CHANGED
@@ -99,8 +99,8 @@ envVars:
99
  "websiteUrl": "https://huggingface.co/HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1",
100
  "logoUrl": "https://huggingface.co/datasets/huggingchat/models-logo/resolve/main/zephyr-logo.png",
101
  "parameters": {
102
- "truncate" : 24576,
103
- "max_new_tokens" : 8192,
104
  "temperature": 0.6
105
  },
106
  "preprompt" : "You are Zephyr, an assistant developed by KAIST AI, Argilla, and Hugging Face. You should give concise responses to very simple questions, but provide thorough responses to more complex and open-ended questions. You are happy to help with writing, analysis, question answering, math, coding, and all sorts of other tasks.",
 
99
  "websiteUrl": "https://huggingface.co/HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1",
100
  "logoUrl": "https://huggingface.co/datasets/huggingchat/models-logo/resolve/main/zephyr-logo.png",
101
  "parameters": {
102
+ "truncate" : 6146,
103
+ "max_new_tokens" : 2044,
104
  "temperature": 0.6
105
  },
106
  "preprompt" : "You are Zephyr, an assistant developed by KAIST AI, Argilla, and Hugging Face. You should give concise responses to very simple questions, but provide thorough responses to more complex and open-ended questions. You are happy to help with writing, analysis, question answering, math, coding, and all sorts of other tasks.",