Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
alozowski
commited on
Commit
Β·
8013f91
1
Parent(s):
c8c4792
update and revised submission info
Browse files- src/display/about.py +26 -14
src/display/about.py
CHANGED
|
@@ -179,35 +179,47 @@ EVALUATION_QUEUE_TEXT = f"""
|
|
| 179 |
|
| 180 |
Models added here will be automatically evaluated on the π€ cluster.
|
| 181 |
|
| 182 |
-
|
| 183 |
|
| 184 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 185 |
|
| 186 |
-
### 1) Make sure you can load your model and tokenizer using AutoClasses:
|
| 187 |
```python
|
| 188 |
from transformers import AutoConfig, AutoModel, AutoTokenizer
|
| 189 |
config = AutoConfig.from_pretrained("your model name", revision=revision)
|
| 190 |
model = AutoModel.from_pretrained("your model name", revision=revision)
|
| 191 |
tokenizer = AutoTokenizer.from_pretrained("your model name", revision=revision)
|
| 192 |
```
|
| 193 |
-
|
|
|
|
|
|
|
|
|
|
| 194 |
|
| 195 |
-
|
| 196 |
-
|
| 197 |
|
| 198 |
-
###
|
| 199 |
-
It's a new format for storing weights which is safer and faster to load and use. It will also allow us to add the number of parameters of your model to the `Extended Viewer`!
|
| 200 |
-
|
| 201 |
-
### 3) Make sure your model has an open license!
|
| 202 |
This is a leaderboard for Open LLMs, and we'd love for as many people as possible to know they can use your model π€
|
| 203 |
|
| 204 |
-
### 4
|
| 205 |
When we add extra information about models to the leaderboard, it will be automatically taken from the model card
|
| 206 |
|
| 207 |
-
### 5
|
| 208 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 209 |
|
| 210 |
-
<b>Note:</b> Please be advised that when submitting, git <b>branches</b> and <b>tags</b> will be strictly tied to the <b>specific commit</b> present at the time of submission. This ensures revision consistency.
|
| 211 |
## Model types
|
| 212 |
{icons}
|
| 213 |
"""
|
|
|
|
| 179 |
|
| 180 |
Models added here will be automatically evaluated on the π€ cluster.
|
| 181 |
|
| 182 |
+
> **Important:** Don't forget to read the [FAQ](https://huggingface.co/docs/leaderboards/open_llm_leaderboard/faq) and [documentation](https://huggingface.co/docs/leaderboards/open_llm_leaderboard/about) for more information! π
|
| 183 |
|
| 184 |
+
## Submission Disclaimer
|
| 185 |
+
**By submitting a model, you acknowledge that:**
|
| 186 |
+
- We store information about who submitted each model in [Requests dataset](https://huggingface.co/datasets/open-llm-leaderboard/requests).
|
| 187 |
+
- This practice helps maintain the integrity of our leaderboard, prevent spam, and ensure responsible submissions.
|
| 188 |
+
- Your submission will be visible to the community and you may be contacted regarding your model.
|
| 189 |
+
- Please submit carefully and responsibly π
|
| 190 |
+
|
| 191 |
+
## First Steps Before Submitting a Model
|
| 192 |
+
|
| 193 |
+
### 1. Ensure Your Model Loads with AutoClasses
|
| 194 |
+
Verify that you can load your model and tokenizer using AutoClasses:
|
| 195 |
|
|
|
|
| 196 |
```python
|
| 197 |
from transformers import AutoConfig, AutoModel, AutoTokenizer
|
| 198 |
config = AutoConfig.from_pretrained("your model name", revision=revision)
|
| 199 |
model = AutoModel.from_pretrained("your model name", revision=revision)
|
| 200 |
tokenizer = AutoTokenizer.from_pretrained("your model name", revision=revision)
|
| 201 |
```
|
| 202 |
+
Note:
|
| 203 |
+
- If this step fails, debug your model before submitting.
|
| 204 |
+
- Ensure your model is public.
|
| 205 |
+
- We are working on adding support for models requiring `use_remote_code=True`.
|
| 206 |
|
| 207 |
+
### 2. Convert Weights to Safetensors
|
| 208 |
+
[Safetensors](https://huggingface.co/docs/safetensors/index) is a new format for storing weights which is safer and faster to load and use. It will also allow us to add the number of parameters of your model to the `Extended Viewer`!
|
| 209 |
|
| 210 |
+
### 3. Verify Your Model Open License
|
|
|
|
|
|
|
|
|
|
| 211 |
This is a leaderboard for Open LLMs, and we'd love for as many people as possible to know they can use your model π€
|
| 212 |
|
| 213 |
+
### 4. Complete Your Model Card
|
| 214 |
When we add extra information about models to the leaderboard, it will be automatically taken from the model card
|
| 215 |
|
| 216 |
+
### 5. Select Correct Precision
|
| 217 |
+
Choose the right precision to avoid evaluation errors:
|
| 218 |
+
- Not all models convert properly from float16 to bfloat16.
|
| 219 |
+
- Incorrect precision can cause issues (e.g., loading a bf16 model in fp16 may generate NaNs).
|
| 220 |
+
|
| 221 |
+
> **Important:** When submitting, git branches and tags will be strictly tied to the specific commit present at the time of submission to ensure revision consistency.
|
| 222 |
|
|
|
|
| 223 |
## Model types
|
| 224 |
{icons}
|
| 225 |
"""
|