Update Space (evaluate main: 05209ece)
Browse files
README.md
CHANGED
|
@@ -10,6 +10,11 @@ pinned: false
|
|
| 10 |
tags:
|
| 11 |
- evaluate
|
| 12 |
- measurement
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
# Measurement Card for Perplexity
|
|
|
|
| 10 |
tags:
|
| 11 |
- evaluate
|
| 12 |
- measurement
|
| 13 |
+
description: >-
|
| 14 |
+
Perplexity (PPL) can be used for evaluating to what extent a dataset is similar to the distribution of text that a given model was trained on.
|
| 15 |
+
It is defined as the exponentiated average negative log-likelihood of a sequence.
|
| 16 |
+
|
| 17 |
+
For more information, see https://huggingface.co/docs/transformers/perplexity
|
| 18 |
---
|
| 19 |
|
| 20 |
# Measurement Card for Perplexity
|