update
Browse files- evaluation/intro.txt +1 -1
evaluation/intro.txt
CHANGED
|
@@ -16,7 +16,7 @@ In most papers, 200 candidate program completions are sampled, and pass@1, pass@
|
|
| 16 |
|GPT-neo (1.5B)| 4.79% | 7.47% | 16.30% |
|
| 17 |
|GPT-J (6B)| 11.62% | 15.74% | 27.74% |
|
| 18 |
|
| 19 |
-
We can load HumanEval dataset and pass@k metric from 🤗 `datasets`
|
| 20 |
|
| 21 |
```python
|
| 22 |
from datasets import load_dataset, load_metric
|
|
|
|
| 16 |
|GPT-neo (1.5B)| 4.79% | 7.47% | 16.30% |
|
| 17 |
|GPT-J (6B)| 11.62% | 15.74% | 27.74% |
|
| 18 |
|
| 19 |
+
We can load HumanEval dataset and pass@k metric from 🤗 [`datasets`](https://huggingface.co/docs/datasets/index)
|
| 20 |
|
| 21 |
```python
|
| 22 |
from datasets import load_dataset, load_metric
|