BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
49
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
bigcode/guanaco-commits-m
Viewer
•
Updated
•
13.6k
•
3
bigcode/guanaco-commits
Viewer
•
Updated
•
13.6k
•
28
•
6
bigcode/starcoderdata
Viewer
•
Updated
•
207M
•
4.4k
•
445
bigcode/bigcode-pii-dataset
Viewer
•
Updated
•
12.1k
•
87
•
50
bigcode/stack-dedup-alt-comments
Viewer
•
Updated
•
32.7M
•
46
bigcode/bigcode-pii-dataset-training
Viewer
•
Updated
•
11.9k
•
8
•
11
bigcode/ta-prompt
Viewer
•
Updated
•
650
•
97
•
199
bigcode/the-stack-smol
Viewer
•
Updated
•
300k
•
522
•
53
bigcode/santacoder-fim-task
Viewer
•
Updated
•
4.79k
•
175
•
11
bigcode/pseudo-labeled-python-data-pii-detection-filtered
Viewer
•
Updated
•
17.7k
•
6
•
7
bigcode/commits-8192
Viewer
•
Updated
•
408k
•
12
•
3
bigcode/code-exchange
Viewer
•
Updated
•
7.66M
•
41
•
7
bigcode/commits-codegeex
Viewer
•
Updated
•
2.67M
•
115
•
5
bigcode/github-commits-diff-dedup-pjjs-april
Viewer
•
Updated
•
146k
•
1.26k
•
3
bigcode/the-stack
Viewer
•
Updated
•
546M
•
13.6k
•
833
bigcode/commits-pjj-2048
Viewer
•
Updated
•
1.85M
•
11
bigcode/commits-pjj-diff
Viewer
•
Updated
•
2.6M
•
284
•
2
bigcode/the-stack-github-issues
Viewer
•
Updated
•
31M
•
248
•
41
bigcode/the-stack-metadata
Viewer
•
Updated
•
10.8B
•
195
•
6
bigcode/the-stack-march-sample-special-tokens-stripped
Viewer
•
Updated
•
747k
•
163
bigcode/programming-languages-keywords
Viewer
•
Updated
•
36
•
23
•
6
bigcode/jupyter-code-text-pairs
Viewer
•
Updated
•
9.31M
•
75
•
8
bigcode/jupyter-parsed
Viewer
•
Updated
•
1.46M
•
47
•
4
bigcode/santacoder-token-usage
Viewer
•
Updated
•
49.1k
•
9
bigcode/the-stack-inspection-data
Preview
•
Updated
•
13
•
2
bigcode/the-stack-smol-xs
Viewer
•
Updated
•
8.7k
•
941
•
8
bigcode/the-stack-smol-xl
Viewer
•
Updated
•
541k
•
208
•
5
bigcode/the-stack-username-to-repo
Updated
•
9
•
1