Evaluation datasets

community

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

SaylorTwift updated a dataset about 19 hours ago

lighteval/logiqa_harness

SaylorTwift new activity about 19 hours ago

lighteval/sacrebleu_manual:Convert dataset to Parquet

SaylorTwift updated a dataset about 20 hours ago

lighteval/sacrebleu_manual

View all activity

lighteval 's collections 9

RULER Datasets SmolLM3-11T-32k-v1-remote-code

RULER Datasets

lighteval/RULER-262144-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20 • 6.5k • 21
lighteval/RULER-131072-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20 • 6.5k • 30
lighteval/RULER-65536-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20 • 6.5k • 27
lighteval/RULER-32768-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20 • 6.5k • 39

RULER Datasets gemma3-base

RULER Datasets

lighteval/RULER-262144-gemma3-base

Viewer • Updated Jun 19 • 6.5k • 8
lighteval/RULER-131072-gemma3-base

Viewer • Updated Jun 18 • 6.5k • 5
lighteval/RULER-65536-gemma3-base

Viewer • Updated Jun 18 • 6.5k • 22
lighteval/RULER-32768-gemma3-base

Viewer • Updated Jun 18 • 6.5k • 7

RULER Datasets Falcon-H1-3B-Base

tokenized with: `tokenizer.tokenize(text, add_special_tokens=False)`

lighteval/RULER-262144-Falcon-H1-3B-Base

Viewer • Updated Jun 19 • 6.5k • 9
lighteval/RULER-131072-Falcon-H1-3B-Base

Viewer • Updated Jun 18 • 6.5k • 7
lighteval/RULER-65536-Falcon-H1-3B-Base

Viewer • Updated Jun 18 • 6.5k • 22
lighteval/RULER-32768-Falcon-H1-3B-Base

Viewer • Updated Jun 18 • 6.5k • 44

RULER Datasets Qwen2.5-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Qwen2.5-Instruct

Viewer • Updated Jun 19 • 6.5k • 10
lighteval/RULER-131072-Qwen2.5-Instruct

Viewer • Updated Jun 18 • 6.5k • 8
lighteval/RULER-65536-Qwen2.5-Instruct

Viewer • Updated Jun 18 • 6.5k • 48
lighteval/RULER-32768-Qwen2.5-Instruct

Viewer • Updated Jun 18 • 6.5k • 26

RULER Datasets Qwen-3

tokenized with: `tokenizer.tokenize(text, add_special_tokens=False)`

lighteval/RULER-262144-Qwen-3

Viewer • Updated Jun 19 • 6.5k • 25
lighteval/RULER-131072-Qwen-3

Viewer • Updated Jun 18 • 6.5k • 7
lighteval/RULER-65536-Qwen-3

Viewer • Updated Jun 18 • 6.5k • 18
lighteval/RULER-32768-Qwen-3

Viewer • Updated Jun 18 • 6.5k • 66

RULER Datasets gemma3-instruct

RULER Datasets

lighteval/RULER-262144-gemma3-instruct

Viewer • Updated Jun 19 • 6.5k • 58
lighteval/RULER-131072-gemma3-instruct

Viewer • Updated Jun 18 • 6.5k • 16
lighteval/RULER-65536-gemma3-instruct

Viewer • Updated Jun 18 • 6.5k • 33
lighteval/RULER-32768-gemma3-instruct

Viewer • Updated Jun 18 • 6.5k • 65

RULER Datasets Falcon-H1-3B-Instruct

RULER Datasets

lighteval/RULER-262144-Falcon-H1-3B-Instruct

Viewer • Updated Jun 19 • 6.5k • 24
lighteval/RULER-131072-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18 • 6.5k • 51
lighteval/RULER-65536-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18 • 6.5k • 11
lighteval/RULER-32768-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18 • 6.5k • 6

RULER Datasets Lamma3-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Lamma3-Instruct

Viewer • Updated Jun 19 • 6.5k • 9
lighteval/RULER-131072-Lamma3-Instruct

Viewer • Updated Jun 18 • 6.5k • 7
lighteval/RULER-65536-Lamma3-Instruct

Viewer • Updated Jun 18 • 6.5k • 82
lighteval/RULER-32768-Lamma3-Instruct

Viewer • Updated Jun 18 • 6.5k • 42

RULER Datasets Qwen-3-Instruct

msg = [{"role": "user", "content": text}] tokenizer.apply_chat_template(msg, add_special_tokens=True, tokenize=True)

lighteval/RULER-262144-Qwen-3-Instruct

Viewer • Updated Jun 19 • 6.5k • 19
lighteval/RULER-131072-Qwen-3-Instruct

Viewer • Updated Jun 18 • 6.5k • 49
lighteval/RULER-65536-Qwen-3-Instruct

Viewer • Updated Jun 18 • 6.5k • 21
lighteval/RULER-32768-Qwen-3-Instruct

Viewer • Updated Jun 18 • 6.5k • 9

RULER Datasets SmolLM3-11T-32k-v1-remote-code

RULER Datasets

lighteval/RULER-262144-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20 • 6.5k • 21
lighteval/RULER-131072-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20 • 6.5k • 30
lighteval/RULER-65536-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20 • 6.5k • 27
lighteval/RULER-32768-SmolLM3-11T-32k-v1-remote-code

Viewer • Updated Jun 20 • 6.5k • 39

RULER Datasets gemma3-instruct

RULER Datasets

lighteval/RULER-262144-gemma3-instruct

Viewer • Updated Jun 19 • 6.5k • 58
lighteval/RULER-131072-gemma3-instruct

Viewer • Updated Jun 18 • 6.5k • 16
lighteval/RULER-65536-gemma3-instruct

Viewer • Updated Jun 18 • 6.5k • 33
lighteval/RULER-32768-gemma3-instruct

Viewer • Updated Jun 18 • 6.5k • 65

RULER Datasets gemma3-base

RULER Datasets

lighteval/RULER-262144-gemma3-base

Viewer • Updated Jun 19 • 6.5k • 8
lighteval/RULER-131072-gemma3-base

Viewer • Updated Jun 18 • 6.5k • 5
lighteval/RULER-65536-gemma3-base

Viewer • Updated Jun 18 • 6.5k • 22
lighteval/RULER-32768-gemma3-base

Viewer • Updated Jun 18 • 6.5k • 7

RULER Datasets Falcon-H1-3B-Instruct

RULER Datasets

lighteval/RULER-262144-Falcon-H1-3B-Instruct

Viewer • Updated Jun 19 • 6.5k • 24
lighteval/RULER-131072-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18 • 6.5k • 51
lighteval/RULER-65536-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18 • 6.5k • 11
lighteval/RULER-32768-Falcon-H1-3B-Instruct

Viewer • Updated Jun 18 • 6.5k • 6