Data Attribution

EleutherAI 's Collections

Evals

Deep Ignorance

Pythia Scaling Suite

PolyPythias

Data Attribution

Quirky Models and Datasets

Pile-T5

Quirky Math (archive)

Pile-T5 T5x Checkpoints

Sparse Autoencoders

updated 21 days ago

Leave-1%-out retrained models, per-query loss changes, and datasets for computing LDS.

Upvote

EleutherAI/LDS-retrain-bank-adamw-N4k-bs256

Viewer • Updated Aug 25 • 2k • 499
EleutherAI/LDS-retrain-bank-adamw-N8k-bs256

Viewer • Updated Aug 25 • 4.64k • 436
EleutherAI/LDS-retrain-bank-muon-N8k-bs256

Viewer • Updated Aug 25 • 2k • 384
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256

Viewer • Updated Aug 25 • 3.2k • 576
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.25

Viewer • Updated Aug 25 • 2.9k • 555
EleutherAI/LDS-retrain-bank-muon-N4k-bs256

Viewer • Updated Aug 25 • 2k • 363
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-ep4

Viewer • Updated Aug 26 • 4k • 471
EleutherAI/LDS-retrain-bank-adamw-N32k-bs256

Viewer • Updated Aug 26 • 4k • 471
EleutherAI/LDS-retrain-bank-muon-N16k-bs16

Viewer • Updated Aug 26 • 4k • 796
EleutherAI/LDS-retrain-bank-muon-N32k-bs256

Viewer • Updated Aug 26 • 4k • 533
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium

Viewer • Updated Aug 26 • 4k • 512
EleutherAI/bergson-smollm2-lds-chunks

Viewer • Updated Jul 17 • 60.1k • 34
EleutherAI/bergson-smollm2-scaling

Viewer • Updated Aug 20 • 512k • 23
EleutherAI/LDS-retrain-bank-adamw-N16k-bs128

Viewer • Updated Aug 24 • 2k • 14
EleutherAI/LDS-retrain-bank-adamw-N16k-bs16

Viewer • Updated Aug 24 • 2k • 22
EleutherAI/LDS-retrain-bank-adamw-N16k-bs32

Viewer • Updated Aug 23 • 2k • 27
EleutherAI/LDS-retrain-bank-adamw-N16k-bs512

Viewer • Updated Aug 24 • 2k • 228
EleutherAI/LDS-retrain-bank-adamw-N16k-bs64

Viewer • Updated Aug 22 • 2k • 415
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-clip1.0

Viewer • Updated Aug 24 • 2.9k • 195
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.5

Viewer • Updated Aug 24 • 2.9k • 186
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.0

Viewer • Updated Aug 24 • 2.9k • 308
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.1

Viewer • Updated Aug 24 • 2.9k • 304
EleutherAI/LDS-retrain-bank-muon-N16k-bs128

Viewer • Updated Aug 22 • 2k • 590
EleutherAI/LDS-retrain-bank-muon-N16k-bs32

Viewer • Updated Aug 23 • 4k • 107
EleutherAI/LDS-retrain-bank-muon-N16k-bs64

Viewer • Updated Aug 24 • 2k • 86
EleutherAI/LDS-retrain-bank-muon-N16k-bs256

Viewer • Updated Aug 24 • 5.64k • 566
EleutherAI/LDS-retrain-bank-adamw-N64k-bs256

Viewer • Updated Aug 29 • 4.18k • 151
EleutherAI/bergson-wikitext-2-gpt2

Updated 22 days ago • 20
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1004

Viewer • Updated Aug 30 • 89.9k • 594
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1005

Viewer • Updated Aug 30 • 96.2k • 431
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1006

Viewer • Updated Aug 30 • 96.2k • 740
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1008

Viewer • Updated Aug 30 • 96.2k • 504
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1007

Viewer • Updated Aug 30 • 96.2k • 833
EleutherAI/LDS-retrain-bank-london16k-bs256-muon

Viewer • Updated Sep 2 • 2k • 299
EleutherAI/PARTIAL_LDS-retrain-bank-muon-N64k-bs256

Updated Sep 2 • 700
EleutherAI/PARTIAL_LDS-retrain-bank-gpt2medium-16k-bs32

Viewer • Updated Sep 2 • 1.3k • 411
EleutherAI/pile-heldout-queries-2048

Updated 24 days ago • 83
EleutherAI/fineweb-heldout-queries-2048

Updated 24 days ago • 87
EleutherAI/bergson-wikitext-2-4656-chunks

Viewer • Updated Aug 2 • 5.14k • 162

Note Pre-tokenized WikiText-2 chunks for the Bae et al. 2024 SOURCE replication
EleutherAI/bergson-wikitext-gpt2-leaderboard

Updated 22 days ago • 16
EleutherAI/bergson-wikitext-gpt2-leaderboard-bank

Viewer • Updated 8 days ago • 11.3k • 595
EleutherAI/bergson-wikitext-512-chunks

Viewer • Updated Jul 8 • 4.86k • 645

Upvote