mmBERT is trained on 3T tokens from over 1800 languages, showing SoTA scores on benchmarks and exceptional low-resource performance
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
DAR: Deontic Reasoning with Agentic Harnesses
Trust Functions: Near-Lossless Weak-to-Strong Generalization by Learning When to Trust the Weak Teacher
models 53
jhu-clsp/mmBERT-small
Fill-Mask • Updated • 51.5k • • 82
jhu-clsp/mmBERT-base
Fill-Mask • Updated • 556k • • 241
jhu-clsp/mmBERT-checkpoints
Updated • 4
jhu-clsp/ettin-decoder-1b
Fill-Mask • Updated • 379 • 5
jhu-clsp/ettin-decoder-32m
Text Generation • Updated • 157
jhu-clsp/ettin-encoder-1b
Feature Extraction • Updated • 3.06k • 25
jhu-clsp/ettin-encoder-68m
Fill-Mask • Updated • 3.99k • • 5
jhu-clsp/ettin-dec-from-enc-32m
Text Generation • Updated • 6
jhu-clsp/ettin-encoder-150m
Fill-Mask • Updated • 10.3k • • 13
jhu-clsp/ettin-decoder-400m
Text Generation • Updated • 82 • 4
datasets 40
jhu-clsp/SciTaRC
Viewer • Updated • 371 • 35 • 1
jhu-clsp/ManyIH-Bench
Preview • Updated • 85 • 3
jhu-clsp/robust04-instructions
Viewer • Updated • 136k • 588 • 2
jhu-clsp/core17-instructions
Viewer • Updated • 49.4k • 574 • 2
jhu-clsp/news21-instructions
Viewer • Updated • 71.5k • 559 • 1
jhu-clsp/megawika-2
Updated • 19.8k • 6
jhu-clsp/mmBERT-decay-data
Updated • 11.3k • 6
jhu-clsp/mmBERT-midtraining-data
Updated • 6.39k • 1
jhu-clsp/ettin-pretraining-data
Updated • 191k • 9
jhu-clsp/ettin-decay-data
Updated • 5.62k • 1