ModernBERT - a answerdotai Collection

answerdotai 's Collections

CLA-Experiments

Multi-Vector Retrievers

Quantized-FT-Orca-Math

Quantized-LLama-3

Japanese Retrieval

Function Calling

ModernBERT

updated Dec 19, 2024

Bringing BERT into modernity via both architecture changes and scaling

answerdotai/ModernBERT-base

Fill-Mask • Updated Jan 15 • 405k • 846
answerdotai/ModernBERT-large

Fill-Mask • Updated Jan 15 • 90.8k • 391
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published Dec 18, 2024 • 150