Scaling Repeated-Data Pretraining: Batch Size, Regularization, and GPU-Time Tradeoffs
Paper • 2610.15965 • Published • 5
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
Learning to Detect Language Model Training Data via Active Reconstruction
Knowing Isn't Understanding: Re-grounding Generative Proactivity with Epistemic and Behavioral Insight
sewon
submitted a
paper to Daily Papers 12 days ago
natolambert
authored 10
papers 26 days ago
RewardBench 2: Advancing Reward Model Evaluation
Paper • 2506.01937 • Published • 7
Spurious Rewards: Rethinking Training Signals in RLVR
Paper • 2506.10947 • Published • 2
Generalizing Verifiable Instruction Following
Paper • 2507.02833 • Published • 1
Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI
Paper • 2511.01689 • Published • 5
Olmo 3
Paper • 2512.13961 • Published • 39
Meta-Reinforcement Learning with Self-Reflection for Agentic Search
Paper • 2603.11327 • Published • 12
Olmo Hybrid: From Theory to Practice and Back
Paper • 2604.03444 • Published
Tmax: A simple recipe for terminal agents
Paper • 2606.23321 • Published • 17
Learning to Solve Hard Problems in RL for LLMs by Never Giving Up
Paper • 2609.13443 • Published • 15
Context Language Models
Paper • 2609.37725 • Published • 47
natolambert
authored a
paper 6 months ago
osieosie
submitted a
paper to Daily Papers 8 months ago
kaurkd13
submitted a
paper to Daily Papers 8 months ago
jacquelinehe
submitted a
paper to Daily Papers 9 months ago
ybelkada
authored a
paper 10 months ago
xhan77
authored 3
papers 11 months ago
LlamaFusion: Adapting Pretrained Language Models for Multimodal Generation
Paper • 2412.15188 • Published • 2
MADFormer: Mixed Autoregressive and Diffusion Transformers for Continuous Image Generation
Paper • 2506.07999 • Published • 2
TV2TV: A Unified Framework for Interleaved Language and Video Generation
Paper • 2512.05103 • Published • 20
akariasai
authored a
paper 11 months ago