FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale
Paper
•
2601.22146
•
Published
•
9
AI & ML interests
None defined yet.
Recent Activity
View all activity
AjayP13
authored
a
paper
14 days ago
AjayP13
updated
19
datasets
18 days ago
fineinstructions-pretraining/dclm_baseline_1.0_actual_all
Viewer
•
Updated
•
2.94B
•
177
•
1
fineinstructions-pretraining/fineweb_edu_actual_all
Preview
•
Updated
•
70
•
1
fineinstructions-pretraining/ipt_fineinstructions_judged
Viewer
•
Updated
•
763k
•
19
fineinstructions-pretraining/nemotron_wrap_1T_exp
Viewer
•
Updated
•
302M
•
187
fineinstructions-pretraining/nemotron_qa_1T_exp
Viewer
•
Updated
•
425M
•
112
fineinstructions-pretraining/nemotron_actual_1T_exp
Viewer
•
Updated
•
302M
•
61
fineinstructions-pretraining/nemotron_fineinstructions_1T_exp_chat
Viewer
•
Updated
•
721M
•
130
•
2
fineinstructions-pretraining/ipt_fineinstructions_all_judged_exp_chat
Viewer
•
Updated
•
34.5M
•
51
fineinstructions-pretraining/nemotron_synthetic_1T_exp
Viewer
•
Updated
•
448M
•
61
fineinstructions-pretraining/ipt_synthetic_all_exp
Viewer
•
Updated
•
26.6M
•
17
•
1
fineinstructions-pretraining/nemotron_actual_1T
Viewer
•
Updated
•
746M
•
17
fineinstructions-pretraining/longform_synthetic_all
Viewer
•
Updated
•
27.7k
•
8
fineinstructions-pretraining/ipt_synthetic_all
Viewer
•
Updated
•
40M
•
21
•
1
fineinstructions-pretraining/ipt_fineinstructions_all_exp
Viewer
•
Updated
•
56.3M
•
44
•
1
fineinstructions-pretraining/nemotron_wrap_1T
Viewer
•
Updated
•
763M
•
34
•
1
fineinstructions-pretraining/longform_fineinstructions_all
Viewer
•
Updated
•
45.7k
•
9
fineinstructions-pretraining/ipt_actual_all_exp
Viewer
•
Updated
•
26.6M
•
36
fineinstructions-pretraining/longform_actual_all
Viewer
•
Updated
•
27.7k
•
5
fineinstructions-pretraining/ipt_fineinstructions_scored
Viewer
•
Updated
•
9.93k
•
7