Predict human preference to LLM responses.
Binfeng Xu
billxbf
AI & ML interests
evolving back to apes
Recent Activity
upvoted a paper 14 days ago
PhyCritic: Multimodal Critic Models for Physical AI updated
a dataset 2 months ago
billxbf/math_pile_v3 Organizations
models 16
billxbf/zephyr-7b-dpo-iter1
Text Generation • 274k • Updated
• 6
billxbf/zephyr-7b-dpo-iter3
Text Generation • 266k • Updated
• 1
billxbf/zephyr-7b-dpo-iter2
Text Generation • 266k • Updated
• 2
billxbf/Nano-Raccoon-Preview-1104
425k • Updated
billxbf/zephyr-7b-sft-iter3
Text Generation • 266k • Updated
• 2
billxbf/zephyr-7b-sft-iter2
Text Generation • 266k • Updated
• 2
billxbf/zephyr-7b-sft-iter1
Text Generation • 266k • Updated
• 3
billxbf/nemo-sft-orpo
12B • Updated
billxbf/chai-nemo13b-sft-orpo-merge_v2
Text Generation • 12B • Updated
• 1
billxbf/chai-nemo-sft-orpo-merge
Text Generation • 12B • Updated
• 1
datasets 20
billxbf/math_pile_v3
Viewer
• Updated
• 1.52M • 10
billxbf/ultrafeedback-dpo-iter3
Viewer
• Updated
• 20.4k • 10
billxbf/ultrafeedback-dpo-iter1
Viewer
• Updated
• 20.4k • 8
billxbf/ultrafeedback-dpo-iter2
Viewer
• Updated
• 20.4k • 8
billxbf/ultrafeedback-sft-iter3
Viewer
• Updated
• 20.4k • 9
billxbf/ultrafeedback-sft-iter2
Viewer
• Updated
• 20.4k • 10
billxbf/ultrafeedback-sft-iter1
Viewer
• Updated
• 20.4k • 8
billxbf/verified100-chitchat
Viewer
• Updated
• 100 • 8
billxbf/verified100-lite
Viewer
• Updated
• 100 • 8
billxbf/verified100
Viewer
• Updated
• 100 • 8