Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
trl-lib 's Collections
Preference datasets
Stepwise supervision datasets
Prompt-completion datasets
Prompt-only datasets
Unpaired preference datasets
Comparing DPO with IPO and KTO
Online-DPO

Stepwise supervision datasets

updated Jan 8
Upvote
-

  • trl-lib/math_shepherd

    Viewer • Updated Jan 8 • 445k • 897 • 6

  • trl-lib/prm800k

    Viewer • Updated Jan 8 • 41.2k • 60 • 2
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs