Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
trl-lib
's Collections
Preference datasets
Stepwise supervision datasets
Prompt-completion datasets
Prompt-only datasets
Unpaired preference datasets
Comparing DPO with IPO and KTO
Online-DPO
Unpaired preference datasets
updated
5 days ago
Upvote
-
trl-lib/ultrafeedback-gpt-3.5-turbo-helpfulness
Viewer
•
Updated
5 days ago
•
16.6k
•
137
trl-lib/kto-mix-14k
Viewer
•
Updated
Mar 25, 2024
•
15k
•
202
•
6
Upvote
-
Share collection
View history
Collection guide
Browse collections