Omkar2118/datasets huggingface dataset:
ListUltraFeedback

A listwise multi-response dataset for human preferences alignment. The dataset is derived from UltraFeedback and SimPO.

Introducing paper: Ordinal Preference Optimization: Aligning Human Preferences via NDCG