List of binarized general preference datasets suitable for DPO and ORPO finetuning with HF Alignment Handbook.