GitHub repository: rycolab/odpo
Primary language: Python
Description: This repository contains code for the paper Directo Preference Optimization with an Offset (ODPO).