GitHub repository: sanowl/SPPO
Description: The official implementation of Self-Play Preference Optimization (SPPO)