GitHub repository: uclaml/SPPO
Primary language: Python
Description: The official implementation of Self-Play Preference Optimization (SPPO)