GitHub repository: sail-sg/CPO
Primary language: Python
Description: [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.