GitHub repository: marcus-jw/Targeted-Manipulation-and-Deception-in-LLMs
Primary language: Python
Description: Codebase for "Targeted Manipulation and Deception Emerge in LLMs Trained on User Feedback". This repo implements a generative multi-turn RL environment with support for agent, user, user feedback, transition and veto models. It also implements KTO and expert iteration for training on user preferences.