32 Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback · 32 authors 1