Direct Preference Heads (Preprint) Collection This collection contains the pre-trained, fine-tuned and aligned models for the Direct Preference Heads paper. • 4 items • Updated 27 days ago • 1