Avelina 's Collections

Direct Preference Heads (Preprint)

This collection contains the pre-trained, fine-tuned and aligned models for the Direct Preference Heads paper.