ContextualAI/zephyr_sft_kto
Text Generation
•
Updated
•
3
Zephyr KTO
Aligned models based on Zephyr-SFT from Table 2 and 3 in the KTO paper by Ethayarajh et al. (2024) (https://arxiv.org/pdf/2402.01306).
Aligned models based on Zephyr-SFT from Table 2 and 3 in the KTO paper by Ethayarajh et al. (2024) (https://arxiv.org/pdf/2402.01306).