DJfastmusic
/

assn2-DPO

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

upload_assn2-DPO_merged_hf

Merged full model for CAS4133 Assignment 2. Source adapter: /root/CAS4133-assn2/checkpoints/dpo_from_best_sft_pref Base model: /root/CAS4133-assn2/checkpoints/sft_lr_sweep/best_sft_merged_hf

Downloads last month: 3

Safetensors

Model size

1B params

Tensor type

BF16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support