cs552-mlp
/

phi3-dpo

Model card Files Files and versions Community

Model Card for Model ID

DPO finetuned version of phi3-instruct-4k on student annotated preference data focusing on course content questions from EPFL curriculum (physics, math, cs).

Downloads last month: 0

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for cs552-mlp/phi3-dpo

Base model

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Adapter

(21)

this model

Collection including cs552-mlp/phi3-dpo

Submitted Models

This collection includes base phi3-mini A) DPO aligned B) SFT on ARC train split (3 epochs) C) Quantised version of B) using GPTQ. • 4 items • Updated Jun 14, 2024