README.md

metadata

library_name: peft
base_model: unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Model Card for Model ID

DPO finetuned version of phi3-instruct-4k on student annotated preference data focusing on course content questions from EPFL curriculum (physics, math, cs).