Model Card for Model ID

329X DPO'd Model. Finetuned off meta-llama/Llama-3.2-1B. Trained for 1 epoch, learning rate=2e-4, batch_size=1.

  • PEFT 0.10.0
Downloads last month
3
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for swulee/cs329x-llama-3.2-1B-dpo

Adapter
(84)
this model