README.md

metadata

base_model: meta-llama/Llama-3.2-1B
library_name: peft

Model Card for Model ID

329X DPO'd Model. Finetuned off meta-llama/Llama-3.2-1B. Trained for 1 epoch, learning rate=2e-4, batch_size=1.

• PEFT 0.10.0