--- library_name: peft base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0 datasets: - intone/mega-dpo metrics: - accuracy --- # TinyLLaMa DPO model