Uploaded model
- Developed by: AlpacaAAR
- License: apache-2.0
- Finetuned from model : AlpacaAAR/llama-3-epfl-tutor
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Model tree for AlpacaAAR/llama-3-epfl-tutor-synthetic-dpo
Base model
AlpacaAAR/llama-3-epfl-tutor