Uploaded model
- Developed by: ksw1
- License: apache-2.0
- Finetuned from model : ksw1/llama-3-8b-sleeper-agent
- Data that was used to train this model can be found on HuggingFace at: ksw1/cs224n-dpo-1
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 6
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for ksw1/DPO-1-1k
Base model
unsloth/llama-3-8b-Instruct-bnb-4bit
Finetuned
ksw1/llama-3-8b-sleeper-agent