Uploaded model
- Developed by: ksw1
- License: apache-2.0
- Finetuned from model : ksw1/llama-3-8b-sleeper-agent
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 4
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for ksw1/DPO-3-1k-1steps-2
Base model
unsloth/llama-3-8b-Instruct-bnb-4bit
Finetuned
ksw1/llama-3-8b-sleeper-agent