Small model trained upon GPT2SMALL pt version with SFT and Orpo (RLHF)
- Downloads last month
- 5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Small model trained upon GPT2SMALL pt version with SFT and Orpo (RLHF)