Model Card for free-solar-dpo-v0.2

Developed by : Freewheelin AI Technical Team

Hardware and Software

• Training Factors: We fine-tuned this model using the HuggingFace TRL Trainer

Method

• This model was trained using the learning method introduced in the SOLAR paper.

Base Model

• davidkim205/nox-solar-10.7b-v4