macadeliccc
/

Orpo-GutenLlama-3-8B-v2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Edit model card

Orpo-GutenLlama-3-8B-v2

Training Params

Learning Rate: 8e-6
Batch Size: 1
Eval Batch size: 1
Gradient accumulation steps: 4
Epochs: 3
Training Loss: 0.88

Training time: 4 hours on 1x4090. This is a small 1800 sample fine tune to get comfortable with ORPO fine tuning before scaling up.

Downloads last month: 7

Safetensors

Model size

8.03B params

Tensor type

FP16

·

Datasets used to train macadeliccc/Orpo-GutenLlama-3-8B-v2