Edit model card

Model

  • trained on custom DPO dataset
    • dedup
    • ~20000??

Base Moel

  • ENERGY-DRINK-LOVE/SOLAR_merge

Framework versions

  • Transformers 4.38.1
  • Pytorch 2.2.1+cu118
  • Datasets 2.17.1
  • Tokenizers 0.15.2
Downloads last month
1,269
Safetensors
Model size
10.7B params
Tensor type
BF16
·

Finetuned from