Edit model card

UNA-POLAR-10.7B-InstructMath-v2

Model description

Its a UNA version with DPO over MathPILE Books out of the UNA-SOLAR-10.7B-Instruct-1.0

I used MathPILE OUTSTANDING Dataset of great Mathematic material in order to produce this beautiful model :)

Intended uses & limitations

If your model has inside UNA technology, cite.

Training and evaluation data

UNA-DPO over Attention and MLP's

Framework versions

  • PEFT 0.7.1
  • Transformers 4.36.2-UNA
  • Pytorch 2.1.2+cu121
  • Datasets 2.16.0
  • Tokenizers 0.15.
Downloads last month
2,063
Safetensors
Model size
10.7B params
Tensor type
FP16
·

Dataset used to train fblgit/UNA-POLAR-10.7B-InstructMath-v2

Space using fblgit/UNA-POLAR-10.7B-InstructMath-v2 1