unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11 • 312 • 13

Note All training runs were done on this model (4 bit qlora). Go unsloth!

Note Used this entire dataset for training. For SFT, the rejected part of the dataset was ignored.

G-reen/EXPERIMENT-DPO-m7b2-1-merged

Text Generation • Updated Apr 15 • 67

Note The image shows a comparison between all the completed DPO runs.

G-reen/EXPERIMENT-DPO-m7b2-2-merged

Text Generation • Updated Apr 15 • 69

Note Probably the best loss curve at lr=5e-5.

G-reen/EXPERIMENT-DPO-m7b2-3-merged

Text Generation • Updated Apr 15 • 66

Note Failed to train, definitely do not use

G-reen/EXPERIMENT-SFT-m7b2-1-merged

Text Generation • Updated Apr 15 • 5

Note The image shows a comparison between all the completed SFT runs.

G-reen/EXPERIMENT-SFT-m7b2-2-merged

Text Generation • Updated Apr 15 • 68

Note Probably the best loss curve at lr=5e-5.