fine tuning
#2
by
obisin
- opened
this is good. is there a good method or doc you used to fine tune it?
I used a hacky way of Charles Goddard's zloss fix for transformers, but @Doctor-Shotgun 's placed all the changes in one.
https://github.com/DocShotgun/axolotl
I'll be uploading the axolotl config in the full bf16 model
thank you