What model is this?
#1
by
Yhyu13
- opened
What model is this based on? And which dataset it is trained on?
We're just doing some experimentation w LoRA merges to see if they can improve the training efficiency of full weight fine tunes later. Results are inconclusive at the moment as we believe there may be some flaws in training.