Preview tag
#6
by snapo - opened
Does this mean you are still training and the model is still improving?
yes, I think they are mainly focusing on improving the RL context length, bcs the model might be good till we reach 128K, then it will be decent, not THAT good. ykwim?
ig, its mainly with RL tbf