Congrats on the great work! May I know if you used UL2 like GPT-JT?
@JunnanLi Hi, the model is an autoregressive language model, fine-tuned from GPT-NeoX. So no, we did not use UL2 for this model :)
· Sign up or log in to comment
