Training the model from scratch

#9
by Mohammadreza - opened

First of all, thank you for introducing such a paradigm. It's highly practical. Secondly, I request you to present the architecture of this model as a network class in Hugging Face so we can train this model from scratch on our own data.
Actually, my main need is this: I have a very powerful model and I want to transfer its knowledge, which has come out in the form of embedding, to this model and have it provide me with a task-specific embedding for various tasks.

NLP Group of The University of Hong Kong org

Sign up or log in to comment