Questions on model API and model sub-set weight configuration

#1
by Avatarass - opened

It appears there's no manual for this model, so I'm forced to ask some questions to clear things up.

Assuming I re-train it from scratch similarly to a typical BERT model, how can I can configure the width/depth weights?

If I save/load the model, will the configuration for weights percist?

Are we able to change the weights numerous times in the model object's lifetime, or is it done only once at initialization?

Is there any specific API calls I need to make after training to generate the sub-set models, or are they generated on the fly during training?

Avatarass changed discussion title from Questions on model API and weight configuration to Questions on model API and model sub-set weight configuration
Avatarass changed discussion status to closed
Avatarass changed discussion status to open

Sign up or log in to comment