为什么修改1_Pooling/config.json中配置word_embedding_dimension=128,但无法生效
#13
by
sungangwudi
- opened
为什么修改1_Pooling/config.json中配置word_embedding_dimension=128,但无法生效
you can not change its dimension by this way.
maidalun1020
changed discussion status to
closed
thank you for your response.
I wonder how to change its dimension?
e.g. you can change the projection head by a linear layer with your dimension, and then train the model with total train data.
NOTE: a. "embedding" should be the projection head output. b. there could be a risk that model could perform worse after you train the model.