Don't create pooling layer with Sentence Transformers
#8
by
tomaarsen
HF staff
- opened
Hello!
Pull Request overview
- Remove "Some weights were not initialized" warning
Details
We can introduce some model arguments in the configuration, which will be used in the eventual model creation. This solved the warning that users have been experiencing:
Some weights of BertModel were not initialized from the model and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
- Tom Aarsen
spacemanidol
changed pull request status to
open
spacemanidol
changed pull request status to
merged