"Some weights of BertForSequenceClassification were not initialized" warning when using with sentence_transformer

#3
by HyunggyuJang - opened

Is it expected? Or did I miss something?

The log is following:

Some weights of BertForSequenceClassification were not initialized from the model checkpoint at /tmp/thenlper_gte-base and are newly initialized: ['classifier.bias', 'classifier.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

Sign up or log in to comment