togethercomputer
/

m2-bert-80M-2k-retrieval

Sentence Similarity

text-classification

Model card Files Files and versions Community

Dan Fu commited on Jan 9

Commit

6082b2d

•

1 Parent(s): 32e57e8

Update

Files changed (1) hide show

bert_layers.py +1 -1

bert_layers.py CHANGED Viewed

@@ -881,7 +881,7 @@ class BertForTextEncoding(BertPreTrainedModel):
                 'If you want to use `BertForMaskedLM` make sure `config.is_decoder=False` for '
                 'bi-directional self-attention.')
-        self.bert = BertModel(config, add_pooling_layer=False)
         # Initialize weights and apply final processing
         self.post_init()

                 'If you want to use `BertForMaskedLM` make sure `config.is_decoder=False` for '
                 'bi-directional self-attention.')
+        self.bert = BertModel(config, add_pooling_layer=True)
         # Initialize weights and apply final processing
         self.post_init()