vocab-transformers
/

dense_encoder-msmarco-distilbert-word2vec256k_emb_updated

Sentence Similarity

sentence-transformers

feature-extraction

text-embeddings-inference

Inference Endpoints

Model card Files Files and versions Community

nreimers commited on Feb 21, 2022

Commit

893a984

•

1 Parent(s): 693dad9

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -9,9 +9,11 @@ tags:
 # dense_encoder-msmarco-distilbert-word2vec256k
 This model is based on [msmarco-word2vec256000-distilbert-base-uncased](https://huggingface.co/nicoladecao/msmarco-word2vec256000-distilbert-base-uncased) with a 256k sized vocabulary initialized with word2vec.
-It has been trained on MS MARCO using [MarginMSELoss](https://github.com/UKPLab/sentence-transformers/blob/master/examples/training/ms_marco/train_bi-encoder_margin-mse.py) with a frozen embedding matrix. See the train_script.py in this repository.
 Performance:

 # dense_encoder-msmarco-distilbert-word2vec256k
+**Note: Token embeddings where updated!**
 This model is based on [msmarco-word2vec256000-distilbert-base-uncased](https://huggingface.co/nicoladecao/msmarco-word2vec256000-distilbert-base-uncased) with a 256k sized vocabulary initialized with word2vec.
+It has been trained on MS MARCO using [MarginMSELoss](https://github.com/UKPLab/sentence-transformers/blob/master/examples/training/ms_marco/train_bi-encoder_margin-mse.py). See the train_script.py in this repository.
 Performance: