nreimers commited on
Commit
af36be0
1 Parent(s): e1d9bd3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -9,9 +9,9 @@ tags:
9
 
10
  # dense_encoder-msmarco-distilbert-word2vec256k-MLM_445k
11
 
12
- This model is based on [vocab-transformers/msmarco-distilbert-word2vec256k-MLM_445k](https://huggingface.co/vocab-transformers/msmarco-distilbert-word2vec256k-MLM_445k) with a 256k sized vocabulary initialized with word2vec that has been trained with MLM for 445k steps with frozen embedding matrix on the MSMARCO corpus.
13
 
14
- It has been trained on MS MARCO using [MarginMSELoss](https://github.com/UKPLab/sentence-transformers/blob/master/examples/training/ms_marco/train_bi-encoder_margin-mse.py) with a frozen embedding matrix. See the train_script.py in this repository.
15
 
16
 
17
  Performance:
 
9
 
10
  # dense_encoder-msmarco-distilbert-word2vec256k-MLM_445k
11
 
12
+ This model is based on [vocab-transformers/msmarco-distilbert-word2vec256k-MLM_445k](https://huggingface.co/vocab-transformers/msmarco-distilbert-word2vec256k-MLM_445k) with a 256k sized vocabulary initialized with word2vec that has been trained with MLM for 445k steps. **Note: Token embeddings where updated!**
13
 
14
+ It has been trained on MS MARCO using [MarginMSELoss](https://github.com/UKPLab/sentence-transformers/blob/master/examples/training/ms_marco/train_bi-encoder_margin-mse.py). See the train_script.py in this repository. **Note: Token embeddings where updated!**
15
 
16
 
17
  Performance: