Update README.md
Browse files
README.md
CHANGED
|
@@ -45,7 +45,6 @@ print(embeddings)
|
|
| 45 |
## Training
|
| 46 |
|
| 47 |
* The original weights was taken from [cointegrated/rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2).
|
| 48 |
-
*
|
| 49 |
* Training was conducted in two stages:
|
| 50 |
1. In the first stage, the model was trained on Wikipedia texts (4 million texts) for three epochs.
|
| 51 |
<img src="https://github.com/FractalGPT/ModelEmbedderDistilation/blob/main/DistilSBERT/Train/1_st_en.JPG?raw=true" width=700 />
|
|
|
|
| 45 |
## Training
|
| 46 |
|
| 47 |
* The original weights was taken from [cointegrated/rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2).
|
|
|
|
| 48 |
* Training was conducted in two stages:
|
| 49 |
1. In the first stage, the model was trained on Wikipedia texts (4 million texts) for three epochs.
|
| 50 |
<img src="https://github.com/FractalGPT/ModelEmbedderDistilation/blob/main/DistilSBERT/Train/1_st_en.JPG?raw=true" width=700 />
|