rufimelo commited on
Commit
1dfa3a1
1 Parent(s): c9bc550

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -85,13 +85,15 @@ print(sentence_embeddings)
85
  | ---------------------------------------- | ---------- |---------- |
86
  | paraphrase-multilingual-mpnet-base-v2| Assin | 0.743740222 |
87
  | paraphrase-multilingual-mpnet-base-v2| Assin2| 0.823565322 |
 
88
  | paraphrase-multilingual-mpnet-base-v2 Fine tuned with assin(s)| Assin | 0.77641 |
89
  | paraphrase-multilingual-mpnet-base-v2 Fine tuned with assin(s)| Assin2| 0.79831 |
 
90
 
91
  ## Training
92
 
93
  Legal-SBERTimbau-large is based on Legal-BERTimbau-large whioch derives from [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased) Large.
94
- It was trained using the multilingual knowledge distillation process, meaning it was trained as a multilingual model. This was chosen due to the lack of Portuguese available data.
95
  In addition to that, it was submitted to a fine tuning stage with the [assin](https://huggingface.co/datasets/assin) and [assin2](https://huggingface.co/datasets/assin2) datasets.
96
 
97
  ## Full Model Architecture
 
85
  | ---------------------------------------- | ---------- |---------- |
86
  | paraphrase-multilingual-mpnet-base-v2| Assin | 0.743740222 |
87
  | paraphrase-multilingual-mpnet-base-v2| Assin2| 0.823565322 |
88
+ | paraphrase-multilingual-mpnet-base-v2| stsb_multi_mt pt| 0.83999 |
89
  | paraphrase-multilingual-mpnet-base-v2 Fine tuned with assin(s)| Assin | 0.77641 |
90
  | paraphrase-multilingual-mpnet-base-v2 Fine tuned with assin(s)| Assin2| 0.79831 |
91
+ | paraphrase-multilingual-mpnet-base-v2 Fine tuned with assin(s)| stsb_multi_mt pt| 0.84575 |
92
 
93
  ## Training
94
 
95
  Legal-SBERTimbau-large is based on Legal-BERTimbau-large whioch derives from [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased) Large.
96
+ It was trained for Natural Language Inference (NLI). This was chosen due to the lack of Portuguese available data.
97
  In addition to that, it was submitted to a fine tuning stage with the [assin](https://huggingface.co/datasets/assin) and [assin2](https://huggingface.co/datasets/assin2) datasets.
98
 
99
  ## Full Model Architecture