Update README.md
Browse files
README.md
CHANGED
@@ -104,22 +104,23 @@ print(sentence_embeddings)
|
|
104 |
## Evaluation Results STS
|
105 |
|
106 |
|
107 |
-
|
108 |
-
|
|
109 |
-
|
|
110 |
-
| Legal-BERTimbau-sts-base
|
111 |
-
| Legal-BERTimbau-sts-base-ma
|
112 |
-
| Legal-BERTimbau-sts-
|
113 |
-
| Legal-BERTimbau-sts-large
|
114 |
-
| Legal-BERTimbau-sts-large-
|
115 |
-
| Legal-BERTimbau-sts-large-ma
|
116 |
-
| Legal-BERTimbau-sts-large-ma-
|
117 |
-
|
|
118 |
-
|
|
119 |
-
| BERTimbau
|
120 |
-
|
|
121 |
-
|
|
122 |
-
| paraphrase-multilingual-mpnet-base-v2
|
|
|
123 |
## Training
|
124 |
|
125 |
rufimelo/Legal-BERTimbau-sts-base-ma-v2 is based on Legal-BERTimbau-base which derives from [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased) base.
|
|
|
104 |
## Evaluation Results STS
|
105 |
|
106 |
|
107 |
+
|
108 |
+
| Model| Assin | Assin2|stsb_multi_mt pt| avg|
|
109 |
+
| ---------------------------------------- | ---------- | ---------- |---------- |---------- |
|
110 |
+
| Legal-BERTimbau-sts-base| 0.71457| 0.73545 | 0.72383|0.72462|
|
111 |
+
| Legal-BERTimbau-sts-base-ma| 0.74874 | 0.79532|0.82254 |0.78886|
|
112 |
+
| Legal-BERTimbau-sts-base-ma-v2| 0.75481 | 0.80262|0.82178|0.79307|
|
113 |
+
| Legal-BERTimbau-sts-large| 0.76629| 0.82357 | 0.79120|0.79369|
|
114 |
+
| Legal-BERTimbau-sts-large-v2| 0.76299 | 0.81121|0.81726 |0.79715|
|
115 |
+
| Legal-BERTimbau-sts-large-ma| 0.76195| 0.81622 | 0.82608|0.80142|
|
116 |
+
| Legal-BERTimbau-sts-large-ma-v2| 0.7836| 0.8462| 0.8261| 0.81863|
|
117 |
+
| Legal-BERTimbau-sts-large-ma-v3| 0.7749| **0.8470**| 0.8364| **0.81943**|
|
118 |
+
| ---------------------------------------- | ---------- |---------- |---------- |---------- |
|
119 |
+
| BERTimbau base Fine-tuned for STS|**0.78455** | 0.80626|0.82841|0.80640|
|
120 |
+
| BERTimbau large Fine-tuned for STS|0.78193 | 0.81758|0.83784|0.81245|
|
121 |
+
| ---------------------------------------- | ---------- |---------- |---------- |---------- |
|
122 |
+
| paraphrase-multilingual-mpnet-base-v2| 0.71457| 0.79831 |0.83999 |0.78429|
|
123 |
+
| paraphrase-multilingual-mpnet-base-v2 Fine-tuned with assin(s)| 0.77641|0.79831 |**0.84575**|0.80682|
|
124 |
## Training
|
125 |
|
126 |
rufimelo/Legal-BERTimbau-sts-base-ma-v2 is based on Legal-BERTimbau-base which derives from [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased) base.
|