Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ Legal_BERTimbau Large is a fine-tuned BERT model based on [BERTimbau](https://hu
|
|
20 |
|
21 |
For further information or requests, please go to [BERTimbau repository](https://github.com/neuralmind-ai/portuguese-bert/)."
|
22 |
|
23 |
-
The performance of Language Models can change drastically when there is a domain shift between training and test data. In order create a Portuguese Language Model adapted to a Legal domain, the original BERTimbau model was submitted to a fine-tuning stage where it was performed 1 "PreTraining" epoch over 30 000 legal Portuguese Legal documents available online.
|
24 |
|
25 |
|
26 |
## Available models
|
|
|
20 |
|
21 |
For further information or requests, please go to [BERTimbau repository](https://github.com/neuralmind-ai/portuguese-bert/)."
|
22 |
|
23 |
+
The performance of Language Models can change drastically when there is a domain shift between training and test data. In order create a Portuguese Language Model adapted to a Legal domain, the original BERTimbau model was submitted to a fine-tuning stage where it was performed 1 "PreTraining" epoch over 30 000 legal Portuguese Legal documents available online. (lr: 1e-5)
|
24 |
|
25 |
|
26 |
## Available models
|