Update README.md
Browse files
README.md
CHANGED
@@ -27,8 +27,7 @@ This model reaches an accuracy of 91.3 on the dev set.
|
|
27 |
- **Model Type:** Text Classification
|
28 |
- **Language(s):** English
|
29 |
- **License:** Apache-2.0
|
30 |
-
- **Parent Model:** For more details about DistilBERT, we encourage users to check out [this model card](https://huggingface.co/distilbert-base-uncased).
|
31 |
- **Resources for more information:**
|
32 |
-
- The model was pre-trained with task-adaptive pre-training [TAPT](https://arxiv.org/pdf/2004.10964.pdf)
|
33 |
- fine-tuned on sst with subtrees
|
34 |
- fine-tuned on sst2
|
|
|
27 |
- **Model Type:** Text Classification
|
28 |
- **Language(s):** English
|
29 |
- **License:** Apache-2.0
|
|
|
30 |
- **Resources for more information:**
|
31 |
+
- The model was pre-trained with task-adaptive pre-training [TAPT](https://arxiv.org/pdf/2004.10964.pdf) with an increased masking rate, no corruption strategy, and using WWM, following [this paper](https://aclanthology.org/2023.eacl-main.217.pdf)
|
32 |
- fine-tuned on sst with subtrees
|
33 |
- fine-tuned on sst2
|