Update README.md
Browse files
README.md
CHANGED
|
@@ -106,7 +106,7 @@ torch.Size([1, 19, 1024])
|
|
| 106 |
You can use the raw model for fill mask or fine-tune it to a downstream task.
|
| 107 |
|
| 108 |
The training data used for this model has not been released as a dataset one can browse. We know it contains a lot of
|
| 109 |
-
unfiltered content from the internet, which is far from neutral.
|
| 110 |
|
| 111 |
## Training
|
| 112 |
|
|
|
|
| 106 |
You can use the raw model for fill mask or fine-tune it to a downstream task.
|
| 107 |
|
| 108 |
The training data used for this model has not been released as a dataset one can browse. We know it contains a lot of
|
| 109 |
+
unfiltered content from the internet, which is far from neutral. At the time of submission, no measures have been taken to estimate the bias and toxicity embedded in the model. However, we are well aware that our models may be biased since the corpora have been collected using crawling techniques on multiple web sources. We intend to conduct research in these areas in the future, and if completed, this model card will be updated.
|
| 110 |
|
| 111 |
## Training
|
| 112 |
|