Update README.md
Browse files
README.md
CHANGED
|
@@ -36,6 +36,9 @@ for token in top_5_tokens:
|
|
| 36 |
print(sequence.replace(tokenizer.mask_token, tokenizer.decode([token])))
|
| 37 |
```
|
| 38 |
|
|
|
|
|
|
|
|
|
|
| 39 |
### BibTeX entry and citation info
|
| 40 |
|
| 41 |
If you use this model in your research, please consider citing our paper:
|
|
|
|
| 36 |
print(sequence.replace(tokenizer.mask_token, tokenizer.decode([token])))
|
| 37 |
```
|
| 38 |
|
| 39 |
+
### Limitations and bias
|
| 40 |
+
Some data used to pretrain gaBERT was scraped from the web which potentially contains ethically problematic text (bias, hate, adult content, etc.). Consequently, downstream tasks/applications using gaBERT should be thoroughly tested with respect to ethical considerations.
|
| 41 |
+
|
| 42 |
### BibTeX entry and citation info
|
| 43 |
|
| 44 |
If you use this model in your research, please consider citing our paper:
|