Bauwens's picture
Update README.md
c38ef14 verified
|
raw
history blame contribute delete
No virus
307 Bytes
metadata
license: apache-2.0

To load the tokeniser for this model, do not use AutoTokenizer. Instead, install TkTkT and run:

from tktkt.models.bpe.knockout import BPEKnockout
tokenizer = BPEKnockout.from_pretrained("Bauwens/RoBERTa-nl_BPE-knockout_30k")