File size: 155 Bytes
4387ce7 |
1 2 3 4 5 |
from transformers import BertTokenizer
tokenizer = BertTokenizer.from_pretrained("bert-base-uncased")
tokenizer.save_pretrained("path_to_save_tokenizer")
|
4387ce7 |
1 2 3 4 5 |
from transformers import BertTokenizer
tokenizer = BertTokenizer.from_pretrained("bert-base-uncased")
tokenizer.save_pretrained("path_to_save_tokenizer")
|