language: - zh thumbnail: https://ckip.iis.sinica.edu.tw/files/ckip_logo.png tags: - pytorch - lm-head - gpt2 - zh license: gpl-3.0 datasets: null metrics: null
Please Use BertTokenizer instead of AutoTokenizer!!!
BertTokenizer
AutoTokenizer