For results on downstream tasks like text classification, please refer to this repository.
NOTE: You have to call BertTokenizer instead of RobertaTokenizer !!!
import torch from transformers import BertTokenizer, BertModel tokenizer = BertTokenizer.from_pretrained("clue/roberta_chinese_base") roberta = BertModel.from_pretrained("clue/roberta_chinese_base")
Organization of Language Understanding Evaluation benchmark for Chinese: tasks & datasets, baselines, pre-trained Chinese models, corpus and leaderboard.
- Downloads last month
Unable to determine this model’s pipeline type. Check the docs .