For results on downstream tasks like text classification, please refer to this repository.
**NOTE:**Since sentencepiece is not used in
albert_chinese_small model, you have to call BertTokenizer instead of AlbertTokenizer !!!
import torch from transformers import BertTokenizer, AlbertModel tokenizer = BertTokenizer.from_pretrained("clue/albert_chinese_small") albert = AlbertModel.from_pretrained("clue/albert_chinese_small")
Organization of Language Understanding Evaluation benchmark for Chinese: tasks & datasets, baselines, pre-trained Chinese models, corpus and leaderboard.