Back to all models
Model: clue/albert_chinese_small

Monthly model downloads

clue/albert_chinese_small clue/albert_chinese_small
- downloads
last 30 days



Contributed by

CLUE benchmark non-profit
1 team member · 11 models

How to use this model directly from the 🤗/transformers library:

Copy model
tokenizer = AutoTokenizer.from_pretrained("clue/albert_chinese_small") model = AutoModel.from_pretrained("clue/albert_chinese_small")



Language model: albert-small Model size: 18.5M Language: Chinese Training data: CLUECorpusSmall Eval data: CLUE dataset


For results on downstream tasks like text classification, please refer to this repository.


NOTE:Since sentencepiece is not used in albert_chinese_small model, you have to call BertTokenizer instead of AlbertTokenizer !!!

import torch
from transformers import BertTokenizer, AlbertModel
tokenizer = BertTokenizer.from_pretrained("clue/albert_chinese_small")
albert = AlbertModel.from_pretrained("clue/albert_chinese_small")

About CLUE benchmark

Organization of Language Understanding Evaluation benchmark for Chinese: tasks & datasets, baselines, pre-trained Chinese models, corpus and leaderboard.

Github: Website: